This article discusses the challenges that contemporary technology present to records management. The costs of traditional records management are increasing. At the same time Cloud computing provides an exciting opportunity to contain costs while increasing organizational capability. Good records management is fundamental to the sustainability of organizations but is seldom seen as anything other than a burdensome addition to the day job by employees. In grappling with the implications of digital and paper records, records managers are not yet dealing with the fact that the sheer economics, volume and challenge of managing information — as records or other ‘stuff’ — simply mandates an automated technical easy to use solution. The Cloud, because it operates at the level of content, can drive dramatic change in the professions working on content management and address the continual expansion in the content created — and this includes forward thinking records managers. The Web together with the Cloud also delivers a new challenge to records management — to open up content for others to use in inclusive participation not hide it away for exclusive use. The article argues that Cloud based innovation will stimulate organizations to reconsider what information they wish to protect and what to release. In a digital world transparency rather than protection will be the stronger influence as seen in the UK’s government plans for opening up data. Organizations will use far more information from the Web and internally will see that it has become simpler and better to recreate much of the information, now protected as records, than to rely on stored old versions. The new records management lifecycle needs to promote an obsession with content use rather than protection. The capture of contextual data at source will transform the way a record can be used. The cost of storage will cease to be an issue instead new values of storage will drive policy. Records management will become use based not store based and placing the new activities of records management at the heart of the living company.
In this series of articles for Business Information Review, I have discussed the dramatic impact of technology and digitization on the world of information. At times, these articles have addressed the need for new skills and competencies from the Information Scientist; they have also introduced the impact of big data in science and society. In this article, I use my recent experience in academic research to explain how the essential disciplines of good records management (RM) are a necessary foundation for big data research. Like the quality movement of the 1990s, embedding good RM in big data research will avoid costly rework, illuminating erroneous conclusions and advancing research. There is more that the Information Scientist can bring to big data – managing the unpublishing process and guiding the integration of documents via structured data. Areas in which Information Scientists have the necessary background, discipline and experience.
Our world is being challenged by the wealth of content produced by digitization – up to now we have been thinking about the volume of information and our own cognitive limits. The rush of digitization and computerization has increased our ability to apply formulae to data, but not our ability to reason and argue. From the written word we might have been aware of the explosion in data in the significance of ‘big data’, a phenomenon which undermines the certainty of our own world in publishing and user-generated content such as the web. This article is based on the schisms in data analysis and the different philosophies of the frequentists and the Bayesians. Their philosophies illuminate a challenge from ‘big information’ – a challenge of information morality and reasonable doubt. Instinctively, we use information to remove doubt without recognizing that increasing information also changes reasonableness; the morality of information is determined by the ratio of signal to noise. ‘Smoking gun’ evidence is only compelling in that you are in no doubt as to the crime. As information increases, we assume it becomes harder to conceal the truth but forget that information itself produces falsehoods – we increase both the signal and the noise. In information poverty the essential skill is that of husbandry; in information excess the essential skill is becoming that of interpretation.
We are all very familiar with the miniaturization of technology, but in this article I develop the case for the miniaturization of published information. With the introduction of Gdrive there is a universal infrastructure for the intimate integration of content, accessible as a continuous stream of information delivered to a new generation of tablet devices. The technological revolution is dismantling the old bulk handling of information in files and books into a new micro quantum based on integrating MicroFormats. It demands new thinking and, for those currently working as information professionals, a new metaphor – of Quantum information. Coming with this change is much improved usability, improved scholarship, better information flow and new opportunities for publishers.