SHARE 

Example of Section Blog layout (FAQ section)
eArchiving, in search of European interoperability
PDF Print E-mail
Friday, 26 November 2021 13:41

Connecting Europe - Benefits of eArchiving | Facebook

A few weeks ago, we closed another stage in the development of eArchiving and we had to reflect on the achievements and future challenges of this project. In this post, I share our thoughts on this.

In these last two years, we have taken part of the European consortium (E-ARK3) that has maintained and managed eArchiving. This consortium was made up of 16 organizations of all sorts (national and regional archives, universities and research institutes, foundations and associations, software providers and consulting companies) from 11 European countries.

Throughout this time eArchiving has matured, both in the development of its components, as in the definition of its vision and the potential benefits of its adoption. Today, eArchiving is strongly established in the OAIS model (ISO 14721- Open archival information systems) and in facilitating that the information packages that are sent to an electronic or digital archive for their long-term preservation are structured in a standardized way that enables interoperability.

These are the main reasons why this interoperability is desirable for an electronic or digital archive:

 

  • The ability to perform joint searches in more than one digital archive and to build applications or information retrieval layers that take advantage of a standardized information structuring.
  • The ease that a standardized structured information supposes in the application of artificial intelligence (AI) initiatives based on the information found in a file or several digital files.
  • The independence of IT solution providers. If for some reason I want to change my provider of electronic archiving solutions, the standardized information packages can easily be transferred to another solution.
  • Compatibility over time, standardized information packages ensure easy transitions in technological as well as organizational changes.
  • The possibility of exchanging standardized information between a digital archive and other organizations, such as the justice system or another archive.

 

And even assuming all these benefits, why eArchiving and not national standardization or the one offered by the providers of digital archiving solutions (all promise compliance with OAIS, PREMIS and METS as a minimum).

The first answer is easy, European integration is a difficult road, but unstoppable. The eIDAS regulation and its possible successor, the EUid regulation, are already on the way to harmonize identification and signature systems. eArchiving is not yet mandatory, but it is the recommended solution for the European institutions themselves and a clear bet on the horizon.

The second is a bit more complex, because each provider of electronic or digital archiving solutions offers its own functionalities, which have nothing to do with standardized structuring and which may better or worse fit the requirements of each situation. In any case, what is important to understand is any solution based on OAIS, it has created its own way of structuring information packages. In most cases based on the same starting standards as the E-ARK specifications (the main component of eArchiving), but with slightly or moderately different results which does not promote interoperability. From a digital archiving point of view, the temptation to have a solution that can be implemented quickly can outweigh the benefits of standardization. For this reason, eArchiving has worked closely with all IT solution providers (not only those that participate in the Consortium) so that they too see the benefits of adopting eArchiving, at least in the European market.

Last but not least, for us as a consulting company, participation in the Consortium has reaffirmed our belief that cooperation is an spectacularly fruitful way of working. The necessary empathy required by working side by side with people from different cultures, languages and situations, makes you broaden your perspective and sometimes find solutions applicable to other cases, which you would not have otherwise known. This participation has made us grow in knowledge and points of view that we hope will be very useful to our present and future clients.

 
What is a records policy?
PDF Print E-mail
Monday, 27 August 2018 17:44

A few days ago, an esteemed colleague asked me for my opinion on a records policy that she had drafted and that had received some criticism from the professional community. This post is part of my answer.

Before starting to draft we must place ourselves in the context of the organization and in the purpose of the policy. In principle, a policy is a document that contains a statement of intentions by the top management of an organization with respect to a specific topic; but within this same definition there are at least two different interpretations:

1) A policy in the context of the implementation of management systems standards (MSS), is a short document that establishes the guidelines of the organization regarding an aspect, in this case records management, that is intended for all the people who work in the organization, since that is what should make the policy possible. It is the type of document that must be written when it comes to implementing the UNE ISO 30301: 2011 Standard on Management Systems for Documents . It is written in a language that is understandable to all and in pre-intranet times it was hung on the walls of the offices so that everyone could keep it in mind. That being the case, this type of policy is best not to go beyond a single page. When several management system standards are implemented within the same organization, the ideal is that the management system is integrated, which means that in many cases it is also an integrated management policy. That is, a document that covers different aspects of management, including records management. Being a short document does not mean that it is easy to write, since it must express the intention of the top management with clear and precise concepts. Of course, the management system is not based only on the policy document, but there are other levels of documents in which it is developed, defined and detailed, each of them with a different audience, according to the scope and purpose of the same.

2) A policy conceived as a technical document that includes the principles and rules for the creation, capture and management of records and that serves as the basis for the implementation of operating schemes, document management models or regulatory developments. These are detailed documents, with technical components whose comprehension is not available to anyone, and which are written by specialists for specialists. They are reference documents in change processes, which detail the decisions made regarding different technical aspects and that are necessary to guide an implementation process. This type of policy is what seems to have been imposed in different countries as a mandatory element for public administrations. In Spain, the Interoperability Technical Standard (NTI) of Electronic Document Management Policy or in Colombia Decree 1080 of 2015 "By means of which the Single Decree of the Culture Sector is issued" have opted for the term "records management policy" for this type of technical content. With this approach, great technical documents have been written, which in many cases exceed 150 pages and where all the details that serve to implement the policy are included in the main text or in its annexes. After having started reading many of them, I think it can be said that it only makes sense when you are directly involved in the process for which they were conceived, and that these are documents of reference rather than declaration of principles. As these are difficult documents in the two cases mentioned, in which the existence of the policy is mandatory, help has been provided in the form of templates or guides, which sometimes produce the opposite effect to the desired, as policies are drafted by “copy pasting”. I can affirm with knowledge that these kind of policies are useless.

When someone reads a records policy to approve and/or criticize it, they have already placed themselves in one of the two conceptions described, therefore, they will not understand a "policy" made with the other vision. The big peril is that those responsible for drafting a policy wanting to make a "mix" of the two visions, staying in "no man's land" and being criticized by all.

But, what is the solution when the organization is in a context where a technical policy is required, but at the same time the organization wants to implement a standard such as ISO 30301? For me it is a question of denomination and, therefore, should not waste too much time in discussions about what is or is not a policy. The two levels are necessary and meet completely different objectives. In some of my projects where these conditions are met we have called the technical document in another way, establishing within it that it acts as an electronic records management policy in compliance with current legislation.

Last Updated on Tuesday, 28 August 2018 09:23
 
Order, Order! Lessons learned from records management
PDF Print E-mail
Friday, 08 September 2017 14:59

Digital transformation requires records analysis and appraisal to be able to determine the information that must be created and fixed to document theprocesses and activities of the organization and, at the same time, define the requirements to manage it.

Laying the foundations on how to do this analysis and carry it out has become a major activity of my consulting work in the recent years. Taking this experience as a starting point I would like to share some  learned lessons in this post.

It seems that, the larger and more technologically advanced organizations are, there is an innate tendency to "disorganize." The division into areas or organizational units that well-meaningly seek to perform better and automate their tasks leads to a lack of overall vision. When records analysis begins, including the several areas and processes, contradictions and different ways of doing things jump very quickly into the light. It is relatively frequent that in any implementation of any computer tool records requirements are defined without considering any kind of general guideline, which results in different solutions to solve equal situations. Hence the title of this post as an old joke about a collective sex session: "order, order" is the first thing is needed.

This is reflected by understanding how the organization works and, above all, seeking synergies with other sorts of analysis that are surely being carried out inside the organization. Although sometimes in a project’s environment, it may seem that this is complicating it, but finally results in a benefit for the organization, that is what records management seeks. Examples of other general analyses that I have come across lately are: the definition of processes in an ISO 9001 implementation environment, the definition of the procedures for the "Administrative Information System (SIA)" of the Spanish public administrations or the conceptualization of a Portal for clients and users. But perhaps the most important thing is to establish clear guidelines to apply records requirements when certain process is automated or a techonological tool is implemented.  An intelligent comment I recently heard said that if the guidelines were made they would act as a riverbed, water would always go through the same place simply because it is easier than trying to change the course.

This also means that records analysis must be tailored for each organization. The archivistical tradition for this type of analysis is a very solid base, but it cannot be imposed at the cost of being isolated. We must consider that the analysis that has been done in archives has traditionally been one of self-consumption and has served to organize paper fonds once an activity has been completed. When the organizations go towards the fully digital environment, this way may not serve us.

I have taken part on many discussions on the definition of processes (procedures) and their relationship with records series. For me, and for many others in this field, the "one-to-one" relationship between process (procedure) and records series should be natural, but for that we surely need not to strictly follow the series defined for paper archives.

Likewise, I think there is a lot of potential in the classification schemes used in records management. As ISO 15489: 2016 states " classification schemes primarily exist to link the records to the context of their creation", and therefore represent the functions, activities and processes of the same. Any need in the organization to classify areas, functions and processes can use the same tool. That is why when talking about the "record classification scheme" an alert must be produced. The functions’ classification table or simply the organization’s classification is much better.

Another important lesson is that records management instruments or controls (metadata schemes, access and permission rules, disposition authorities ...) are not the goal of records management, but the means we use. Usually I repeat as a mantra "If the instrument is not useful it will have to be changed".

And in any case, we always need, when proposing how to comply with the requirements of records management, to find the balance between standardization (with equal needs propose the same solutions) and the necessary flexibility that allows the optimization of work processes.

 

Note 1:As in other occasions, for the sake of good understanding and traslation, I have used the term records analysis to describe what in ISO 15489: 2016 in English has been called "appraisal"

Note 2: When I wrote this post I just realized what an absorbing task records analysis is. I’ve been over a year without posting in my blog!

Last Updated on Monday, 11 September 2017 09:52
 
Records analysis: trends and reflections
PDF Print E-mail
Thursday, 16 June 2016 15:01

The demands of the digital environment affecting all facets of the organizations, both in public and private sector, are also producing a major change in what records analysis means or how to deal with.Analyzing processes

 

As an evolving concept, the first thing we need to understand is what it is. Substantially processes and activities of an organization are analysed to determine the information to be created and fixed to document these processes and activities, at the same time requirements are identified. In Australia and the new ISO 15489 (2016) this new concept is named as appraisal, term than in other countries is only been used for determination of retention schedules. While this new meaning is popularized and accepted, I deliberately use in this "post" the term "records analysis" to make myself understood by a broader audience.

 

The first major trend that can be observed is the necessary convergence between activities raised separately in the organizations. The analysis carried out by records managers or archivists, which in many cases was made retrospectively when the documents "came" into his hands, and the analysis conducted by specialists in processes when systemazing or designing business processes normally in the context of improvement iniciatives or process reengineering. This confluence, produced not without tensions, is imperative for organizations that want to address the digital transformation being efficient.

 

The second is records analysis should be performed prior to the implementation of a process or procedure. Therefore, the digital transformation of business processes is an ideal time to start it, and many organizations are now at that time. After that, records analisys is a recurrent activity able to incorporate changes produced by new legislation, functional changes or innovations.

 

As positive reflections, a number of professionals has began to walk this path for some time, inventing new tools such as records maps, alligning with ISO management systems (ISO 30301), or trying to establish the methodology of analysis (the ultimate experience with colleagues of Metadata in the context of the project ARPAD Xunta de Galicia). Others, such as in the recent article by Maria Garcia-Gonzalez, in El profesional de la información, research on how to systematize the analysis for local governments in Spain ("process description model" is called). International standardization in the new  ISO 15489 (2016) i, describes and explains this analysis as one of the fundamental concepts and principles of managing records.

 

However, for records professional is an important transformation of the tools and instruments used in the paper environment, which is still not taught or practiced in all contexts. We are at that moment when is difficult to identify the necessary competencies and skills needed to participate in this new paradigm of  analysis, and it is difficult to say that someone with traditional archival knowledge is prepared to do so. From my point of view, the first thing that should be assumed is the analysis is not specific to records management and records managers, but must be integrated into the definition of processes or procedures of the organization covering all kind of requirements.

 

Moreover, in the climate of immediacy around us, a previous records and well done analysis could be perceived as a slow down factor in the achievement of the objectives. The need to do the analysis in previous form, together with the endemic shortage of resources for records management, can make true that the ability to address records analysis is slower than the needs of transformation (could be the case of many public administrations in Spain having October 2018 as a deadline to implement all processes digitally).

 

Then comes the tendency to step back and decouple business processes and records management, proposing models similar to traditional paper records management. When business processes are completed records management begins. The analysis, the resulting instruments and applications for managing records are tools intended only for records management and records managers.

 

In these times of change, organizations need to decide what information management model to be implemented, and consequently how to approach to records analysis.

Last Updated on Thursday, 16 June 2016 15:34
 
E-Administration and records management
PDF Print E-mail
Tuesday, 29 March 2016 18:07

Since the end of 2015 Spain has a new set of legislation for the public sector that fully affects how documents should be managed. Law 39/2015 of Common Administrative Procedure and Law 40/2015 of the Legal Framework of Public Sector lay the foundations of how to develop e-administration and, therefore, how  electronic records in the public sector should be managed.

Overall, I welcome the content of the new legislation in what regards to document management. I think that it comes to settle and clarify the fundamental aspects, while simplifying some other issues that had unnecessarily complicated implementations. This is not to deny that some issues have already sparked some debate and the practical implementation is still pending to be solved.

The big change introduced by this laws is to establish e-administration, and therefore electronic procedure, as the only possible. It's no longer a project of transformation by the leading administrations, but the norm. The exception is now the use of paper, which is relegated to a few isolated cases that should not affect electronic transactions as the norm. This is a breakthrough, as in common parlance it means that governments in Spain shall stop producing paper within the deadlines established by the laws. The possibility of "hybrid cases," an idiom so ugly as complicated and expensive in its practical implementation, is beyond discussion. We shouldn't spend more resources and brain cells defining this practice!

Besides the main change, I had to carefully review this legislation to prepare the course I teach in SEDIC. I have gathered the most important issues in this table.

 

ASPECT

COMMENT

Register for income documents

There will no longer be to types of registers: one for paper, with its structure and staff, and other for E-documents, managed by the IT department. There is only one. The organizational transformation of the register offices will be a great change (dateline: Oct. 2018)

 

Electronic Registrar: Handling of Paper Documents

Only citizens (natural persons) have the right to present paper documents if they choose. This measure aims to limit this practice leaving it as a residual situation. Register offices are required to scan the document while they register it and return it to the citizen. Any doubts whether it can be destroyed or not, or on who has to authorize the destruction are ended.

 

E-Signatures: Differences between means of signature and means of identification

From a records management point of view this clarification together with the specification of the different types of e-signatures helps to separate the signature of documents and the means of identification

 

Documents to be signed by citizens

By explaining clearly in what types of documents shall an electronic signature be used : Requests, Responsible statements or Communications, Appeals, Waivers and Refusals; not only do they help by simplifying the use of the signatures, but they also clarify the main document types.

 

Administrative Public Documents

The documents produced by public authorities have to be electronic. These are the ones to be managed, forget all possible paper copies.

 

Electronic Cases

Clearly defined as a grouping of documents, indicating that mandatory reports, a certified copy of the resolution and a numbered index of documents should always be included.

Somehow it moves away from the complexity of the "ENI (National Interoperability Framework) Cases," which seem to only be used when they need to be refered to another administration. The debate is open.

To highlight a curious contradiction, the law states that a record can be in more than one case and at the same time, but for for the resolution it requires a certified copy to be included.

 

Metadata

Although the concept is too technical for a general law, it is used at least three times, referring to the metadata that records and copies should have. Undoubtedly we will have to be supported by subsidiary legislation.

 

Single Electronic Archive

It is one of the concepts that more debate have arisen, especially among archivists who have to make it compatible with an existing legislation based on a paper custodial model (departmental archive, central and historical). I prefer to see it as an advance with technological: a single repository, and organizational consequences: criteria, processes and methods common to all documents and cases.

It circumscribes the electronic archive only to records pertaining to finalised cases. Apart from the question, meanwhile what shall we do with electronic records? It gives rise to different approaches that probably require another post (see post Paco Fernandez in his blog: "El Archivista")


Conditions of access to electronic archive

Without establishing it explicitly, the idea of single electronic archive and the conditions to access it seems to carry the same implicit idea that records and cases must be accessible without using processing applications. We can not therefore leave the logic of permissions and access only in the hands of the later.

 

Last Updated on Friday, 01 April 2016 08:42
 
<< Start < Prev 1 2 3 4 Next > End >>

Page 1 of 4