Tag: data

Categories
Research Process

Getting Started: Compiling the Data

The Mapping Museums project aims to identify trends in the growth of independent museums from 1960 to 2020. In order to conduct our analysis we need to be able to interrogate longitudinal data for a number of museum variables, including years of opening and closure, size, and status change. At present, no such database exists that would allow us to do so. Ironically, for a sector committed to the preservation of cultural memory, documenting the institutions that participate in these activities is seemingly much less of a priority (see ‘Problems with the Data’ post). Thus, the first objective of the project was to create a functional database that catalogued all of the museums that have existed in the UK since 1960.

Before we began building this database we first considered the logistics of the process, namely the point during our timeframe when it would be best to begin to collect the data. Should we put together a snapshot of the nation’s museums as of 2016 (estimated at 2,500 at the outset of the project) and work backwards, or begin with a baseline of around 900 museums that existed in 1960 and work forwards? The former would give us a solid foundation but might require tortuous weaving back through name changes and amalgamations; the latter would give us fewer museums to start with, but might be easier as we attempted to record individual museum trajectories.

The solution was a compromise based on time and the availability of data. Between 1994 and 1999 the Museums and Galleries Commission ran a programme that produced the Digest of Museum Statistics (DOMUS). It involved annual reporting from museums that participated in the scheme in the form of  lengthy postal surveys. The information captured included address, registration status, visitor numbers and many other characteristics. While some limitations with the data have been highlighted in retrospective analyses (specifically by Sara Selwood in 2001), the baseline data that DOMUS provided was sufficient for our needs.

Using this as a starting point enabled us to begin with detailed information on nearly 2,000 museums. This snapshot of the museum sector in the late 1990s provided us with the flexibility to work both forwards and backwards in time. In particular, having records of museums at an interstitial stage of their development has been helpful in tracking (often frequent) changes of name, status, location and amalgamations.

The major problem with the DOMUS survey was accessing the data and formatting it for our use. After the project was wound up in 1999 the mass of information it had generated was deposited at the National Archives. However, given the complex nature of the data, there was no way of hosting a functional (i.e. searchable) version of the database. Consequently, it was archived as a succession of data sheets – in a way, flat-packed, with instructions as to how the sheets related to one another.

The first task was to reassemble DOMUS from its constituent parts. This meant trying to interpret what the multiple layers of documents deposited in the archive actually referred to. While the archival notes helped, there was still a great deal of deductive work to do.

Once we had identified the datasheet with the greatest number of museums to use as our foundation, the next step was to matchup associated data types held in auxiliary sheets into one single Excel master sheet. To do so we used the internal DOMUS numbers (present within each document) to connect the various data to create single cell data lines for each individual museum. We slowly re-built the dataset in this way.

In some instances the splitting of the data – while presumably logical from an archival perspective – was frustrating from a practical standpoint. A particularly exasperating example was that museum addresses were stored in a separate sheet from their museum, and had to be reconnected using a unique numerical reference termed ADDRID. While the process was relatively straight-forward, there was always a degree of anxiety concerning the integrity of the data during the transfers, and so regular quality checks were carried out during the work.

The next step was to clean-up the reassembled sheet. Firstly, we removed anything from the data that was not a single museum (e.g. references to overarching bodies such as Science Museum Group). Second, we reviewed the amassed data columns to assess their usefulness and determine what could be cut and what should be retained. Thus, old data codes, fax numbers and company numbers were deleted, while any information that could potentially be of use, like membership of Area Museum Councils, was retained. We also ensured that the column headings, written in concise programming terminology, reverted back to more intelligible wording.

This formatting helped shape the data into a usable form, but the final step was to put our own mark on it. Thus we devised specific project codes for the museums, which was useful for recording the source of the data and managing it effectively moving forwards. To tag the museums we decided on a formula that indicated the project name, the original data source, and the museum’s number in that data source (e.g. mm.DOMUS.001). Once our database is finalised, each entry will be ascribed a unique, standardised survey code.

Ultimately, the DOMUS data has acted as the bedrock of our database. It provided a starting point of 1848 museums and thus the majority of our entries have their basis as DOMUS records (which have been updated where applicable). One of our initial achievements is that the DOMUS data is now re-usable in some form, and this may be an output of the project at a later date.

A wider lesson from this process is the importance not only of collecting data, but ensuring that it is documented in a way that allows researchers to easily access it in the future. When our data comes to be archived in the course of time, the detailed notes that we have kept about this process – of which this blog will form a part – aim to provide a useful guide so that our methods and outputs can be clearly understood. Hopefully this will allow the history of the sector that we are helping build to be used, revisited, and revised for years to come.

© Jamie Larkin June 2017

Categories
Research Process

Problems with the Data

When I first began this research I had assumed that there was very little data on the museums that were founded in the late twentieth century. In fact, the contrary is true. A great deal of information has been collected about museums from the 1960s onwards. By our reckoning there were at least nine major cross-UK surveys, three that concentrated on Wales, two on Ireland, and one apiece on museums in Scotland and England. Dozens of smaller surveys concentrated on specific regions or aspects of the sector, Arts Council England keeps lists of museums across the UK, and the Museums Association runs a Find-A-Museum service. Why then, is it so hard to get information about the rising numbers of museums? In this blog I identify five reasons why this massive amount of data has not translated into information.

 

  1. Lost data

The first major survey that falls within our time period is the Standing Commission Report on Provincial Museums of 1963. Very conveniently, it is available in print form from major public libraries, and contains both the final report of the committee and a complete list of museums sorted according to region. From there onwards, however, the raw data largely disappears from government publications on the subject. The 1973 Standing Commission report, for instance, enumerates the different types of museums and provides an overview of emerging trends, but it does not provide a list of museums or the information that relates to individual venues, which we need if we are to track the emergence and development of the sector. As far as we know, the original data that was collected for that survey and for subsequent surveys conducted by the Standing Commission has been lost.

Research on museums conducted by other organisations is similarly missing. In 1983, the Association of Independent Museums (AIM) undertook a large-scale survey of that sector, but they do not seem to have published a report, and initially we were only aware of the survey’s existence from a handful of references in other contemporaneous sources. After some time, however, we found photocopies of the typewritten lists and the original survey questionnaires lodged in a university archive. We have been less successful in finding the information associated with the ‘UK Data base project’ of 1987. The Museums Association, which ran the survey, has a small in-house archive and its historic materials are kept at University College London. Unfortunately, neither archive contains any of the relevant materials. No-body in either organisation has any recollection of the survey taking place or any idea of where the material went, although it is likely that the UK Data base materials were thrown out when the Museums Association moved offices earlier this century.

  1. Indecipherable data

A second problem for researchers interested in the museums of the late twentieth century is whether the data is usable or not. One of the most important surveys of UK museums was the

Digest of Museum Statistics, otherwise known as DOMUS. From 1994 to 1998, it collected information on all accredited museums, some 1700, and generated a huge amount of material. When the project was closed, most of the paperwork was deposited in the National Archives and so researchers can easily find and download documents pertaining to the surveys. The problem is, the material is difficult to decipher. As well as some documentary material, the archive consists of three folders, each containing around fifty files that contain the raw data from DOMUS. All of the folders and files have coded names. The files comprise of spreadsheets with numerous columns that have similarly opaque headings. Some sheets are virtually empty, while others contain over two thousand entries. There is no explanation as to how these tables relate to each other, what the files or columns refer to, or how the user is supposed to decipher them. Using this data requires someone to unlock the coding system and re-constitute the original database.

  1. Data that is not easily accessible

The Museums Association currently compiles the most extensive dataset relating to UK museums. Their Find-A-Museum service lists information on the whereabouts, visitor numbers, staff, subject matter and governance of around two thousand museums. However, the Museums Association is a commercial enterprise and accessing this data incurs a fee. Users must pay to join the association and cover the subscription charges for the Find A Museum Service, at a minimum cost of around £186 for an individual or £450 for an organisation. In addition, the data cannot be downloaded or manipulated, and can only be examined via the service’s own rather limited search engine. Find-A-Museum is intended for museum professionals who want to look up information on specific venues, and is not designed with researchers in mind, but it does mean that one of the most substantial data sources on museums to be available in the UK cannot be used for broader analysis.

Other lists and surveys of museums are compiled by the various government bodies that oversee museums, namely, the Arts Council England (ACE), the Northern Ireland Museums Council (NIMC), Museums Galleries Scotland (MGS), and the Welsh Museums, Archives, Libraries Division (MALD). These organisations do not publish their data although they do make it available on request and without charge. In our experience, the four government bodies have been very helpful in the provision of data but we are aware that they do not have staff whose role it is to deal with such requests and there is no automatic or established mechanism by which data can be obtained.

 

  1. Incompatible data formats

Having acquired data from the various surveys and lists conducted by ACE, NIMC, MGS, and MALD, researchers will find that each of the government bodies collects different data, with significant variations in the level of detail, and about slightly different kinds of organisations over a range of dates. The spreadsheets cannot be simply merged. Moreover, if researchers want to include historic data, as we do, this all has to be transcribed by hand.

 

  1. Partial and missing data

On collating the available information, researchers might spot a further problem, which is that surveys and lists compiled by government bodies invariably concentrate on accredited museums. The accreditation scheme, which is co-ordinated by Arts Council England, establishes that a museum has achieved professional standards, but small independent museums often lack the staff or the know-how to apply for accreditation, or may not meet the criteria set by the scheme. Museums Galleries Scotland and the Museums Archives Libraries Division in Wales invite non-accredited museums to make themselves known and they do list such venues in their reports and on websites, although submitting data still requires a certain degree of professional capacity or interest. Thus as far as the official reports are concerned, small independent museums are routinely omitted. Indeed, the only survey to have actively sought information on such venues was the one conducted by AIM in 1982/3, and never published.

There are also other omissions. Properties owned by the National Trust register in some surveys and not in others, while few surveys include art galleries that do not have permanent collections, so established venues such as the Baltic in Newcastle or the Whitechapel in London rarely appear in the data.

Finally, information that is essential to a historically minded researcher is less relevant to museum professionals who focus on the current environment. Only one of the surveys registered the foundation dates of museums, and none have listed closure. Once the doors of a museum have been shut to the public, that venue ceases to appear in surveys.

 

In summary, then: Over the last five decades several associations and government departments have collected an enormous amount of information about UK museums. There is no lack of data. There are problems with archiving, making that information comprehensible and accessible, with sharing data across national and organisational borders, with collecting historical data and information on venues that do not reach professional standards or that do not quite fit an orthodox model of museums, and on compiling data. These factors help explain why researchers cannot elucidate recent developments within the museum sector and specifically the emergence of independent museums. There is a wider question, however, about why arts organisations seem to have been so poor at keeping, managing and sharing data. Thoughts on that matter would be welcome, as indeed would any clues as to the whereabouts of the data collected for the 1987 UK Museums database project and for Standing Commission surveys other than the 1963 publication.

©Fiona Candlin May 2017

Categories
Research Process

Not Knowing About Museums

There is a lot that we don’t know about museums. In an age when it is possible to download an institution’s annual reports and follow their exhibitions and events via social media, it seems unlikely that academics, museum professionals, and the museum-going public would be so uninformed about the recent history, characteristics, and scope of the sector. That situation seems doubly unlikely if we note the growth of audit culture, in which public venues are required to account for themselves to taxpayers and policy-makers, and trebly so when we consider the vast scholarship on museums. And yet it is the case. This situation is not limited to museums in developing nations. It equally applies to America and Western Europe. Granted, these areas contain tens of thousands of museums, but even at the smaller scale of the UK, which is the focus of this research, our overview of museums is remarkably sketchy.

We do know that the number of museums boomed in the late twentieth century. In 1960, the Standing Commission for Museums and Galleries took a census and listed some 896 museums. When the same commission took a census a decade later they reported that there were over 1,000 museums and, sounding somewhat anxious, they commented that there were no controls on their formation. No such restrictions were introduced and the number of museums continued to rise. The 1978 Standing Commission described the ‘sheer proliferation’ and ‘bewildering fecundity’ of the sector and, in the mid-1980s commentators started declaring that museums were opening at the rate of one a fortnight, and then one a week, or even three a week. By 1986 government reports placed the number of museums between 2000 and 2,300, although one survey thought it might be as high as 3,500. The official total subsequently inched to around 2,500 and, according to the Museums Association, that figure has remained more or less stable. At the very least, the number of museums has increased by around 180%.

We also know that the vast majority of those museums were independent, in that they did not receive direct funding from the state. In 1960 when the Standing Commission conducted its survey, around 300 museums were independently managed, about one third of the total, whereas in 1986 that statistic was more or less reversed, with around 1800 of a total 2,300 museums being independent, the remainder being national, local authority, university or regimental museums. This made them the single biggest type of museum within the sector.

The boom in the number of museums was and is recognized as a cultural phenomenon, but beyond the rising numbers and the fact that the majority of the museums were independent organisations, we have very little information about it. We don’t know exactly where the new museums opened within the UK, or when, or what subject matter they covered. Nor do we know if these new museums survived, or when they closed, or how many new museums opened: There may be around 2,500 museums but it is entirely possible that hundreds have closed and hundreds have opened in the past few decades.

Now I confess, that when I first realized that there was relatively little information on the development of the museum sector, I judged it to be little more than an inconvenience. At the time I was working on my book Micromuseology: an analysis of small independent museums and I was wholly uninterested in the specifics of whether there were more museums in the English Midlands than in the Scottish Highlands, or how many museums were devoted to hats as opposed to trains. That seemed like bean counting, a quantitative exercise that would reveal nothing of substantial interest about the sector. It took some time before I realized quite how wrong I was. Having this information would enable me to write new and very different histories of museums in the UK, and to begin to understand how the sector had changed. More than that, it would allow me rethink dominant preconceptions about the location and production of culture in Britain. Once I realised what the information would enable I started to wonder if it could be compiled, and is so, how. Over the following year I began to plan the Mapping Museum project, which eventually gained funding in June 2016 and was launched in the October of that year.

Over the next few blog posts I’ll explain a little about why the data was missing and how the Mapping team has begun to compile a dataset of all museums that opened (and closed) in the UK between 1960 and 2020.

 

©Fiona Candlin May 2017