Categories
Research Process

Missing, massaged, and just wrong: Problems with visitor numbers

Visitor numbers provide some sense of the scale of a museum’s operations. If a museum has a large collection of priceless artefacts, occupies an impressive building, has professional curators and conservators, a nice café, and offers activities to its audiences, then it is unlikely to attract a mere 2,000 visitors per year. Conversely, if a museum is housed in a defunct railway station, with one retired locomotive on exhibition, and is staffed entirely by volunteers, then it would be surprising to discover that it gained millions of visitors. There is a link between a museum’s provision, and its visitor numbers. Thus by listing visitor numbers for the museums in our dataset, the Mapping Museums team intended to provide researchers with some guide as to the organisations’ size and character. However, this process was not as straightforward as it initially seemed.

One problem is that visitor numbers are not always available. Figures for larger institutions are reported in the national monitor Visit Britain. Information on attendance at accredited museums is published by Arts Council England, and the Museums Association usually includes visitor numbers on the Find-A-Museum service listings. Obviously, museums that are not accredited or are not members of the Museums Association do not appear on those sites. Unaccredited, unaffiliated museums may sometimes note their visitor numbers on their own website or annual report, but more often, that information cannot easily be found. Moreover, visitor numbers may not exist as such. Collecting that information requires staff capacity and resources that are beyond the reach of some organisations, and while the lack of documentation or the complete absence of data may indicate low visitor numbers, that correlation cannot be guaranteed.

Problems with visitor numbers are not confined to a lack of information. Even when visitor numbers do exist, they cannot be relied upon. One issue is that there is no accepted methodology for how visitor numbers are collected, and institutions each decide how to accomplish this task. In some instances, museums log everyone who comes through the door. However, if the museum or gallery has conveniently placed toilets, as was the case at Middlesbrough Museum of Art, then people coming to use the facilities raise the footfall. Cafes can similarly boost the total visitor count. Other museums only record the number of visitors who enter into a gallery or look at artwork, although those criteria can be met by putting artwork or displays into the foyer of a museum. It is also unclear whether people who participate in outreach or other activities are included in total numbers. We found one very small museum that reported 42,000 visitors because they organise an annual rally and included all the attendees. Who is doing the counting and how they count has a significant impact on the recorded visitor numbers.

Methodology aside, visitor numbers are sometimes actively massaged. Adrian Babbidge commented in a recent article for Cultural Trends, there are strategic reasons for inflating them and the Mapping Museums team found instances where disparate numbers had been reported. For instance, one museum stated that it had less than 20,000 visitors a year on its AIM membership forms yet claimed 30,000 visitors per year on a fund raising website. If its actual numbers were closer to 30,000 then by tweaking figures, the institution saved a little on membership fees, and if the lower number was more accurate, the upwardly adjusted figure might have improved their chances of raising money. The Mapping Museums team has also encountered cases where visitor numbers were purposefully deflated. At least one small museum had under-reported ticket sales to avoid paying tax on that income. This had the consequence of them appearing to have lower visitor numbers than is in fact the case.

Another set of difficulties obtain when dealing with historic visitor numbers. As we’ve noted before, the Mapping Museums team is documenting UK museums from 1960 until the present day. Where available we have recorded visitor numbers that pertain to that period, and most notably, we have included figures from the massive DOMUS survey that was run between 1994 and 1998. This has the advantage of providing size indicators for museums that have now closed but we have discovered that some of the DOMUS records are anomalous. For example, The Royal Electrical and Mechanical Engineers museum is listed as having the following audiences in successive years.

4,500 in 1994

20,000 in 1995

35,000 in 1996

5,000 in 1997

According to these figures, the number of visits increased eightfold in a two year period, and then reverted to its original numbers. This seemed unlikely so we contacted the museum. The director, Major Rick Henderson, told us that the museum had never attracted such high visitor numbers. Even now, with a dedicated staff and a new building, attendances are in the region of 20,000. It is therefore likely that the inflated figures are due to errors made when the data was entered into the DOMUS system. The problem is that we cannot check all the anomalies, partly because of time but mainly because many of the museums have since closed and the institutional memory lost.

Thus, there are several challenges to using visitor numbers to give a sense of the scale of a museum: it is difficult to find figures for unaccredited museums or they may never have been collected; there is no established methodology for collecting visitor numbers; museums massage audience numbers for strategic purposes; and historic records may be incorrect.

The Mapping Museums team decided to deal with these various issues by using categories for size rather than visitor numbers. Providing precise numbers may give the false impression that the figures all adhere to the same measure and can be compared, whereas categories provider a looser guide to a museums operations. Unfortunately, using size categories also has its complications, which I will outline in the next blog.

Copyright Fiona Candlin 2018

Categories
Lab News

Two Years On: An Update

The Mapping Museums project is coming to the end of its second year. To mark the half way point of the research, this blog provides a brief update on some of the work so far.

Finalising the data
Early this year, Dr Jamie Larkin, the researcher, completed the main phase of data collection. We are continuing to make changes to the dataset as new museums open and existing museums close, and we’re still trying to hunt down some missing opening and closing dates, so it remains work in progress. Nonetheless, we now have information on almost 4,000 museums that have been open at some point between 1960 and the present day.

Evaluating the knowledge base

Alongside data gathering, we have designed a knowledge base that allows users to browse, search, and visualise the data in nuanced and precise ways, and which we described in our last blog (See: Managing Patchy Data). As part of the design process, Professor Alex Poulovassilis, the co-investigator on the project, and Nick Larsson, the Computer Science researcher and developer of the knowledge base, organised a series of trials to evaluate the knowledge base. These provided us with valuable feedback and we responded by making changes to how the material is presented and navigated.

We got enormously positive responses at the most recent user trial in Manchester in July. Having lived and breathed the research for the last two years it was very encouraging to hear Emma Chaplin, director of the Association for Independent Museums, call it the “museums equivalent to YouTube” and say that she could while away hours browsing the material; to know that staff from Arts Council England thought that it was “intuitive  to use”; and generally that the trial participants assessed it as a being a useful resource for them in their roles and for others in the sector.

Analysing and publishing the findings

Having finished the data collection and the main phase of developing the knowledge base, we have been able to start analysing the data. These initial analyses will be the basis of a series of articles, and over the summer, the team has been working on four publications:

  • ‘Mapping Museums and managing patchy data’ examines the reasons why data on the museum sector is so incoherent, how the project sought to remedy that situation, in part by building a system that acknowledges uncertain information.
  • ‘Where was the Museum Boom?’ looks at the massive expansion of museums in the late twentieth century and asks whether or not the boom took place across the UK, or if there were regional variations.
  • ‘Creating a Knowledge Base to research the history of UK independent museums: a Rapid Prototyping approach’, covers the computer science research that underpins the conceptualisation and construction of the knowledge base.
  • ‘Missing Museums’ deals with the recent history of museum surveys, considers the focus on professionalised museums, and asks what the sector looks like when we factor in unaccredited museums.

Brief versions of the first and second of these papers were also presented at conferences: Digital Humanities Congress at Sheffield University and Spatial Humanities at Lancaster University, both of which took place in September, and we hope that the full versions of all four articles will be published within the next academic year. We’ll let you know when that happens.

The process of analysing data has been greatly helped by having Dr Andrea Ballatore join the team early in 2018. Andrea is a Lecturer in GIS and Big Data Analytics in the Department of Geography at Birkbeck and he is leading the statistical analysis within the project. He has also made invaluable contribution to developing the knowledge base, particularly with respect to mapping the data.

The Mapping Museums Team

Categories
Research Process

Modelling Patchy Data

How do researchers manage when they have missing data? One of the initial aims of the Mapping Museums project was to establish an authoritative dataset of all the museums open between 1960 and 2020, and to record information on their location, governance, accreditation status, subject matter, opening and closing dates, and visitor numbers. Having this material would provide the first step in constructing a nuanced, evidence-based history of the development of the museum sector during the period, and so the research team began to compile information from numerous sources: surveys conducted by government bodies, by the Association of Independent Museums, and the Museums Association; lists of museums held by the national organisations for the arts; guidebooks; and websites. The researchers also got in touch with dozens of tourist boards and local history groups, and hundreds of curators and volunteers to follow up leads or information. All this material was cross-checked within the team, and then reviewed by experts from the Museum Development Network.

We now have a rigorously researched list of museums in the UK from 1960-2020. Even so, there is still a considerable amount of missing data. When the first phase of data collection was finished we had identified almost 4,000 museums and had established the following coverage of their key attributes:

  • Museum opening dates: 88%
  • Museum closing dates: 6%
  • Governance: 92%
  • Visitor numbers: 67%

The question then was, how were we to represent and model the missing dates, governance, and visitor numbers within our analysis?

At the same time as collecting data, we started to build a knowledge base that allows users to explore. The system is designed so that users can browse in a structured way through the categories of accreditation, governance, location, size, subject classification, year of opening and year of closing, and see the results on a map or in a list view. Alternatively, they can submit a detailed search that allows them to filter results by combinations of the categories above, or they can generate visualisations of how the different types of museums have emerged over time and create tables showing how the various categories inter-relate. At any point, it is possible to scrutinise the details of individual venues.

One option for dealing with missing information was to exclude museums with missing data from the relevant searches. The problem with that approach is that incomplete data tends to be associated with small, unaccredited museums or with museums that have since closed and so excluding them on this basis would bias our analysis in favour of extant established museums., which would be counter to the purposes of the project as a whole. Thus, when we could not identify a museum’s governance, we assigned it a value of Unknown. The advantage of an explicit Unknown category is that the missing data is made apparent, and the problem of data patchiness is exposed rather than hidden.

We took a different approach to opening and closing dates because we often had rough information about these rather than no information at all – for example, we might know that a museum had closed at some point in the 1990s. This approximate information would be lost if we just categorised a date as ‘unknown’. Therefore, we decided to use a date range of the form (earliest possible year, latest possible year) to capture imprecise knowledge about museum opening/closing dates. These date ranges are used in different ways across the different facilities provided by our system:

  • In the Browse facility, we take museums’ opening/closing dates to be the mid point of the specified date range.
  • In the Visualise facility, event occurrences are ‘spread’ equally over a date range. For example, if a museum is known to have opened between 1965 and 1969, then the count of one museum opening is spread over that time period (i.e. a count of 0.2 is assigned to each of the five years 1965, 1966, 1967, 1968, 1969).
  • In the Search facility, the user has the option of searching by definite dates so that the results exclude all the museums with date ranges attached, or by possible dates, in which case the results include museums where the date range intersects with the specified period. This allows for a much more nuanced analysis.

Looking in more detail at how Search works, opening and closing dates are stored as a pair of years (f,t) in our database, where f and t may be the same year if we know the year of opening/closing for certain.  So, for example, the pair (1965,1969) would be stored for a museum known to have opened between 1965 and 1969; and the pair (2011,2011) would be stored for a museum known to have closed in 2011. Modal Logic operators are supported by our system’s Search facility that allow the user to query whether a particular museum definitely or possibly opened/closed in a given year.  In particular, suppose a given museum ‘m’ is recorded as having opened in year ‘f’ at the earliest and year ‘t’ at the latest.  Suppose a researcher wishes to find out whether museum m opened before, on, or after a specified year ‘d’.  Then the following comparison operators are supported by our system to allow the researcher to determine whether this is definitely the case:

Comparison operator Implementation logic
(f,t) = d  DEFINITELY ON A SPECIFIC YEAR f = d  and t = d
(f,t) < d  DEFINITELY BEFORE t < d
(f,t) <= d DEFINITELY BEFORE OR INCLUDING t <= d
(f,t) > d  DEFINITELY AFTER f > d
(f,t) >= d DEFINITELY AFTER OR INCLUDING f >= d
(f,t) != d DEFINITELY APART FROM t < d OR f > d

 

And the following comparison operators are supported to allow the researcher to determine whether this is possibly the case:

 

Comparison operator Implementation logic
(f,t) = d POSSIBLY ON A SPECIFIC YEAR f <= d AND d <= t
(f,t) < d  POSSIBLY BEFORE f < d
(f,t) <= d POSSIBLY BEFORE OR INCLUDING f <= d
(f,t) > d POSSIBLY AFTER t > d
(f,t) >= d POSSIBLY AFTER OR INCLUDING t >= d
(f,t) != d POSSIBLY APART FROM not (f=d and t=d)

 

The same comparison operators are available for interrogating closing dates.

We employed a further strategy for visitor numbers, which is the least complete category and has discontinuities that make it difficult to compare like with like.  Our primary objective was to use visitor number data to provide an indication of the size of the museum and, given the patchiness of the information, we decided to have a category of Unknown and also to gross numbers into size categories of Large, Medium and Small, where large and small also have sub-categories. This approach enabled us to include data from the Association of Independent Museums and Arts Council England who generally provide visitor number ranges rather than precise figures, and to use predicative analysis to establish broad size ranges. It also allowed us to circumvent some of the methodological problems of having figures collected by different means and from across the decades. Users can browse or search according to these size categories, and in addition, they can search according to precise date-stamped visitor numbers where available.

In conclusion, in the Mapping Museums project we have managed data patchiness in a variety of ways: designing a flexible knowledge base that can be modified and added to as required; representing absence rather than ignoring unknown information; using date ranges and providing users with the option of searching by definite or possible dates; and apportioning the probability of an opening/closing event occurrence over the estimated time interval for statistical analysis. Rather than implying that all visitor numbers data are of equal reliability, we created size categories for a large number of museums, and provided the means to search the definite but incomplete data that was available.

Fiona Candlin, Alex Poulovassilis
September 2018

Categories
Research Process

Historic Buildings: In or Out of the Surveys?

In the process of compiling a list of all museums in the UK from 1960 until 2020, the Mapping Museums team have collected data from previous surveys and sources. As I discussed in previous blog posts, we found that surveys had excluded art galleries without collections, and to a large extent, unaccredited museums. Historic buildings are different in that their inclusion is uneven. They are listed in some circumstances, and not in others.

When the Standing Commission for Museum reviewed the sector in 1963 they included historic buildings that were managed by the Ministry of Public Buildings and Works (later English Heritage), but they only listed National Trust buildings if they contained a stand-alone museum. By contrast, when the Museums Association launched the massive Museums.UK Database in 1987, they included historic buildings and stated that the content of the building, and arguably the building itself, could be considered a collection: a venue did not need to have a stand-alone exhibition in order to qualify as a museum. The Museums Libraries Archives Council later reinforced this position when they clarified the 1998 definition of a museum by noting that ‘a collection is an organised assemblage of selected material evidence of human activity or the natural environment, accompanied by associated information. As well as objects … held within a museum building, a collection may include buildings or sites’.

From the early 1980s onwards there has been a broad consensus that historic buildings can be counted as museums. The difficulties or the unevenness around their inclusion in museum surveys and lists has two sources. The first is that historic buildings drop out of the data for the same reasons as small independent museums, which is that they do not always comply with the standards outlined by the accreditation scheme (I discussed this point in my previous post). Some of these venues might be owned or managed by major organisations including the National Trust, others and particularly stately homes, might be owned by individuals or families and thus do not meet the requirement that museums must be held in trust.

The second and more complex reason for the uneven data on historic buildings concerns the different organisations involved in their preservation, and the variety of process. Each of the four countries has a national development agency for museums, or in England, for the arts, this also having responsibility for museums. In addition, each nation has organisations that oversee the preservation of national heritage or environment or buildings: English Heritage Trust, Historic Environment Scotland, Cadw in Wales, and Historic Environment Division in Wales.

The four sister organisations have relatively similar holdings in that they look after a mixture of stately and historic homes and buildings, monuments, and sites. Crucially, however, each of these organisations takes a different approach to accreditation, which has an impact on which venues appear on lists of museums and thus on which sites are recognised as museums. In consequence, English Heritage runs thirty ‘museums’, Historic Environment Scotland seemingly operates three, while Cadw and the Historic Environment Division in Northern Ireland have only one museum apiece and in both cases that remains unofficial in that it does not appear in the records kept by that nation’s museums council. In each case, the organisational structures and histories of the departments responsible for historic buildings and environment result in different outcomes as to whether a historic building constitutes a museum.

There is no particular merit in a building being considered a museum or a heritage site. The issue is not whether something ought to be counted as a museum or a historic building. Rather it is the effect of that designation on how the museum sector is depicted. The different attribution potentially produces a skewed picture of which nations have more or less museums of a particular kind, and it potentially underplays the number of historic buildings that function as museums.

Again, this situation leaves the Mapping Museums research team with questions. Do we include those historic houses and buildings that are owned by the national bodies, although officially they are not designated as museums? Do we include those historic houses that remain in private hands? What do you think?

Categories
Events

Participate in our web application evaluation sessions!

Can you help us to evaluate the Mapping Museums web application?

Mapping Museums is a large-scale research project that is based at Birkbeck, University of London. It aims at documenting at analysing the development of the museum sector between 1960 and 2020. So far, the team has collected a rich range of data on approximately 4000 UK museums, and we have developed a web application that enables users to browse, search, and visualise that information.

The evaluation session is an important means for us to gain feedback about the usefulness of the web application. With your input we can further improve the system before it is made publicly available.

We’d like a wide variety of people to participate in the evaluation trial especially those that are involved in the museum and archive sectors, in academia, or in digital media

The trial session will be based on three activities:

  • A hands-on introduction to the web application.
  • Using the application to undertake a small number of information searches. This will allow us to gauge how easy the system is to use.
  • Group discussion about your experience of using the system and the ways that it could be improved and extended.

The session will take no more than two hours.

There is more information about the project available at http://mappingmuseums.wpengine.com/about/.

Locations and dates:

2 – 4.30pm | October 3rd 2018 | Room 407, Birkbeck Main Building, Malet Street, London WC1E 7HX (the entrance is on Torrington Square)

We would be very grateful for your assistance. If you would like to participate, please email the project director at f.candlin@bbk.ac.uk briefly explaining why you would like to attend. We can cover travel expenses up to £20.

Researchers involved in the trial session

Researchers and contact details:

  1. Professor Fiona Candlin (candlin@bbk.ac.uk)
  2. Professor Alex Poulovassilis (ap@dcs.bbk.ac.uk)
  3. Nick Larsson (nick@dcs.bbk.ac.uk)

How the data will be handled in the study

Information obtained from you through the session will be used to inform the research work of the project and subsequent research publications. All personal data collected from this study including your name and contact details will be kept confidential. No reference will be made in oral or written form that could link any participant to information they have provided to us as part of this the study.

Your participation in this study is voluntary, and you may withdraw from the study at any time.

Categories
Museum Snapshots

The Camera Museum

The Camera Museum began life as a cafe before being established in 2012 by Patrick and Adrian Tang, displaying Patrick’s growing collection of cameras. The display includes a timeline of cameras from the 1800s to the present. The sign makes reference to the nearby British Museum.

Photo by Jamie Larkin.

Categories
Museum Snapshots

Bournemouth Transport Museum

Yellow bus from Bournemouth Transport Museum
Leyland bus from Bournemouth Transport Museum marked as a Mobile Museum. Photo by Michael Wadman at Netley rally, 1988.

The Bournemouth Transport Museum was a collection of public transport vehicles on display to the public each summer, probably from the late 1970s. It was later known as the Bournemouth Heritage Collection. Some of the vehicles were returned to commercial service in the early 1990s. The collection changed hands and locations a number of times and was eventually sold at auction in 2011. The bus pictured above now appears to be in the West of England Transport Collection, along with many other Bournemouth vehicles. Interestingly it is labelled as a mobile museum, although we don’t know if it contained any exhibits. As always, if you can offer any information about this, please get in touch.

Image via Michael Wadman on Flickr, where you can also read a short but detailed history of the collection.

Categories
Museum Snapshots

Gloucester Folk Museum

Gloucester Folk Museum sign on an old bicycle

The Folk Museum, now known as the Gloucester Life Museum, is housed in Tudor timber-framed buildings. One of them is traditionally associated with the last night of John Hooper, Bishop of Gloucester and Worcester, who was burned for heresy by Queen Mary in 1555.

The museum tells the social history of Gloucestershire and includes a reconstructed Victorian classroom.

Image via roomsbooked.

Categories
Museum Snapshots

Big Four Railway Museum

Post mark for the Big Four Railway museum

Some museums are well documented, while others can be rather elusive. A case in point is the Big Four Railway Museum in Bournemouth, about which we know very little. According to one source it housed a collection of railway locomotive name plates belonging to the enthusiast Frank Burridge and was open in the 1980s. As this postmark suggests, it may also have hosted temporary exhibitions.

Burridge wrote a book about locomotive name plates. As the book’s cover indicates, the Big Four were the four main railway companies in the United Kingdom between 1923 and 1947: Great Western Railway, London, Midland and Scottish Railway, London and North Eastern Railway, and Southern Railway.

A postcard apparently showing the museum’s interior is reproduced below.

Interior of the big four museum with name plates

Images via ebay and Alwyn Ladell on Flickr.

 

Categories
Research Process

Unknown Opening Dates – Museums

Can you help us with opening and/or closing dates for the museums listed below?

The Mapping Museums research team have compiled data on around 4,000 UK museums, but we’re missing crucial information about the opening and closing dates of a few venues. We know that these venues existed, but sometimes have little more than a postcard or an old publicity flyer.

If you can help us, do please get in touch with the project director, Professor Fiona Candlin on f.candlin@bbk.ac.uk.

Name of museum Address line 1 Town or City Postcode Year opened Year closed
ABERGYNOLWYN VILLAGE MUSEUM 14 Water Street Abergynolwyn LL36 9YB 2007
AGRICULTURAL & RURAL MUSEUM Twycross Zoo CV9 3PX 1982
ASTON MAGNA BYGONES MUSEUM Aston Magna GL56 9QQ 1985
BENSON VETERAN CYCLE MUSEUM 61 Brook Street Wallingford OX10 6LH
BLACKED-OUT BRITAIN WAR MUSEUM 1 St. Mary’s Street Huntingdon PE29 3PE
BORRERAIG PARK MUSEUM Borreraig Dunvegan IV55 8ZX
BWLCH FARM MUSEUM Bynes Llanelli SA14 9ST
CARRON ROW FARM MUSEUM Titchfield PO15 1DZ
CHAPEL BECK GALLERY Guisborough TS14 6LS
COUNTRYSIDE COLLECTION Ferndown BH21 2EB 2006
DOLLAND AND AITCHISON MUSEUM 1323 Coventry Road Birmingham B25 8AW
DRUSILLAS MUSEUM Berwick Polegate BN26 5QS 1980-1984
DUKES WOOD OIL MUSEUM Kelham Hall Newark NG23 5QX Open
DYKE NOOK FARM MUSEUM Dyke Nook Appleby CA16 6NS
HAYWAIN FARM MUSEUM Field Farm Doncaster DN9 1Z
JOHN KING WORKSHOP MUSEUM Victoria Road Pinxton NG16 6LR
LAUNDRY & MANGLE MUSEUM Coggleshall CO6 1NT 2001
MULLAGHBAWN FOLK MUSEUM Tullymacrieve Newry BT35 0AA
NATIONAL GYPSY MUSEUM Trerife Farm Park Trerife Unknown 1994
OLD FORGE MUSEUM Sloe Lane Alfriston PN26 5UT 1994
UPPERLANDS HERITAGE MUSEUM The Green Maghera BT46 5RZ
WARSETTER FARM MUSEUM Isle of Sanday KW17 2BL
WEST GREEN HOUSE AGRICULTURAL MUSEUM Hartley Wintney RG27 8JB 1983