Library managers have been reviewing metrics and statistics we keep as part of Operational Plan Goal 4.4 Review metrics and statistics used to describe Library impact and value.
A group of us met in May to discuss what we saw as the priority for addressing in 2015. I gave a presentation as part of the Staff Development Programme in July which covered this in more detail.
Key areas we would like to address in the future are:
1. getting better at telling the Library story and
2. demonstrating value and impact
Work is already underway to improve 1) as part of the monthly reporting we do for the LR managers meeting. Often the narrative behind the statistics is more useful to give Alex and SMT a picture of the work we do in the Library. Ideas from Library staff are always welcome.
Regarding 2), most of the data we keep is what we might call “implied value” data (like usage or downloads). The problem with implied values is that they don’t show purpose, satisfaction or outcomes of use, for example whether what is downloaded is actually read and what benefit or impact that had. More ideas are required in this area and institutions like Wollongong and Huddersfield have led the way looking at the use of library resources services and investigating the impact of that on things like student success. Again, we are really keen to hear your ideas as to how we might do this. If you’re looking for a research project as part of MIS studies for example, there are lots of opportunities within our own Library. Jo and MB are looking into the possibility of doing a study on heritage collections and value for student learning.
One of the most comprehensive studies I’ve come across on this topic is:
Oakleaf, M. 2010. The value of academic libraries: A comprehensive Review and Report. Association of College and Research Libraries
As a result of reviewing the statistics we do keep, the following decisions have been made:
• Statistics we will cease keeping
• CONZUL/CAUL statistics we will continue keeping
• Other statistics we will continue keeping
Just to particularly mention that Access and Collections will cease maintaining database usage statistics in the Wiki, if the data can be obtained from COUNTER reports. This information is available via Serials Solutions/Intota. Access and Collections will continue to maintain the statistics if the usage data is only available from non-COUNTER compliant reports, but will do this at half-yearly intervals instead of monthly. We are happy to provide reports with a monthly breakdown for particular products if required.
Updating the Wiki statistics is time consuming because for a number of the databases the data has been compiled from two or more usage reports. Some of the data seems of limited interest eg the number of searches in a journal package, so this is another reason to reduce the maintenance of these pages.
Access and Collections will also be moving to implement Intota Assessment and eventually Intota version 1 which will replace Serials Solutions. Training will be provided in due course for staff who need to run reports directly from these services.
Tim Stedman