Passing on the benchmarking baton — welcome to our workshop in Cardiff

We are delighted and honoured to see that the interactive workshop we will facilitate on Wednesday 11th July from 14:00 to 15:30 in Studio 2  in Cardiff is already fully booked. Maybe it is not so surprising when we only accept 20 workshop attendees because the required level of participant activity is very high.

The title — and topic of the workshop — is Passing on the benchmarking baton: workshop on cooperation methods, using new indicators, finding partners, and reporting results. The methods will include speed-dating, brain-storming and brain-writing.

Our workshop aims to

  1. Share methods and tools;
  2. Encourage cooperation and new partnerships between libraries and librarians;
  3. Build on new indicators that were identified during the Dublin workshop;
  4. Identify themes and methods for new benchmarking projects;
  5. Find methods and channels to report to colleagues.

As a participant, you will have the opportunity to meet new partners for future benchmarking projects and to learn and practise tools to use in your workshops.

Why do we want to pass on the benchmarking baton?

For about five years, we have collected and tried to compare plenty of data and statistics, had dozens of online meetings and a few live meetings, made site visits to each of the participating libraries, interviewed library users, interviewed library staff, discussed  library as a place, marketing, information skills training, and many other aspects of our work. We have also maintained this blog where we have shared experiences and thoughts on benchmarking issues.

We have also had a focus group session in EAHIL+ICAHIS+ICML 2015 workshop in Edinburgh, prepared and presented a paper at EAHIL 2016 conference in Seville, moreover, facilitated an interactive workshop session in ICML+EAHIL 2017 in Dublin. Most importantly, we have learned a lot.

Now it is not only finally the time to pass on the benchmarking baton to you, but we also need to move on — to new projects and roles, to different challenges and experiences.

Part of a workshop planning document

Part of a workshop planning document

So, what we are proposing, is that you start benchmarking! Our benchmarking project brought us to compare different ways of organising library area and services, of managing staff and coordinate relationships within the institution and outside, and how to train users to information literacy and establish and maintain connections with faculty and hospital. Current and traditional statistics did not help us. They could be compared but did not provide us with handy information, partly because they do not cover the same reality (e.g. economics, mostly). ISO indicators were difficult to use because our countries, working cultures and usages are different.

We came to the point where we wanted to investigate the value of the library, and what we needed was new indicators to compare this value. Impact of our project was that EAHIL members took part in our benchmarking and collaborated in our workshops to propose these new indicators, which could better address our goals. We hope this last workshop will help you to set your goals and encourage you to start something as rewarding as our project.

If you have not attended our previous workshop (or participated in the focus group or heard the presentation) or read this blog before, please, take a look at the background, the participating libraries, and the About page, in addition to reading at least some of the linked posts — most of them are shorter than this one.

We would also really appreciate it, if you could shortly comment who you are, where you work and/or study, and why you have chosen our workshop.

See you in Cardiff!

Advertisements

How to find time for benchmarking or other cooperation?

Taking part in library development and projects should be a natural activity for any library staff member. The great challenge is to find time to dedicate to such important tasks. A regular week in the library consists of lots of planned activities, meetings, events, things that just appear and must be solved on the spot, and then there is not any time left. It is easy to ignore tasks not visible in the plan of action or calendar. These tasks often seem “less important” and ends up out of sight, out of mind — regardless of how exciting and useful the project/task is. This happens both to in-house projects and international cooperation, and is also our experience in the benchmarking project –- it is difficult to find time.

Our project started in 2013; the initiative came from the library director of the University of Eastern Finland; the other two library directors supported the project mainly by agreeing on their staff spending their time. None of us has a budget or dedicated time for this project, we have had our normal tasks all the time – except during the site visits and some face-to-face meetings. We have kept costs, and use of time to a minimum as we mainly work online. The funding sources for the visits came from Erasmus staff exchange program and from the libraries’ budgets.

20170131blogpost

Karen and Ghislaine taking a look at a handout in Brussels.

The project has clear goals and a project plan that give direction and deadlines. Our project is a best-practice benchmarking that aims at improving services; it is a process much more than a traditional project. The work is loosely organised; there is no leader – or we are all leaders. The three of us are equal in all decisions, our roles are based on our personalities and competencies, and so it must presumably be in a project of this character.

So how much time have we spent?  Since January 2014 (the main project period) we have used roughly 5 % of our total work time each:

  • Library visits: 3 weeks
  • Work together at EAHIL meetings: 3 days
  • Skype monthly meetings and preparations: 3 weeks
  • Planning the workshop for Edinburgh: 1 week
  • Planning the presentation and writing the full-text article for Seville: 1 week

These scheduled activities are roughly 8,5 weeks for each of us – out of the 156 weeks in the 3-year periods. The problem is to find time for individual activities like reading and preparing between our meetings.

 

20170131blogpost3

Tuulevi writing in Kuopio

 

Collaboration tools have been important to be able to spend time effectively both during and between meetings. The most useful tools we’ve used for cooperation have been these:

  • Dropbox for all kinds of data: meeting agendas and minutes, collected data, plans, photos and so on
  • Google Hangouts for online meetings and collaborative writing
  • WordPress blog for communicating our results

The blog was originally intended to document library visits in Trondheim, Kuopio and Brussels, but has become an important help to keep focus and progress. We use the blog as a planning tool, where each blog post explores and describes new topics, with deadlines and a responsible person. Parts of online meetings are used to finalise and publish new blog posts.

20170131blogpost2

Ghislaine and Karen with Frédéric Brodkom in Louvain-la-Neuve

To work on an international project, with limited resources, is challenging but also rewarding. It requires self-discipline to allocate time, but also support and understanding from colleagues and supervisors. It is important not to be frustrated from insufficient time, or when meetings and deadlines have to be postponed.

We have learned a lot from the project, from working together and from sharing with other EAHIL colleagues. So far the benchmarking project has been a continuing process of evaluation and development of the libraries’ functions and staff competencies as well as learning about different ways of managing a library.

Focus! — said the focus group

Ten delegates of EAHIL+ICAHIS+ICLC 2015 workshop participated in our focus group interview session in Edinburgh. Focus group is a qualitative method, the results cannot be generalized to a population (e.g. all participants at the EAHIL workshop), but can say something about trends and point out features and patterns that recur. In our session, we looked for perceptions, opinions, beliefs, and attitudes about some themes we have covered in our benchmarking project.

The focus group participants were Bente Aastad (Telemark University College, Porsgrunn), Elaine Garrett (Royal College of Obstetricians and Gynaecologists London), Imrana Ghumra (Cilip Health Libraries Group London), Hans Ket (University Medical Center Amsterdam),Marie Källberg (Karolinska University Hospital in Stockholm), Joëlle Longchamp Reuge (Haute école de travail social et de la santé in Lausanne), Emma-Lotta Säätelä (Biomedical- and Medical libraries at Uppsala University), and Guus van den Brekel (University Medical Center Groningen), and, as moderators, Karen J. Buset & Tuulevi Ovaska.

We talked about the challenges of data comparison, our site visits, marketing, library as a place, and — most importantly — how the project should proceed. We took notes but also asked the participants to put a word or two on post-it notes.

Post-it notes

Post-it notes


Preparation for the session 

We used a semi-structured interview guide to structures the discussion and secure that all topics were covered and that all of the participants had the opportunity to express their opinion. We made notes but also asked to the participants put a word or two on post-it notes. In the blog we asked the people attending our workshop session, to themselves very shortly (name, organization, main tasks) by commenting the blog post. Some of them also explain why they chose to attend this session:

  • … interested in focus groups as a way of identifying our user needs, and the benchmarking process because I have seen on recent visits to other libraries how much we can learn from each other
  • … it is important to do the right thing at the hospital, using benchmarking and focus groups are two different methods to learn what the library can do to keep updated and preparing for the future
  • … interested in hearing what you have learnt in your benchmarking … it will help our planning to learn what you found important during your project.
  • … hope to hear more about benchmarking in general …
  • … benchmarking to find out how to improve some of our services, for example : the marketing …
  • … interested in the question about site visits and the library as a physical space

The workshop started with a brief summary on benchmarking and focus group as methods, and we also explained to the group the intention of the workshop was not to teach them something about benchmarking, but to get input and ideas for our future work.

Topic 1: Data comparison

The discussion was mostly on library quality assurance in different countries, for example the Quality assurance framework in England, that provides tools for best practices, that we think we should check out. The focus group agreed that using indicators probably is the best way forward, but the big question is, which data to compare: number of books and e-books, number of loans…? They advised us to to go back to our data and start figuring out what we want to measure. They asked, if we should also compare our library staff numbers and competencies, and would it be possible to measure progress of services.

Post-It notes from the participants

Focus group tools

Focus group tools

Topic 2: Site visits

The group agreed that site visits are useful but take time from other activities, as well as money for traveling. They agreed that interviewing the students in all the three libraries has given us useful information but that we should also think how to get in touch with those who are not visiting the library. It was agreed that there are challenges in making visits and comparisons among libraries and their users in several countries, for example in our case three different languages (in addition to English as the common language) and the different (working) cultures of our countries. We think there is more information and value — and more to learn — in comparing with someone different from your own country.

Sidetracks from the discussion

  • EAHIL should engage in such projects
  • Libraries are not good at publishing and sharing results.
    • Could there be a performance parameter on “How good are the libraries in sharing information about their projects”?

Post-It notes from the participants

  • What about non-users?
  • Staff not always open to be interviewed
  • Language and cultural barriers
  • How do we share information?
  • Books and shelves
  • Furnishing
  • Number of study desks and PCs

Focus group

Focus group

Topic 3: Marketing

We talked about good examples like the Biblio-Jack project in Brussels. Libraries and librarians need skills and more knowledge on marketing; how to do it, what works out…. IT could be useful to collaborate and share marketing material, as an example we learned about the common hospital library week in Sweden. It was suggested that EAHIL should have a new special interest group for people interested in marketing so there could be more cooperation in this field. It was also asked if it is possible to measure or have indicators of the impact of marketing. The group thought marketing could be one of the main focuses of our benchmarking project.

Post-It notes from the participants

  • Targeting different user groups
  • Video Biblio-Jack
  • Core skills for librarians?
  • Share stories, examples, material, experiences e.g. promoting libraries in education
  • Small level marketing projects

Focus group

Focus group

Topic 4: Library as a place

Library as a place was discussed earlier in connection with the site visits and student/customer interviews.

Post-It notes from the participants

  • Find the people that do not use the library anymore, maybe clinicians and researchers or nurses
  • Re-zoning university libraries in UK — also health libraries

How should we proceed?

The group suggested that we figure out what we want to measure at this point, that we use indicators, that we should compare staff and — most importantly — that we must focus on fewer topics. We are grateful to the group for the discussion, the tips and the encouragement.