صفحه 1:
IFLA
صفحه 2:
library use as affecting the هما
+) = | individual user
@ Impact shows not the
quality of the service, but
the "quality" of individuals
_ in consequence of using the
service
IFLA
صفحه 3:
3 ۱
cd 0 @ knowledge
Say 9 information literacy
@ academic or professional
success
@ social inclusion
@ individual well-being
IFLA
صفحه 4:
9 changes in skills and
competences
9 changes in attitudes and
_ behaviour
@ changes in the structure of
the library's clientele
@ higher social inclusion
@ higher success in ممعم 1
صفحه 5:
“copaci oP a library's services oa tke vuloowes
DE ts porect iosituioa
Our wes oP وهی
recruitment and retention of si
recruitment and retentio:
academic staff
effective teaching
- high graduation rates
- high grades in exami
- high employment ra after,
examination of these
effective research
- high renown and use of research
results and
publications
- renown of faculties and resear |p}
صفحه 6:
صفحه 7:
New services
(inclufles services replacing or complementing traditional ser
Coro services (exnvples)
666666666
IFLA
صفحه 8:
صفحه 9:
© trot ad wot word te bray
© trot had wt wed fhe sawe service to radicod Por
8 سا جر مسر pricay wer you wk}
عبر venice
IFLA
صفحه 10:
6 امسر وی ماد or valor surveys, Poo yours,
© Onl bey Prd سس سا word? نع
© Oka probews?
© ON bey opt ratctay Por a ew serie? wel?
8 Law بای با اه تمه نها ww serie?
IFLA
صفحه 11:
۳۰ تیاه موه توا ip wee we series?
6 وم ناب و th hey wr ew
6 Behiag bray sth
@ Oka hep de were weed Por whet
Oe here a cheng oP while Pier te
verve?
صفحه 12:
dornoecty ond bbleqrophies crwpled by were: ‘ls جو رل
there a cheng ۰
> rescues used
وه (ه روسجوه -
۱ resourves vied?
IFLA
صفحه 13:
2 رم ۷
لجيه خان ستصصفت ,صمعصماه جص الس 1
information
* became acquainted with
new
resources
* used more inter?"
search IFLA ۱
صفحه 14:
change in
attitudes,
۱0
in السام محر
library
work more frequently in +
learn from group membi *
attended library trainin:
electronic services
find working in the lib: *
more attractive |
IFLA 1
صفحه 15:
6 weno han ae ck Aa pcan CA
ee ee Ree ee
* 4a SOOO t wos exveptowd Por
Paculy stePP oot to vee the
elvrows versio
IFLA : "ی
صفحه 16:
ل
را
a ed tere ned oe aed رم
صفحه 17:
IFLA
صفحه 18:
IFLA
صفحه 19:
TOL (Wrote oF تومطرا لمی مسجت Oervies): oucowe-
booed euckriva oP propor
اجان tole توا
@RL Dew Orwures ‘Iutaive:
- مه بویا Propo
8 سم مه مق
- 0108۵0 (Drcerrtoa he خا سرت
vervicer)
سوساج له نها
IFLA
صفحه 20:
160: م1۳ Ocho of the اجه مه <ن بووسبظ
QOuwversiy oP Ohad Orhool oP IPorwuics: ۳۰۵ وواووموجه و(
the و اسب Porton fo polio
موري ,02 لدي ةط دلت وطوو/صس د أمصادط ولاج
GOOOOL ud LARG (library ond IePorwates Reseach
Grow): kopont teitaive ced calierg ht
hip اعما يس اوعدت ااححتو ييه
ACL® Gevics Gritetice ond مت تست :لیا
uipowelkopan; bibkoqraphy oF biercture wad projets workdutde
IFLA
صفحه 21:
Don't throw away the old bucket until you know
whether the new one holds wa‘
Swedish Proverb
A new broom sweeps clean,
but an old broom knows the
corners. ۱
Ménard tite from success,
but much from failure.
Arabian Proverb
To change and to
improve
are two different things.
No matter how much the w
verb
G 58
changes, cats will never la
Bambara Proverb
Measuring the impact of
new library services
Dr. Roswitha Poll
Münster
Impact / outcome
Outcomes are the results of
library use as affecting the
individual user
Impact shows not the
quality of the service, but
the "quality" of individuals
in consequence of using the
service
Impact / outcome of cultural institutions
knowledge
information literacy
academic or professional
success
social inclusion
individual well-being
Impact / outcome of library services
changes in skills and
competences
changes in attitudes and
behaviour
changes in the structure of
the library's clientele
higher social inclusion
higher success in research,
Impact of a library's services on the outcomes
of its parent institution
Outcomes of universities
recruitment and retention of students
recruitment and retention of excellent
The
academic staff
library
effective teaching
can
- high graduation rates
support
- high grades in examinations
nearly all
- high employment rates after
of these
examination
goals
effective research
- high renown and use of research
results and
publications
- renown of faculties and research
Reasons for measuring impact of new services
accountability
special funding needed: evidence of positive effects
results-based budgeting
justifying investment into change
management of resources
rising expenses for new services
higher workload when introducing new services
increasing demand for new services
new allocation of resources necessary
promotion of the library's role
communication of benefits
New services
(includes services replacing or complementing traditional serv
Electronic services (examples)
regional/national catalogue databases
portals
online ordering and delivery
personalized services
online reference
digitized collections
electronic publishing
online self-paced training
Internet access via the library
New non-electronic services (examples)
group work areas
study landscapes for problem-based learning
Methods of measuring impact of new services
Problems of measuring
Most tested methods are time-consuming
Data not available because of data protection rules
Results of projects not comparable because of different data collection
methods
Influences
.
Services have different outcome
on and value for different user groups
It is difficult to prove that changes
in competences or behaviour are indeed
individual
due to library use
s
are
diverse
Methods of measuring impact of new services
Use statistics as measures of impact
new electronic media
frequency of use
location of use
Usersforms
are familiar
withsearches, downloads)
of use (sessions,
range
resources used before and after introducing a
the use
ofofelectronic
service
resources
and services
use statistics for a new service (e.g. online delivery)
change of use in traditional services
change in remote use
number of new users
that had not used the library
that had not used the same service in traditional form
percentage of the primary user group using
electronic services
new
Methods of measuring impact of new services
Qualitative measures
Asking users: print or online surveys, focus groups,
interviews
What knowledge have they of the new
Exit
service?
surveys
most
Did they find the new service useful?
useful
Use of services (frequency, location of use)
What problems?
Did they get training for a new service? useful?
Have they improved skills by using a new service?
Methods of measuring impact of new services
Qualitative measures
Asking academic teachers
Do new services support teaching and research?
Do they encourage students to use new services?
For what purpose do they use new services?
Anecdotal
evidence
What help do users need for what service?
Asking library staff
Was there a change of skills after the introduction of a new
service?
Methods of measuring impact of new services
Other methods
ls on a new
tests: can assess user skills before and after training
a
o
g
service
o
to
g
in
d
r mining:
performance monitoring / data
can document changes in
s
o
e
cc om
searching by a new service
a
– utc
s
e
o
m
d
te can report on failures or success and on
coshoppers":
"mystery
t
c
u pe they perceived in their skills
o
improvements
d nex
e
t
c
u
e
p
ex
analysis of documents and bibliographies compiled by users: Is
there a change in
- resources used
- accuracy of citations
- number of electronic resources cited?
Practical examples
Implementing a regional portal for academic libraries
Methods used: use statistics, surveys of academics
Statistical results
Survey results:
Academics said they
Higher percentage of
external users
Higher use of most
electronic resources
change of
• saved time by the integrated
competences,
search
attitudes,
• changed
their seeking ways
• found
access easier
behaviour
• found broader covering of
relevant
information
• became acquainted with
new
resources
• used more interdisciplinary
search
Practical examples
Opening a group learning area
Methods used: use statistics, survey to students
Statistical results
Physical visits to the
library have increased
change in
attitudes,
Survey results:
behaviour,
Students said they
personal well• work more
frequently in th
being
library
• work more frequently in gr
• learn from group members
attended library training o
electronic services
• find working in the library
more attractive
Practical examples
Changing the journal collection to electronic form
Methods used: use statistics, survey to faculty
Statistical results
online versions
were accessed
10 times more
usage of an online article
5.4 times
cheaper
high decline in print
usage
remote use increased
physical library
visits decreased
•
change
of
Survey results:
attitudes
and
behaviou
In 1998
r a number of
academics were sceptical
as to E-journals
• In 2002 it was exceptional for
faculty staff not to use the
electronic version
Practical examples
Implementation of an inquiry-based instruction program
Method used:
Analysis of bibliographies in students' research papers
Results of the analysis
increase
in citations to
scholarly journals
higher awarenes
of
no significant differenc in other
scholarly
topics
journals
accuracy of citation
currency of resources
competence of judging
Impact of new services on the library
Changes in organization
and resource allocation
investment of funds, room, staff time
staff training
user training
change of workflows
changes in organizational structure
Replacement of traditional by electronic
services: possible improvements in
speed of delivery
accuracy of delivery
ease of access
relevance for users
market penetration
Impact of new services on the library
Impact on costs
Probably transforming a service from traditional to electronic form will not
reduce costs
But: Higher use will reduce cost-per-use
Impact on traditional services
possible decrease in
- circulation
- copying
- physical visits
may be counterbalanced by
- comfortable surroundings in the library
- group working areas
- good in-house IT equipment
Outcome projects
eVALUEd: in "evidence base", University of Central England:
Toolkit for evaluating electronic information services
http://www.evalued.uce.uk/index.htm
IMLS (Institute of Museum and Library Services): outcomebased evaluation of projects
http://www.imls.gov/index.htm
ARL New Measures Initiative: several projects
- Learning outcomes
- Higher education outcomes research review
- MINES (Measuring the impact of networked electronic
services)
http://www.arl.org/stats/newmeas/index.html
Outcome projects
IBEC: Information School of the University of Washington and
University of Michigan School of Information: Toolkit for assessing
the impact of information in communities
http://ibec.ischool.washington.edu/default1024.aspx
SCONUL and LIRG (Library and Information Research
Group): impact initiative and mailing list
http://www.jiscmail.ac.uk/archives/lis-impact.html
IFLA Section Statistics and Evaluation: working group on
outcome/impact; bibliography of literature and projects worldwide
http://www.ulb.uni-muenster.de/outcome.html
Don't throw away the old bucket until you know
whether the new one holds water.
Swedish Proverb
A new broom sweeps clean,
but an old broom knows the
corners.
Virgin Islander Proverb
Men
learn little from success,
but much from failure.
Arabian Proverb
To change and to
improve
are two different things.
No matter how much the world
German Proverb
changes, cats will never lay eggs.
Bambara Proverb
