The current issue and full text archive of this journal is available at www.emeraldinsight.com/0888-045X.htm ROI in German Return on investment (ROI) in libraries German librariesThe Berlin School of Library and Information Science and the University Library at the 141 Humboldt University, Berlin – a case study Received May 2010 Revised June 2010 Kathrin Grzeschik Accepted June 2010 ¨ Humboldt Universitat zu Berlin/Berlin School for Library and Information Science, Berlin, GermanyAbstractPurpose – The purpose of this paper is to verify the proposition by the University of Illinois,Urbana-Champaign (UIUC), that their return on investment (ROI) formula developed for academiclibraries and based on hard facts is broad enough to be used throughout the world for ROI studies inacademic institutions/libraries. It further aims to verify that UIUC’s methodology is adaptable enoughto work in other academic environments as well.Design/methodology/approach – The methodology developed by UIUC (an ROI formuladeveloped for academic libraries based on grant proposal applications and citations) has been“copied” and thereby adapted to enable it to be used in an academic environment in Europe/Germany.Findings – The methodology developed by UIUC was adaptable enough to be used in a Germanacademic environment for calculating the ROI of a University library. However, the methodology wassometimes complicated and therefore simpliﬁed for this and possible further studies. Likewise, the ROIformula was very complex and this study found that it was possible to simplify it as well for furtheruse.Research limitations/implications – There was difﬁculty in gathering all the informationnecessary for conducting such a study in Germany as grant proposals contain sensitive data thatpeople are unwilling to display. Further, it was noticeable that German statistics on funding wereunable to provide the necessary data without further enquiries, despite the German law that publicinstitutions are obliged to disclose funding information.Originality/value – Previously no one else has tried to verify the methodology for an ROI studydeveloped by UIUC. This study gives evidence that UIUC was right in claiming that their ROI formuladeveloped for academic institutions/libraries may be used for any academic library in the world.Further, this study shows how the formula and the methodology may be adapted to ﬁt individualacademic environments.Keywords Return on investment, Libraries, GermanyPaper type Case studyIntroductionThe following paper describes the experiment to implement the return on investment(ROI) concept developed by the University of Illinois, Urbana-Champaign (UIUC) (see The Bottom Line: Managing LibraryKaufman, 2008a or Luther, 2008) for the ﬁeld of LIS (Library and Information Science) Finances Vol. 23 No. 4, 2010 ¨at the University Library of the Humboldt Universitat zu Berlin (HU) and the Berlin pp. 141-201School of Library and Information Science (IBI) (www.ibi.hu-berlin.de/). It investigates q Emerald Group Publishing Limited 0888-045Xthe principal ideas and methodology developed by UIUC and applies those in a German DOI 10.1108/08880451011104009
BL academic environment. One of the features Illinois claimed for their study, was the23,4 chance for other institutions to use and copy the main steps. Quantitative and qualitative measurements have been used in public, corporate and academic libraries before, but this paper focuses on ROI as a quantitative method to evaluate a library’s monetary value. The research question is: “Can the methodology developed by UIUC be applied to German universities?” It is not the aim of this study to142 come up with a true ROI ﬁgure for the IBI and the HU, but the testing and evaluation of the UIUC method; nevertheless, all calculations aim to achieve as true of a possible ﬁgure as can be determined. The institutions that are part of this study are both well established in higher education in Germany, The IBI is one of the two European members of the iCaucus. Since the middle of the past decade, more and more grant proposals have been issued by the IBI, which makes a study based on the ROI study of the University of Illinois, Urbana-Champaign feasible, as the core of the ROI study by UIUC are grant proposals. The university library at the Humboldt University, Berlin (UB) was founded in 1831, and currently has an inventory of 6.5 million media. It sprawls over several section libraries, but the collection for LIS is situated at the main library in the newly-built Jacob-und-Wilhelm-Grimm Zentrum in Berlin-Mitte. Literature review The “gain from investment” is not easily determined by libraries. The literature review will demonstrate the lack and need of a continued investigation in ROI in academic libraries in Germany, as well as the speciality of the concept developed by UIUC. ROI is a ﬁnancial metric performance measure to calculate what a certain investment is worth. Very simply put, ROI is how much one gets back for what one has put into something. “To calculate ROI, the beneﬁt (return) of an investment is divided by the cost of the investment; the result is expressed as a percentage or a ratio”. A positive percentage or ratio indicates that more beneﬁt than cost has been generated; a negative percentage or ratio indicates less beneﬁt was generated. In order to calculate ROI, one needs to be able to quantify how much money was invested into something and compare it with the loss or gain that is a result of handling the initial investment. ROI is a well-used performance measure in ﬁelds such as human resources, marketing, engineering, business studies, and training. A problem libraries have to deal with is ` that they are not capitalistic corporations, but exist to support their speciﬁc clientele with information and technology. This is true for any library: the difﬁcult part for a ROI study in libraries is the assignment of monetary values for library services. Among the uses of ROI in libraries, differences are discernible between the aims addressed in studies: Quantitative measurements for a special library’s ROI include time saved by library users (. . .); the money users save by using the library instead of alternative sources; and revenue generated with the assistance of the library (Strouse, 2003, para. 9). Commonly-used methods to ﬁlter monetary values for non-proﬁt organisations are: . “assessing time costs (replacement value of a client’s time)”; and . “the contingent valuation method” (Poll and Boekhorst, 2007, p. 36).
The ROI study by UIUC focused on revenue generated with the assistance of the ROI in Germanlibrary in question. libraries The ﬁrst method is valuable when average salaries of users are known, as itcalculates time costs with the help of average salaries. These measures may thentranslate into actual dollar savings; nonetheless, the method is not feasible in anacademic surrounding, as most users of academic libraries are students who do notearn a regular salary. 143 The second method, contingent valuation (CV), is a technique that assigns economicvalue to non-market resources with the help of surveys. It has been around a while, butwas quite controversial until it gained a better reputation when scientists discussed themethod at a National Oceanic and Atmospheric Administration (NOAA) Panel in 1993.They found it meaningful when a set of rules was followed: [. . .] [B]y means of carefully designed surveys it is possible to elicit, in quantitative terms, how much people value a particular organisation or service (British Library, 2004, p. 4).Other publications followed, for example Mitchell and Carson (1993) claimed toprovide: [. . .] decision makers, policy analysts, and social scientists with a detailed discussion of a [. . .] technique for the valuation of goods not traded in private markets. [. . .] the technique draws upon economic theory and the methods of surveys to elicit directly from consumers the the values they place upon public goods (Mitchell and Carson, 2000, p. xv).These surveys ask participants how much they would be prepared to pay (WTP –willingness to pay), and how much they would be willing to accept for loss of quality oflife (WTA – willingness to accept). Since this panel, the method has been used incost-beneﬁt analysis concerning the environment as Arrow et al. (1993) did, in realestate, and lately libraries have adopted this method as well. As people (users and potential users) receive indirect (and direct) beneﬁts fromlibraries, CV is a valuable method to use in the library environment: Applied in a library/information context the methodology enables consideration to be given to the cost implications of having and of not having a library service. The direct economic contribution of the library to their users is calculated including investment in terms of time and travel (Missingham, 2005, p. 146).Libraries employing CV as a method assign ﬁnancial value to intangible products. Themost famous CV study performed in the area of library and information science is theBritish Library study from 2004. The surveys used in the British Library CV studyasked questions such as “how much beneﬁciaries would be willing to pay for thelibrary’s continued existence” and “how much they would invest in terms of time andmoney to make use of the library” (British Library, 2004, p. 4). After evaluating thesurveys, the research organisations found that “[f]or every £1 of public funding theBritish Library receives annually, £4.40 is generated for the UK economy“ (BritishLibrary, 2004, p. 5). It is difﬁcult, however, to establish objective economic value based on surveys thatask people for estimations. Even the British Library (2004) indicates in its summarythat this method is seen as one of the most appropriate available, but it is still not anexact science. UIUC set their goals to ﬁnd a more tangible ROI method that could besummarised in a formula adaptive enough to be used by other academic libraries and
BL institutions. Apart from that, the UIUC-study is the ﬁrst ROI study based in an23,4 academic setting. The British Library is a national library and their study was not set in such an environment; therefore, it is less adaptable to be used in an academic setting. The interest in ROI and performance measurement in general has generated huge interest in the past decade. Missingham (2005) spoke about a third wave of ROI studies. Demonstrating that libraries are worth their expenditures is not a new topic for144 librarians. Librarians are no longer secure in their assumptions that the impact of a library will be recognised by the communities served, or the authorities that fund them. “As librarians we naturally tend to think our libraries and our services are invaluable.” (The Krafty Librarian, 2008, para. 1). But it is rather the opposite that is believed by academic as well as public communities and their funding bodies. One of the major reasons for the strengthened demand for value is the paradigm shift of media processed and stored in libraries. The shift has been induced by the massive changes in technology development in the past two decades. Libraries have been very adaptive, and included each new technology as it came along, but critics have often voiced to librarians the familiar question: “Why do we need libraries when everything is on the internet now.” It is common knowledge among library staff that technology is altering the way information is created and thereby technology is creating new ways of how information is distributed; nevertheless, this information needs to be prepared and made available the same way printed information has been. What has changed is the perception of the public and of funding bodies, “libraries cannot take for granted, if they ever could, that they have a monopoly over the provision of information” (Payne and Conyers, 2005, p. 1). This shift in thinking as well as economic problems have lead to an accumulation of calls from funding bodies for proofs of value. Aabø (2009) conducted a meta-analysis on what she calls the “subgroup of library valuation that returns a return on investment or a cost-beneﬁt ratio”: Public libraries [. . .] need to prove how the taxpayers’ money is used to beneﬁt both the individual citizens and the local communities. Academic libraries, school libraries, and special libraries in different businesses meet similar types of demands, being asked for performance measurement, cost justiﬁcations, and return on investment from the administration of their university, school, or enterprise. These demands have been strengthening due to increasing economic pressure (Aabø, 2009, p. 312). Aabø emphasised that, owing to the ﬁnancial crisis, the need for library valuation grows stronger. Libraries in the private as well as the public sector have a slightly longer tradition in proving their value with the help of ROI, compared to academic libraries. Although collecting, analysing, and presenting quantitative and qualitative data has been part of a library’s pursuits for a longer period of time, only in the past few years it has shifted from “simple questionnaires to complex surveys, and from simple economic cost/beneﬁt assessments to complex economic algorithms and forecasts” (Imholz and Weil Arns, 2008, p. 5). Only recently have German libraries realised that performance measurement is not only an internal task but an external one: “[. . .] das ¨r Bewusstsein fehlte, wofu Bibliotheken und Bibliothekar/innen eigentlich da waren ¨ ¨ und wie sie die Unterstutzung der Offentlichkeit [. . .], gewinnen und behalten konnen,¨ ¨ [. . .] heute erst hat sich das geandert!” (Busch, 2004, p. 13).
In the 1990s Holt et al. (1996) researched into frameworks for evaluating public ROI in Germaninvestment in public libraries. They emphasised that “economic impact occurs only librarieswhen a business’s or institution’s activities bring outside clients to the region, therebybringing new dollars into the region, or when an institution attracts ﬁscal support fromoutside the region for its activities”. (Holt et al., 1996, p. 3). They strengthened thenotion that libraries are among those institutions that are able to have economicimpact. A 2004 ROI study by the State Library and Archives of Florida showed “that 145when Florida’s state and local governments invest in libraries, it enhances the qualityof life in communities and helps build a stronger state economy” (Grifﬁth, 2004,Overview). Academic libraries supporting academic institutions that bring newdollars, or in this case Euro, into their institutional region, have the chance to havesimilar economic and qualitative impact as described above by Holt et al. and Grifﬁth. Public libraries have been especially creative in ﬁnding solutions to raise awarenessfor ROI regarding their library. Aabø found that “of the 38 studies [evaluated in hermeta-analysis], 32 are of public libraries” (Aabø, 2009, p. 311). Browsing the web pagesof public libraries showed many Anglo-American ones creating their own ROIcalculators. An example is the Library of Michigan ROI calculator that enables taxpayers to calculate their own ROI when using the library. Further discoveries werepublic libraries doing surveys, listing their studies’ results or uploading videos onYouTube. ROI calculators by public libraries help customers to get an insight into their ROI ontax money spent when using a library; academic libraries need to focus on the ROI fortheir funding bodies. Poll and Payne (2006) demonstrated a variety of purposes andmethods used, again mostly by public libraries. They distinguished among othersbetween the “correlation of library use and academic or professional success [. . .]impact on information literacy, the importance of the local library on research [. . .]social impact [. . .] [and] the ﬁnancial value of libraries” (Poll and Payne, 2006, p. 6).Two of their ﬁndings are particularly important for this study: ﬁrst, they emphasisedthat measuring the ﬁnancial value of libraries is the most interesting to fundinginstitutions. Despite the social importance of libraries and their impact on informationliteracy, what counts for funding bodies is the money made. There is evidence for thistheory even in Germany. German universities and their libraries are recognized moreand more for the monetary value they bring their communities. For example, theGerman Exzellenzinitiative considers third-party funds in their benchmark ofparticipating universities; naturally, that makes German universities interested in themonetary surplus or deﬁcit their libraries are producing. Second, Poll and Payne (2006)mentioned two studies that show that the impact of local libraries on research hassuccessfully been measured with the help of citations analysis. Both studies evaluated“what percentage of the material cited was (or could have been) retrieved via the locallibrary” (Poll and Payne, 2006, p. 7). Additionally, they conducted surveys to supporttheir assumptions. The study at UIUC started in a similar way, but went a step furtherand added real economic value to citations by calculating ROI with the help of citationanalysis in grand proposals. There have been studies on performance measurement in Germany as well, but veryfew in the academic sector and even fewer considering ROI as a method. In 2003 asimilar tendency was seen in the Anglo-American academic ﬁeld of LIS:
BL Precious little attention is currently given to development and collection of ROI data. Among the three primary types of special libraries (corporate, academic, government), corporate23,4 libraries are most likely to study their value impact, and academic libraries are least likely (Strouse, 2003, para. 3). Later international outcome-studies such as “Worth Their Weight” conducted by Imholz and Weil Arns (2008) showed that opinions and trends, at least among the146 public library sector in continental America, have changed. This development gives hope for a new trend in Europe. Imholz and Weil Arns presented seventeen US-American studies by public libraries punctuating current approaches and methods used by contemporary scholars and researchers. Nevertheless, two years earlier Blanck (2006) surveying performance measurements in (mainly public) libraries in Germany was correct to claim that “Im deutschen Bibliotheks- und Informationsbereich ﬁndet hierzu bisher so gut wie keine Diskussion statt.” (Blanck, 2006, p.13). One exception in the growing ﬁeld of evaluations of public library ROI studies (see Missingham, 2005; Blanck, 2006; Imholz and Weil Arns, 2008; Aabø, 2009) is Blanck’s predecessor Fett (2004), who collected literature on performance measurement in academic libraries. He devoted a short chapter to the topic of ROI and lists only the Value-Added Library Methodology (V þ LM) by Ruth MacEachern. This methodology is based on CV and results from “eine Ermittlung von Schatten- oder Quasipreisen durch Erhebungen bei den Nutzern“ (Fett, 2004, p. 42); additionally, replacement costs are calculated. As previously mentioned, the problem of CV and V þ LM are the often very subjective monetary values assigned to library services that are then used as hard facts. Designing an ROI measurement based on hard facts and ﬁgures is a sensible task for the German ﬁeld of academic libraries. UIUC’s study provides a new way to calculate ROI for libraries based on hard facts instead of assumptions (see for example the British Library study). UIUC, however, had to gather certain ﬁgures with the help of surveys. These minor approximations are amended in this study due to its smaller scale and the possibility to count and individually evaluate citations. The making of the UIUC return on investment study In 2007, researchers of the Library at the University of Illinois, Urbana-Champaign together with Judy Luther, president of Informed Strategies at Elsevier and Dr Carol Tenopir, Professor at the University of Tennesee at Knoxville, conducted the ROI study that is the basis for this study. The starting point of their study was the common perception that academic libraries are in need of a tool that is easy to use for answering the demands for accountability from funding institutions. The research group aimed at having numbers rather than ﬁgurative values for proving what their university library gives back to their funding institutions, “[. . .] it is important to demonstrate that investment in the library yields a ‘return’ that contributes to the strategic goals of the institution” (Kaufman, 2008a, p. 29). Their aim was to ﬁnd a formula that would answer the question “for every dollar invested by the University in the library, the University received x dollars in return” (Kaufman, 2008a, p. 30). The ground-breaking approach was that they did not plan to develop a model based on predictions as is the case with the CV method, but they planned to base the formula on real ﬁgures. In order to have real ﬁgures, they were in need to ﬁnd a connection between the library and
strategic concerns of the university that could be expressed in quantiﬁable terms. ROI in GermanTheir goals were to: libraries [. . .] demonstrate that the library and its research collections contribute to [essential] income-generating activities [. . .], quantify the return on the University’s investment in its library, highlight the library’s role in the extra-mural funding process on campus [and to] demonstrate correlation between the library and grant activities, rather than attempt to prove cause and effect (Kaufman, 2008a, p. 30). 147Roger Strouse’s (2003) approach for a ROI-study in corporate libraries was theapproach chosen by UIUC for the development of a generic model that is not predictiveand works in the academic environment. Strouse developed a formula that determinesvalue based on “revenue generated with the assistance of the library [. . .] [and] theimportance of information provided by the library that the user would not have foundor had access to without the library’s intermediation” (Strouse, 2003, para. 8). His formula (adapted by Judith Luther (Kaufman, 2008a, Slide 7)) was to multiplythe percentage of respondents generating revenue with library’s support by thepercentage of instances when the library was used and thereby revenue generated.This was multiplied by the median revenue generated in US dollars. This would leavea certain amount of US dollars generated per library use (Kaufman, 2008b, p. 430). ThisCorporate Library Model by Roger Strouse (adapted by Judith Luther) is shown below: xx% of respondents report generating revenue w= library’s support £ xx% of instances when library was used £ $xx median revenue generated ¼ $xx average revenue generated per library useThe research team in Illinois decided that grant proposals are revenue generatingincomes in an academic setting that are created with the help of library resources. Inorder to conﬁrm that assumption, Illinois distributed an online survey among 2,000members of their faculty. The survey elicited how users perceived the library and itsresources when constructing grant proposals. “Almost 75% of respondents stated thatmore than three-quarters of the citations they included in their grant applications wereaccessed through the library” (Kaufman, 2008a, p. 31). After evaluating the surveyresults, calculating the ROI for Illinois’ university library based on the use of citationsin successful grant proposals was conﬁrmed as a reasonable method. Calculating the ROI with the total library budget, the researchers determined a ROIof $4.38 for every dollar invested in the library, for the ﬁscal year 2006 (Kaufman,2008a). This result is based on surveys, i.e. evaluating “percentages of staff usingcitations in their grant proposals” and budgets provided i.e. “the actual size of grantsawarded ” by the ﬁnance department (see Table I). The ROI was calculated by dividing the proportion of grant income in US dollarusing library materials by the total library budget (see Table I, E). The researchers atUIUC decided to use the total library budget instead of for example the materialsbudget or a subset of the budget (i.e. electronic resources), because staff and supportcosts are also part of acquiring materials that are used for citations. Nevertheless, toshow the difference, they calculated the ROI with the materials budget of UIUC libraryand it resulted in a ROI of approximately $12. It is important to note that:
BL No. tenure system faculty 2,04523,4 No. principal investigators 1,700 *Survey Q11-94% faculty use citations in grant proposals A ¼ % faculty using citations in grant 78.14 (1,700 £ 94%)/2,045 proposals * No. grant proposals 2,897 * *Survey Q12-94% proposals include148 citations that are obtained via campus network/Library Gateway No. grant awards 1,456 * *Survey Q10-95% faculty state citations important or essential in grant awards B ¼ % proposals inc. citations obtained 50.79 (1,456 £ 95%)/(2,897) £ 94%) through library $ Average size grant 63,293 C ¼ $ proportion of grant $ secured using 25,369 (78.14% £ 50.79% £ $63,923) library materials No. grants (expended) in year 6,232 D ¼ $ proportion of grant income using $158,099,608 ($25; 369 £ 6; 232) library materials $ Total library budget $36,102,613 E ¼ University return in grant $ on $4.38 ($158,099,608/$36,102,613) libraryTable I.UIUC ROI calculations Source: Kaufman (2008a) [. . .] [f]aculty survey results factor into the equation in three separate places. In this way, the model does not assume that all grant proposals use references, it does not assume that that all references come from the library, and it does not assume that citations are deemed critical to all grant proposals (Kaufman, 2008b, p. 433). The differing amounts of citations per grant proposals in this study show, that UIUC was right in assuming the above, but the model designed by UIUC is a feasible version of including revenue generating actions supported by the library (citations in grant proposals (see Appendix 1)) into a ROI calculation for academic libraries. Designing an ROI study for the Berlin School of Library and Information Science When initially planning to adopt the University of Illinois ROI study for a German setting, a study larger in scale and more similar to the Illinois ROI study was intended. ¨ It was planned to conduct the study for the Niedersachsische Staats- und ¨ ¨ Universitatsbibliothek Gottingen and its partner the Georg-August-Universitat ¨ ¨ Gottingen. These institutions were possible candidates for a German ROI study, because they represent a major research university and library. They are major players in receiving grants from the Deutsche Forschungsgemeinschaft (DFG) as well as ¨ the Bundesministerium fur Bildung und Forschung (BMBF). What the author did not consider was the sensitive nature of data grant proposals contain; collecting the necessary data was an impossible hurdle. In addition, the data that were available in the end for running a ROI study comparable to the one developed by UIUC have incompatible categories that cannot readily be disentangled in the time available. The problems and their possible consequences will be noted in the sections below.
To narrow down the scope and receive usable material, the author chose to examine ROI in Germanthe Berlin School of Library and Information Science (IBI) and the Library and librariesInformation Science section at the university library. The Berlin School for Library andInformation Science is the only LIS-research-orientated academic institution inGermany that actively participates in current state-of-the-art research. In past years,the IBI has actively participated in grant proposals applied for in cooperation withother major research universities, as well as applying on its own. Researching the 149activities of other LIS-orientated academic institutions with the help of the DFG searchengine GEPRIS showed no results. Neither of the major Universities of AppliedScience had any projects listed in the ﬁeld of LIS that were funded by the DFG inthe past ﬁve years. By choosing a smaller institution than the University of Illinois Urbana-Champaignand its library for this study, the author had to adjust the longitudinal scope. In orderto have a substantial enough amount of grant proposals, it was extended to threeconsecutive years (2006-2009). In total, 13 grant proposals applied for by the IBI and partners have been awardedwith grants in those three years. The total budget of these conglomerates wase3,190,502.72 (see Appendix 2 Grants Calculations). This budget is a compositenumber compiled with the help of budgets forecast in the grant proposals. Anapproximate number had to be established because ofﬁcial budget listings forthird-party funds vary a lot, and unfortunately the listings by the HU are notsufﬁcient for this study. The above ﬁgure has been composed of average wage costs(salary and fringe beneﬁts) as well as travel costs, print and publishing costs, plusmiscellaneous costs listed in the grant proposals. The average salary and fringe beneﬁt costs were calculated on the basis of apersona being just under 30 years of age and being paid on BAT IIa level 1.BAT IIa is a standard level for a scholarly member of staff working on a researchproject at the HU. The age plays an important part, as BAT scales income based onmaturity. For example, a 26-year-old person would earn a gross income of e2,293.30 permonth plus residence allowance and further allowances based on marital status andchildren. A person having the same conditions but being 30 years of age would earn agross income of e2,523.37 per month plus allowances simply because of being fouryears older. The basic idea was that people being older have had more experience andare therefore better qualiﬁed. This way of calculating easy changed from April 2010 ¨ ¨with a new collective wge agreement called TV-L (Tarﬁvertrag fur den offentlichen ¨Dienst der Lander), but the average salary and fringe beneﬁts will not changesigniﬁcantly because of those changes. The salary and fringe beneﬁts are not the amount such research project employeesreceive in their paychecks, but the amount of money the institution actually spends onthem. In Germany, institutions support their employees by paying proportions forcertain beneﬁts such as health insurance, pension, unemployment insurance, andsometimes accident en route. These proportions are paid directly to the respectiveorganisation responsible for the beneﬁt or the state. For the above-described persona(just under 30 years of age, level 1 BAT IIa) it amounts to e3,492 per month. Thisamount correlates with expenditures for one person-month. Person-month is a measureof work effort, for example if a project will take three months to ﬁnish with three people
BL working full time on it, the project requires 3*3 ¼ 9 person-month effort. That would23,4 imply e31,428 in salary and fringe beneﬁts costs at the HU for such a project. As mentioned above, UIUC conducted a survey. They found out that 94 percent of proposals include citations that are obtained via a campus network or library gateway. This survey, however, is the weakest part of the UIUC ROI study. A response rate of 16 percent is not seen as low, but a higher response rate would have been better, because150 UIUC based their percentage of proposals including citations obtained through the library on the survey results. Certain factors determine the statistical conﬁdence of surveys, these factors are for example the size of the population or the degree of variance in responses from the population. All the same, Bennekom (2002) states there is no average response rate, and UIUC had Dr Bruce Kingma of Syracuse University consulting their research methodology. Due to the smaller scale of this study, a survey was not deemed necessary. It was possible to evaluate the citations individually to retrieve a more accurate proportion of grants in Euro secured by using library materials; the number was acquired by calculating the (%) proportion of citations obtainable through the library. The starting-point was to ﬁnd and investigate each citation in the successful grant proposal. All references made to a published or unpublished source, including websites, were identiﬁed as citations and either found as footnote, link in the full-text, or traditionally in the bibliography. References in German grant proposals are usually added in the section “Ausgangslage/Eigene Vorarbeit”, but the variety of proposals for the differing funding bodies showed that simply searching through this section was not enough; each proposal was searched from top to bottom. For the established references the focus was the availability either through the Online Public Access Catalogue (OPAC) or the digital library accessible via Virtual Private Network (VPN). The OPAC of the UB is connected with the Kooperativer Bibliotheksverbund Berlin-Brandenburg (KOBV). Loan sharing is one of the features KOBV (n.d.) facilitates among its participants, and any citations available via loan sharing were therefore counted as belonging to the UB. In the 13 grant proposals, 474 individual citations are discernible. Individual means that some proposals cited the same source twice, for example as a proper citation in the references list and as a link in the full-text; in this case, the citation was counted as one only. For 190 citations, its source could be traced back via the materials provided by the UB. This means either the source being a physical or electronic item at the UB, or the source being obtainable via loan sharing and thereby listed in the OPAC. 284 citations were purely internet-related sources; quite a few of those were websites created by other projects led by HU members and/or institutions. The number of citations per proposal varied a lot as well. Some projects had a very low number of citations, others comparatively very high numbers (see Appendix 3 Citations). The project LuKII (LOCKSS-und-KOPAL-Infrastruktur-und-Interoperabilitat) ¨ with the lowest amount of citations cites only seven sources, whereas the project Distributed Open Access Reference Citation Services (DOARC) cites 103. Grand proposals applied for at the DFG are supposed to cite or add literature references, but “Der Antrag sollte nicht mehr als 20 Seiten umfassen und aus sich heraus, auch ohne ¨re Lektu der zitierten oder beigefu ¨gten Literatur, verstandlich sein”. Therefore the ¨ amount of citations seem to be individually determinable. Owing to the survey results gathered by UIUC, citations in grant proposals were assessed as valuable
measurement for revenue generated by the respective library. This assumption is ROI in Germanbased on perceptions by the tenure system faculty. The question is if this is true for librariesGerman grant proposals as well. The vastly differing amount of citations persuccessful grant proposal for the IBI suggests that citations might not carry such animportance for success or failure in Germany. Comparing the two studies in this matteris impossible, however, as UIUC did not count the individual citations and no surveywas conducted for this study. Hence for this study, UIUC’s assumption of value for 151citations in grant proposals is taken as fact. Some of the internet-based sources cited in the grant proposals link to projects bythe HU, those that are very closely linked to the IBI and which sources are found via theUB catalogue have been counted as belonging to the UB (i.e. DINI – Deutsche Initiative ¨fur Netzwerkinformation e.V). Those that are linked to the HU by being a projectbut whose sources are not (yet) obtainable via the library are counted as internet-basedsources. Some grant proposals cite internet-based sources more often than once; for example ¨IUWIS lists press releases by “Borsenverein des Deutschen Buchhandels” in itsreferences list as well as in its footnotes. Sources listed twice were counted once only,but sources linking to differing locations on one website were counted twice. Thepercentage of citations obtainable via the university library were calculated accordingto above descriptions. This adds up to 40.08 percent citations that are obtainablethrough the UB (see Table II). As brieﬂy mentioned above, calculating the percentage of citations obtainable via thelibrary by counting and evaluating the citations single-handedly is a different way ofutilising the results as UIUC purported. With the help of data gathered with the surveyamong tenure system faculty, UIUC determined what percentage of faculty is usingcitations in grant proposals. Afterwards, they established the percentage of proposalsincluding citations obtained through the library, by multiplying the grants awarded withthe percentage of faculty stating that citations are important or essential in their grantsawards. This ﬁgure was then divided through the grant proposals made multiplied withthe percentage of proposals, including citations that are obtained via the library (seeTable I, UIUC ROI calculations). As said before, by counting and evaluating the citationsindividually, the established ﬁgures are more accurate and allow a more precisecalculation of the ROI. One has to keep in mind, however, that UIUC would have toevaluate the citations of 1,456 successful grant proposals for 2006 alone. Given thedifferences in scope, other institutions working with the UIUC method need to analyse ifcounting and evaluating costs more or less time and effort than executing a major survey.The grant proposals evaluatedBetween 2006 and 2009, 13 grant proposals applied for by the IBI were successful andhad grants awarded by either DFG, BMBF, or the European Union (EuropeanTotal amount of citations 474 Table II.Amount of citations obtained through UB 190 Citations obtainedProportion of citations obtained through UB in all through UB (library) inproposals (%) 40.08 (190/4.74) proposals (%)
BL Commision/i2010). (for more details, see the paragraphs on each grant proposal23,4 below or Appendix 3 Citations). When looking at this appendix the comment “not applicable” might catch someone’s eye, or the fact that there are more running numbers listed than citations in the total count. Not all footnotes were counted as citations. If the text provided in the footnote was additional information regarding the proposal but not a link or reference, the information was not counted as citation.152 As said before, the third-party funds statistics available at the HU website are not sufﬁcient for the purpose of this study; the HU statistics do not segment third-party funds into individual years per institute for more than the last accounting year (currently 2008). The funds expended are split between the institutions receiving grants, but the previous years are summarised as third-party funds expenditures for the entire HU. This fashion of listing funds forced individual calculations for each proposal to be made. The budget calculations themselves proved to be challenging. For example, the travel budget intended for DOARC was split up between the three participating institutions. This information posed the question of how detailed the calculations were going to be. If only the travel costs allotted to the HU were calculated, the costs for travel, publishing, and miscellaneous costs would minimize to e13,932.72 instead of e23,132.72 in total. Initially this way seemed to be the right way to go, as this study is concentrating on the IBI and the UB. Further considerations, however, indicated splitting up travel costs like that would imply splitting up the other costs as well. This in turn would demand a level of interrogation of applicant bodies that is not possible. In addition, it is not traceable which partner added which citation to the grant proposal. If the costs would be split up between the participating institutions, the citations would have to be split up too. This approach is too highly structured and not feasible simply because of applicants not remembering their citations. Under US practice, it is quite possible that grant money for one institution is also used to fund travel for people at other universities. Trying to tease out the amounts for other partners is not necessarily improving the comparability of data. Nevertheless, it is important to understand that this is a ROI study for the IBI and not for the other institutions, as the ROI is calculated on the basis of citations obtainable via the UB and the materials budget for the UB. The budgets of grant proposals applied for on a European level posed another problem. Total budgets for European projects amount to millions; for example, EuropeanaConnect has a budget of e4,798,149 (without own contribution) of which the HU receives only e191,986 (without own contribution). If this study were to use the total budgets allocated for European projects, as done for the DFG or BMBF funded projects, the ﬁnal ROI ﬁgure would be distorted immensely and thus lead to serious misrepresentations. Additionally, the amount of e191,986 allocated to the IBI for EuropeanaConnect as well as the budgets of the other two European-based projects, correspond with the budgets calculated for the non-European projects. Although this study does not aim at calculating a precise ROI number for the IBI and UB, but at reconstructing the UIUC study in a German academic setting, the ﬁgures should be as close as possible to reality and provide an approximate result in the end. Hence, for all European-based grant proposals only the budgets (without own contribution) allocated to the IBI were used for calculating the total budget.
IUWIS ROI in German ¨Infrastruktur Urheberrecht fur Wissenschaft und Bildung (IUWIS) is a two-yearproject applied for by Professor Michael Seadle from the IBI and Professor Rainer libraries ¨Kuhlen from the University in Constance (Universitat Konstanz). It is based at theIBI and funded by DFG. IUWIS has calculated to need 60 person-month on BAT IIa level or equivalent,creating a salary and fringe beneﬁt budget of e209,520. Additionally e46,464 are 153needed for four student assistants each working 40/h per month for both years. Costsfor printing, travel, as well as miscellaneous costs are summed up to e55,515; totallingthe grants awarded for IUWIS to e311,500. The proposal has 28 citations for sources found at the UB and 36 purelyinternet-based ones, summing up to 64 citations in total. Some citations appear twice,once in the footnotes and once in the references; depending on their source they are ¨ ¨counted once or twice. For example, the Gottinger Erklarung is listed as aninternet-based source, as well as a source obtainable through the library because the ¨references in the grant proposal point to differing sources established by the Gottinger ¨Erklarung.LuKII ¨LOCKSS-und-KOPAL-Infrastruktur-und-Interoperabilitat (LuKII) is one of the newestprojects currently pursued by the IBI. Its topic is the ongoing problem of long-termdigital archiving. Applicants are Professor Michael Seadle (IBI), Professor PeterSchirmbacher (IBI/CMS) and Dr Elisabeth Niggemann (DNB). LuKII was planned to run for two years and calculated to need 57 person-month onBAT IIa level or equivalent as well as one student assistant working 80/h month forboth years. The average salary and fringe beneﬁts can be estimated at e222,276.Additional costs such as scholarly equipment, travel expenses, and publishing costsare calculated at e58,450; totalling the probable budget to e280,726. Altogether, LuKII has only seven citations in total. Four citations are for sourcesobtainable through the UB and three are internet-based sources. This is speculative,but maybe because the websites for LOCKSS and kopal provide excellentinformation on each project and further references are not needed. In addition, LuKIIoperates on a new level of digital archiving and relevant sources may not be availableyet.EuropeanaConnectEuropeanaConnect is a project funded by the European Union working in closecontext with the major European library project Europeana. The applicant at theIBI is Professor Stefan Gradmann; he is one of 31 pan-European applicants. EuropeanaConnect asks for a total budget of e4,798,149 as contribution from theEuropean Commission. Of this large amount a mere e191,986 (4%) accrue to the IBI. Itis important to note that European projects are always funded only partly by theEuropean Commission, as much as up to half of the funding may come from within theparticipating institutions. In the case of EuropeanaConnect only 25 percent (e1,199,538)have to be contributed by the participating institutions. To incorporate thesedifferences for this study is unnecessary for the ﬁnal ROI calculations; for eachEuropean-funded project the grants awarded without own contribution are used.
BL EuropeanaConnect has 26 citations; only one is from a source obtainable by the UB.23,4 All other citations are links to European websites. This grant proposal differs from most of the others as it did not contain a separate reference list or high amount of footnotes, but links in the running text. Galateas154 Generalized Analysis for Logs for Automatic Translation and Episodic Analysis of Searches (Galateas) is a project with eight participants all based in Europe; the applicant at the IBI is Professor Vivien Petras. The total budget allotted for Galateas is e3,700,000 (without own contributions). The European contribution is e1,850,000 of which the IBI receives e62,356. This is the total budget for one research staff member and a student assistant working for two years, including travel costs. Altogether, the grant proposal for Galateas holds 31 citations of which 19 sources are obtainable via the UB and twelve are internet-based ones. Among the internet-based ones are two journals that have earlier issues available at the UB, but it was not clear if the needed issue is available as well; therefore, these were ascribed to the internet-based citations as they were available online. DOARC Distributed Open Access Reference Citation Services (DOARC) is a project of the IBI, the Institute for Chemistry at the HU, the Carl von Ossietzky University in Oldenburg, and the Institute for Science Networking in Oldenburg. The applicants are Professor Peter Schirmbacher (IBI/CMS), Dr Frank Havemann (IBI), Dr Wolfgang Christen (HU), Professor Volker Mellert (Carl von Ossietzky University Oldenburg), and Professor Eberhard R. Hilf (Institute for Science Networking). Not surprisingly, considering the topic, DOARC is the grant proposal with most citations. DOARC has 103 citations of which 39 are obtainable via the UB databases or OPAC, 64 citations are internet-based ones. A couple of the internet-based citations link to open access publications by the applicants, as for example Havemann (2004) “Eprints in der wissenschaftlichen Kommunikation.” One of the citations that were counted as being obtainable via the UB is not explicitly allocable. DOARC’s citation No. 51 (see Appendix 3 Citations is a publication by S. Katz in Science and Public Policy from 2006. The publication was not traceable at the HU for this speciﬁc year but for the year 2000; nor did the authors’ website provide the publication from 2006. As the source from 2000 was at ACM and the double non-appearance of the later publication might indicate a typing mistake by the applicants, the citation was counted for the UB. The total third-party funds allocated for DOARC sum up to e183,692,72; e160,560 are for stafﬁng costs and e23,132.72 for travel, publishing, and miscellaneous costs. EERQI European Educational Research Quality Indicators (EERQI) is a European research project in the 7t77h Framework Programme for Research in the Socio-economic Sciences and Humanities Theme (SSH). The applicant at the IBI is Professor Stefan Gradman.
Altogether, nineteen European institutions are participating in this project, the total ROI in Germanamount of grants awarded are e1,494,624. The Berlin School for Library and librariesInformation Science receives e136,720. As with the other European projects this projectis only partly funded by the European Commission, the total budget is e2,226,323.08and 67,13 per cent are funded. The amount left needs to be contributed by theparticipating institutions. The grant proposal contains 43 citations; 20 refer to sources obtainable by the UB 155and 23 are purely internet-based. Like the grant proposal EuropeanaConnect, the grantproposal for EERQI contains many references as links in the full-text. No peculiaritieswere discernible for citations in the grant proposal for EERQI.Forschungsdiversitat ¨ ¨The full title for this project is “Messung der Diversitat der Forschung”, applicants ¨ ¨are Dr Jochen Glaser (Freie Universitat Berlin), Michael Heinz (IBI), and Dr FrankHavemann (IBI). This project aims at creating methods for measuring the diversity ofresearch in various special subject areas and their respective organisations. ¨ The total budget for Forschungsdiversitat is e230,013. This is split up in e103,645for staff, consisting of e88,621 for 18 person-month on BAT IIa level or equivalent pluse17,424 for other stafﬁng costs not further speciﬁed. e126,338 are allocated for travel,scholarly equipment, publishing, and other costs. The staff budget for this project wasnot calculated with the help of the persona developed for this study, but taken from thebudget listing provided by the grant proposal. In contrast to grant proposals appliedfor at DFG that list the person-month only, grant proposals applied for at BMBF haveto calculate the person-month and the costs connected. Eighteen person-monthmultiplied with the e3,492 used as median for salary and fringe beneﬁts throughoutthis study sum up to e62,856. This is e25,765 less than the budget for staff costs ¨calculated throughout this study. Forschungsdiversitat has therefore calculated theirbudget with an older person in mind. As this study does not aim to provide an exactROI result, these differences are not important. For a concrete ROI ﬁgure, furtherinformation such as what age the actual person working in a position has, as well asthe marital status and place of residence would be necessary; however, this kind ofinformation is deemed to be too private in Germany. ¨ The citation count for Forschungsdiversitat is 48 in total; 41 are citations obtainablevia the UB. This is the grant proposal with the largest amount of citations obtainablevia the UB, the runner up is DOARC with 39 citations obtainable via the UB. Onlyseven citations are internet-based ones. None of the citations found were peculiar.CARPETThe motivation for CARPET (Community for Academic Reviewing, Publishing andEditorial Technology) was the ongoing process of virtualisation of workingprocesses in the academic area. The applicants are Professor Peter Schirmbacher ¨(IBI/CMS), Dr Norbert Lossau (SUB Gottingen), and Dr Laurent Romary (Max PlanckDigital Library, Berlin). CARPET (n.d.) was planned for two years and calculated to need 72 person-monthor three members of research staff for two years. Additionally three student assistantseach working 80h/month for two years were estimated, the budget for staff costs ise321,120. Additional e27,820 for travel and publishing raised the total budget to
BL e348,940. This is the highest budget for a DFG-funded project the IBI is involved in, the23,4 runner-up is IUWIS with e1,441 less. Twenty-six is the total count of citations made in the grant proposal for CARPET, with a very high amount of internet-based sources (20) and a small amount of library-obtainable sources (ﬁve). Four internet-based resources (DRIVER, eSciDoc, Berlin Declaration, Budapest Open Access Initiative) point to projects the HU is156 involved in. Meta-Image Art history is a visual-orientated subject and the digitalisation of scholarly life has opened new possibilities for research in art history. Applicants are Dr Martin Wanke ¨ ¨ ¨ ¨ (Leuphana Universitat Luneburg), Lisa Dieckmann (Universitat zu Koln), and Professor Peter Schirmbacher (IBI/CMS). Meta-Image (n.d.) has a total budget of e271,520 composed of e209,520 for staff and e62,000 for travel, publications, and miscellaneous costs. There is no budget for scholarly equipment as these are goods on own account. The citation count is relatively low, only 14 citations altogether. Nine are citations for publications obtainable via the UB and ﬁve are internet-based ones. One of the citations obtainable via the library is not clearly allocable, because it is microﬁche based at the UB until 1998 and then superseded by a link to the resources based in Marburg (Bildarchiv Foto Marburg). The resources provided on Marburg’s website, however, are freely accessible for everyone and do not have special access rights. A test browsing the site with HU VPN and without it showed no differences in presentation or access; therefore, the citation could have been listed as internet-based source as well. I decided to list it as UB source as the microﬁche is on-site at the main library, the website is detectable via the OPAC, and the reference in the grant proposal does not refer to a certain year. MUNIN-RS MUNIN-RS (Entwicklung und Implementierung einer Open-Source-Repository-Solution ¨ fur vernetztes Arbeiten mit wissenschaftlichen Bild- und Multimediasammlungen/ Modiﬁable Universal Image Network – Repository Solution) aims at developing and implementing a kind of repository-based solution for picture and multimedia collections. The applicant is Prof. Schirmbacher (IBI/CMS). The total budget estimated for MUNIN-RS is e276,880. Next to e214,080 for staff, the project calculates a very high amount of e53,000 for miscellaneous costs of which e 50,000 are intended for a service contract. A further e9,800 is budgeted for travel. A relatively low amount of citations (12) is split in ﬁve citations obtainable via the UB and seven purely internet-based ones. One of the internet-based sources is a website by the HU (Medienportal); it is counted as an internet-based resource because the Medienportal (n.d.) was not detectable via the OPAC or the digital library. OAN Open Access Netzwerk (OAN) is the oldest grant proposal of the 13 analysed for this study. Applied for in 2006 the project was funded for two years by DFG; starting the assembly of a network of certiﬁed open access repositories. The applicants are
¨ ¨Professor Peter Schirmbacher (IBI/CMS), Dr Judith Plumer (University of Osnabruck), ROI in German ¨and Dr Norbert Lossau (SUB Gottingen). Based on the calculations for the persona developed for this study, e202,464 are librariesbudgeted for staff working 48 person-month on BAT IIa level as well as three studentassistants each working 40h/month for two years. In addition e38,700 are estimated forscholarly equipment, travel expenses, and publications. The total amount calculated ise241,164. 157 OAN is one of the grant proposals with a very high count of citations forinternet-based sources. Of the 39 counted 31 are internet-based and only eightobtainable via the UB. All but one of the eight are online sources belonging to the UB(i.e. DINI website or edoc-Server). All of these are detectable with the aid of the OPACand therefore counted as sources belonging to the UB. A high amount of internet-basedsources is not remarkable, considering the requirements related to open access that isthe key element of this grant proposal.OAN2OA-Netzwerk 2 (OAN2) is the direct continuation of the OAN project. The grantproposal for OAN2 was written in 2009 and continues where OAN terminated. ¨Applicants are Professor Peter Schirmbacher (IBI/CMS), Dr Judith Plumer (University ¨ ¨of Osnabruck) and Dr Norbert Lossau, (SUB Gottingen), in addition Professor StefanGradmann (IBI) has joined the team. The total budget for OAN2 is e86,858 more than assessed for the previous projectOAN; the sum totals are e328,022. e286,272 are calculated for stafﬁng; 72person-month on BAT IIa level or equivalent and 18 month for a student assistantworking 40/h a month. Further costs add up to e 41,750. OAN2 has the third highestbudget of all grant proposals. Citations in the grant proposal for OAN2 add up to 17 citations only, of which 13 areinternet-based ones. Only four citations are obtainable via the UB; again, the citationsmirror the OA topic of the grant proposal. One of the internet-based sources links to theMathematics Subject Classiﬁcation which is available in print via loan sharing. Theprint version is from 2000, however, and the link refers to an up-to-date version, thecitation was counted as internet-based resource and not as belonging to the UB.DocupediaDocupedia is a project by Professor Peter Schirmbacher (IBI/CMS), Professor WilfriedNippel (Institute for History at the Humboldt University), and Professor Martin ¨Zabrow (Zentrum fur Zeithistorische Forschung Potsdam). It aims at creating asubject-speciﬁc organised, dynamically-growing repository containing encyclopaedictexts about contemporary history. This project was planned to run for three years and funding was applied for twoyears. The applicants calculated for 60 person-month on BAT IIa level or equivalent aswell as two student assistants each working 80/h per month for both years. Theaverage salary and fringe beneﬁt costs can be estimated at e255,984. Additional costsare calculated at e35,000 totalling the approximate budget to e290,984. The proposal has 45 citations; only seven citations can be found with the help of theUB and 38 citations are purely internet-based ones. Of the latter nine, links to websitescreated by projects the IBI, CMS or HU are involved. Quite a few links direct to the
BL same page but at varying contents. For example arxiv.org is counted twice because23,4 one link in the grant proposal leads to the main page and the second link to the information “How to replace an article in arxiv”. Double references like those are counted as two separate citations, because they do indicate two different destinations. Determining the ROI158 Usually determining the ROI is a simple mathematical, monetary calculation (see equation below), but as described before, UIUC had to conduct a survey and evaluate certain data to ﬁt into this kind of basic mathematical formula: ðGain from investment 2 Cost of InvestmentÞ ROI ¼ Cost of Investment The term “gain from investment” sounds innocent, but as discussed in the literature review of this study is rather difﬁcult for libraries, because no direct monetary gain from investment is discernible. For both studies, investment in libraries is understood as the budget allocated to a library. For UIUC the total library budget is $36,102,613. As visible in Table I, UIUC did not as indicated in the formula above, subtract the “cost of investment” from the “gain from investment” before dividing it. They simply divided the “total library budget” from the “gain from investment.” In the UIUC study the gain from investment is the proportion of grant income using library materials in US dollars. This assumption is the basis for their study. Probably UIUC decided to change the basis formula accordingly, because a library budget is not a real cost of investment for a certain product. Without the library budget a library would not exist. In contrast to almost 100 per cent of a library budget being provided by the federal state in Germany,59 library budgets or higher education in general are not highly state-subsidized in the USA: Public support for higher education in the USA has declined over the past quarter century. Nearly half of Illinois’ budget came from state funding in 1980; by 2008, that ﬁgure had declined to less than 17% (Kaufman, 2008a, p. 29). Nevertheless, the budget allocated is always the core of existence for a library and again for both studies the basis for the ROI calculation. In their study, UIUC calculated the ROI with the total library budget and only for comparison reasons with the materials budget. “If the materials budget, rather than the total budget, had been used, the ROI would have been approximately $12.” (Kaufman, 2008a, p. 32). For this study, the materials budget assigned to the Library and Information Science section at the UB is used. This is done because this study focuses on the IBI and not on the HU in general. For comparison, a second calculation is done with the complete materials budget of the UB. The materials budget of the UB is usually a combined amount of federal state money and earmarked capital such as third-party funding, funds for educational books, and special grants for the acquisition of electronic resources as well as funds spent on speciﬁc research. The latter is not included in the materials budget used for comparison, because the budget for the LIS section comes from the part of the materials budget that is state-funded. This second calculation makes sense as the citations in the grant proposals by the IBI do not remain
entirely in the LIS section. Some additional sources from ﬁelds such as law, economics, ROI in Germanand ICT (Information and Communication Technology) are used as well. libraries In 2009 the materials budget for the UB was e4,700,000. Approximately e2,200,000was earmarked capital as explained above, the rest (approximately e2,500,000) wasdistributed among the various subjects. The UB has a deﬁned model for the dispersionof budgets among all subjects available at the HU. In 2009 the budget for the LISsection was e30,600 (1.21 per cent of the federal state funding). The ROI is calculated 159with both values, e30,600 and e2,500,000.Doing the mathBetween 2006 and 2009, 13 grant proposals applied for by applicants related to the IBIhave been successfully accomplished or begun. The total amount of grands awardedfor these grant proposals sums up to approximately e3,190,502.72 (in three years),approximately e1,063,500.90 per year. The average size of grants the IBI received isapproximately e245,423.29. Owing to the decisions made for calculating the budgetand evaluating the citations, the ﬁgures are all approximate ﬁgures. Illinois calculated their proportion of grants secured using library materials in USdollar, by using their average size grant (see Table III, lines 7 and 8 of the ROIcalculation by UIUC below). In a second step, UIUC multiplied the result of the above calculation with thenumber of grants expended in the year 2006. This provided UIUC with the size of thegrant income using library materials (see Table IV, lines 9 and 10 of the ROIcalculation by UIUC). For the German study, the total amount of Euro secured with the help of third-partyfunds is available for calculating the proportion of grant income using librarymaterials; hence no average size grant is needed. The two steps above were combinedinto one. The proportion of grants awarded in Euro using the library is then calculatedby multiplying the percentage of citations obtainable through the UB with the totalamount of third-party funds awarded for 2006-2009 (see Table IV ROI calculation forthe IBI and the UB). Table V ROI calculations for the IBI and the UB shows the following results: . 13 grant proposals contain 474 citations of which 190 are obtainable through the library; . more than 40 percent of the grants awarded to the IBI came from citations in those 13 grant proposals that are obtainable through the UB; $ Table III.Average size grant 63,923 Lines 7 and 8 of the ROIProportion of grant $ secured using library materials 25,369 (78.14% * 50.79% * $ 63,923)/100/100 calculation by UIUC Table IV.No. grants (expended) in year 6,232 Lines 9 and 10 of the ROI$ proportion of grant income using library materials 158,099,608 (25,369 * 6,232) calculation by UIUC
BL No. grant proposals 13 Total no. of successful grant proposals at23,4 the IBI between 2006-2009 No. citations 474 Total count of citations No. citations obtainable through the UB 190 1st calculation % citations obtainable through the UB 40.08% For all grant proposals160 In total (see Appendix 2. Grants e total size of grants awarded 3,190,502.72 Calculations Final) 2nd calculation e proportion of grant income using the UB 1,278,753.49 (40,08% * 3,190,502.72)/100 No. of materials budget expended for LIS in 2009 e30,600 Approx. no. of materials budget expended for LIS in 2006-2009 e91,800 (e30,600 * 3 years) 3rd calculation University return in e grant on LIS 13,93 (1,278,753.49/91,800) Approx. no. of total materials budget for UB in 2009 2,500,000 Approx. no. of total materials budget for UB in 2006-2009 7,500,000 (e2,500,000 * 3 years)Table V. 4th calculationROI calculations for the University return in e grant on library e0,17 (1,278,753.49/7,500,000)IBI and the UB with the help of the IBI (materials budget) . for 2006-2009 the total grant income at the IBI is approximately e3,190,502.72; . the average proportion of the grant income generated by using the library resources is approximately e1,278,753.49; . dividing the proportion of the grant income generated by using the library resources through the approximate amount of the materials budget expended for the subject area LIS in three years, calculates a ROI of e13,93 for every Euro invested in the subject area LIS between 2006 and 2009; and . dividing the proportion of the grant income generated by using the library resources through the approximate total materials budget expended in three years, calculates a ROI of e0,17 for every Euro invested in the materials budget of the UB between 2006 and 2009. The results show that implementing the UIUC concept and formula in a different, in this case German academic setting, is possible. Certain amendments had to be made, but no major problems occurred. Similarities and differences In summary, it is clear that the essentials of the study created by UIUC have stayed the same, but that components were adapted for the study to work in a German academic setting that is considerably smaller in scope than UIUC’s facilities. For one, UIUC had to deal with a very large amount of grant proposals in just one year. This study had to adapt UIUC handling of large amounts of proposals in order to be able to work with a
comparably very small amount of 13 grant proposals. The huge difference in scope ROI in Germanindicated the possibility and maybe necessity to change the analysis and evaluation of librariesthe citations. As mentioned previously, the smaller scale of this study made afull-blown survey unnecessary. It was possible to evaluate the citations individuallyand thereby to retrieve a more accurate proportion of grants in Euro secure-able byusing library materials. Using citations in grant proposals as basis for incomegenerated by the library has stayed the same. 161 Further, UIUC had to establish that applicant bodies do actually use their ownlibrary and its resources for citations made in grant proposals. For this they had toconduct a large scale survey examining the tenure system faculty perceptions on therole the library plays in their research and grant-seeking activities (Kaufman, 2008a).On the one hand, the study for the IBI and the UB could rely on UIUC’s ﬁndings that“75% of respondents stated that over three-quarters of the citations they included intheir grant applications were accessed through the library” (Kaufman, 2008a, p. 31). Onthe other hand, individually evaluating each citation gave a clear result which citationsand how many citations were obtainable through the library (UB), not indicatinghowever if the applicant bodies really used the UB. Regarding the latter, when asking faculty at the IBI for the necessary documentsand grant proposals to conduct this study, a question intended to afﬁrm UIUC’sproposition was included. The recipients were asked to rate on a spectrum rangingfrom one to ﬁve how often they use materials that could be made available by theuniversity library; including databases, eBooks, electronic journals, and theedoc-Server. Rating with a one would imply 0 per cent of one’s materials aredetectable with the help of the UB, two would imply 25 per cent are obtainable, threewould imply 50 per cent, four would imply 75 per cent and ﬁve would imply 100 percent are obtainable through the UB. The spectrum was kept very elementary tosimplify answering the question. It was done in the hope of receiving a greater amountof replies. Even so only two answers came back; one voted a one or maximum two,stating that the grant proposals involved are usually focusing on applied researchrather than subject-speciﬁc fundamentals, thereby indicating that those grantproposals are not citing many resources obtainable through a library. Interestinglyenough, the grant proposals by this person had low amounts of citations. The secondanswer voted a four but was very unsure about it, simply because the person felt it wasimpossible to prove it. The grant proposals this person was involved in containedconsiderably more citations than the grant proposals by the previous person. As it was possible to analyse each citation individually, receiving answers from allapplicants was not that important for this study, but it would have been interesting toﬁnd out how much perception (rate) and reality (analysed citations) there is. If moreanswers were received, it would have been possible as well to verify that UIUC wasright in their assumption to use the statements by their tenure system faculty (i.e. 78.14per cent of faculty using citations in grant proposals) as basis for their ROIcalculations. All the same, this is not the research question of this study, but could bean interesting follow-up study. The ﬁnal calculations differ at two places. On the one hand, UIUC calculates theproportion (%) of grant income using library materials with the help of an average sizegrant that is multiplied with the number of grants expended in the year in question.For the IBI/UB study, calculating the average size grant was not necessary. As part of
BL the evaluation of the thirteen grant proposals, the total amount of grants awarded was23,4 estimated and used for receiving the result (proportion of grant income using library materials). In the ﬁnal calculation by UIUC, the ROI was calculated with the total library budget of UIUC’s university library. The ROI calculated as part of this study, was calculated with the materials budget allocated for the LIS subject area. Only for162 comparability was it calculated with the total materials budget as well. The latter calculation is not important for this study, because the grant proposals that were evaluated are all based on the IBI and the subject area Library and Information Science. Table VI lists all similarities and differences at a glance. Essentially, UIUC’s formula for calculating a ROI for an academic library has been maintained, but certain amendments due to scale and information available were made. Conclusion Although a different academic setting, the study for the IBI is very small in scale and focused on one subject area only. A further study for all subject areas at the Humboldt University, Berlin would provide a clearer picture of the strength and weaknesses adapting the formula devised by UIUC into a different environment. The author, however, does not believe that any major problems would appear when conducting the study on a larger scale in any German academic setting. Going along as this study did, and individually analysing hundreds of citations in grant proposals might be too much of an effort on a larger scale. This depends on the amount of people involved, however, and one could always resort to the way UIUC estimated their amount of proposals including citations. When conducting such a survey, a limitation of people who would receive the survey is not necessary in Germany; professors, faculty, and members of research staff should be allowed to answer if they take part in grant proposal applications. Interestingly, another question came up that, in the author’s opinion, could be answered with the help of UIUC’s formula. The author believes the difference in grant Description of process UIUC IBI/UB Initial position/ Study conducted for a major university Study conducted for a subject area and scope and its library its institution at a university Amount of Large (2,879 proposals/1,456 successful Small (13 successful proposals) proposals ones) Analysis With the help of estimations/based on a Individual evaluation for each citation large-scale survey (50,79% proposals (474 citations in total, 190 obtainable inc. citations obtained through library) through the library ¼ 40,08%) Calculation 1 Calculates $ of grant income using Calculates the proportion of grant library materials with an average size income using library materials with the grant multiplied with grants (expended) total amount of grants awarded between in 2006 2006-2009Table VI. Calculation 2 Calculates ROI with the total library Calculates ROI with the materialsSimilarities and budget budget for LIS (plus total materialsdifferences budget/total library budget)
proposal application behaviour between subject areas could be explored. One would ROI in Germanexpect application-orientated subjects such as ICT, physics, chemistry, and economics librariesto have large amounts of grant proposals with a high ROI, as they are understood asthe subjects third-parties are interested in. It is true that technically- andeconomically-orientated universities have higher third-party funding than others.Some of the application-orientated grant proposals for the IBI had low amounts ofcitations, however, and would not have a very high ROI in regards to the library. A 163quick glance at the amount of grant proposals at the HU in subject areas such asAfrican studies/literature (ten research projects), English and American Studies (26research projects), or German literature (43 research projects) show a surprisingamount of research studies; it occurred that it would be interesting to evaluate theirROI in regards to the library. The ﬁnal ROI ﬁgures would not indicate which subject isbetter or worth more in creating a ROI for the university, but the size of results wouldperhaps illuminate differences in research behaviour and eventually help a universitylibrary to decide which collections for which subject area to extend. UIUC has planned applying their ROI formula to multiple institutions as well asexpanding the longitudinal scope. It will be interesting to see their follow-up studiesthat might show differences in institutional characters or in the countries as well. The only problem that can be seen with the study by UIUC is the fact that they basethe proportion of grant proposals containing citations obtainable through the libraryon a survey. Kingma validated their model, but the survey is UIUC’s weakest link, andany study going along the same lines needs to make sure that their survey isimpervious. This study validates the original research question “Can the methodologydeveloped by UIUC be applied to German universities?” It shows that UIUC developeda ROI model and formula that is modiﬁable enough to ﬁt into different academicsettings. Their formula had to be adapted, but it was easy to do so. As said before,university libraries implementing the formula have to take extra special care whenevaluating the citations either with the help of a survey, or by counting themindividually. If striving for a concrete ROI ﬁgure, the evaluation of the citations is thefocal point. Hopefully, ROI studies as this one by UIUC will help to value academic libraries’impact on research and revenue generating activities.Notes 1. www.hu-berlin.de/ (accessed April 25, 2010). 2. “Deans from a number of leading iSchools have joined together to leverage the power of leading iSchools in building awareness of, support for and involvement with the iField among key constituencies, principally the media, business community, those who fund research, student prospects, and users of information.“ www.ischools.org/site/about/ (accessed February 15, 2010). 3. www.ub.hu-berlin.de/ueber-uns/proﬁl (accessed February 15, 2010). 4. www.investopedia.com/terms/r/returnoninvestment.asp (accessed March 27, 2010). 5. See publications in Social Enterprise Journal (2005), Strategic HR Review (2009), Journal of Consumer Marketing (1999), International Journal of Hospitality Management (1983), Handbook of Business Strategy (2004), Journal of Accounting and Public Policy (1996).
BL 6. www.google.de/url?sa ¼ t&source ¼ web&ct ¼ res& cd ¼ 1&ved ¼ 0CBAQFjAA&url ¼ http%3A%2F%2Fciteseerx.ist.psu.edu%2Fviewdoc%2Fdownload%3Fdoi%3D10.1.1.129.23,4 2114%26rep%3Drep1%26type%3Dpdf&ei ¼ zmSFS-eCNKTqmgP-8cGtAg&usg ¼ AFQjCNE3g7V508WEU8gUbIigWvmf-No_CQ&sig2 ¼ Sb7IC6GJzU9hotNT-kHoUQ (accessed February 21, 2010). 7. www.bl.uk/pdf/measuring.pdf (accessed February 21, 2010).164 8. This quote translates as: “The awareness for reasons why libraries and librarians exist was missing as well as the comprehension how to gain and keep support from their beneﬁciaries. Only now this has changed.” 9. http://mel.org/ﬁles/calculatorcode.php (accessed March 23, 2010). 10. The Library of Michigan Return on Investment Calculator as well as the North Suburban Library System (NSLS) calculator allows its users to enter the amount of books, magazines, audio books, movies, etc. borrowed per month and calculate the ROI in the case of NSLS with the help of average list and retail prices of those items. Michigan in return does not specify where the numbers come from and let you speculate if they used retail prices as well or considered other costs such as library budget used for human resources needed for records management as well. 11. www.youtube.com/watch?v ¼ TgqoM5ZNu3Q (accessed March 23, 2010) The video shows a selfmade advertisement for the North Suburban Library System’s ROI calculator. 12. www.bmbf.de/de/1321.php (accessed February 21, 2010). The German Exzellenzinitiative ¨ funded by the BMBF (Bundesministerium fur Bildung und Forschung) claims to support cutting-edge research at outstanding universities, but the ﬁrst two rounds (2006, 2007) show a strong bias towards richer German states. Only a fraction of the nominated winning ¨ universities are not in the two richest German states Baden-Wurrtemberg and Bavaria. 13. Freely translated this quote says: “The German ﬁeld of Library and Information Science (LIS) has not shown much inclination to deal with this.” 14. Freely translated this quote says: “Virtual prices are estimated through surveys conducted with users.” 15. www.sub.uni-goettingen.de/ (accessed February 18, 2010). 16. www.uni-goettingen.de/ (accessed February 18, 2010). 17. www.dfg.de/index.jsp (accessed March 23, 2010). 18. www.bmbf.de/ (accessed March 23, 2010). 19. http://gepris.dfg.de/gepris/OCTOPUS/ (accessed March 23, 2010). ¨ 20. The ﬁve Universities of Applied Science searched for, were: Hochschule fur Angewandte Wissenschaften Hamburg, Fachhochschule Potsdam, Hochschule Darmstadt, Hochschule ¨ fur Technik, Wirtschaft und Kultur Leipzig and Hochschule der Medien Stuttgart. 21. http://forschung.hu-berlin.de/statistik/ (accessed March 16, 2010). ` 22. Personae are ﬁctive people devised to represent a certain clientele (in Marketing) or users (Usability studies). The persona devised for this study is between 26 and 28 years old, single, has a postgraduate degree and starts the ﬁrst job as research assistant. 23. For calculations of the BAT (Bundesangestelltentarif) see http://de.wikipedia.org/wiki/ Bundesangestelltentarifvertrag or http://oeffentlicher-dienst.info/tv-l/berlin/ (accessed March 26, 2010). People employed in the public service in Germany are paid based on a complicated system considering previous knowledge, age, marital status, place of residence and other. As this is very complex only average costs may be calculated.
24. For more information on TV-L see http://de.wikipedia.org/wiki/Tarifvertrag_f%C3%BCr_ ROI in German den_%C3%B6ffentlichen_Dienst_der_L%C3%A4nder (accessed March 26, 2010) Again there are no sources available in English. libraries25. Translates as: Initial position/own preparatory work.26. www.kobv.de/ (accessed April 16, 2010). Kooperativer Bibliotheksverbund Berlin Brandenburg’ is the cooperative network of all academic, public and many corporate libraries in Berlin and Brandenburg supporting each other by creating a wholesome stock of 165 ` materials and media as well as devising new services for their clientele.27. www.dfg.de/forschungsfoerderung/formulare/download/1_02.pdf (accessed January 12, 2010). Freely translated this quote says: “The grant proposal should not exceed 20 pages and should be coherent on its own; reading citations and additional literature should not be necessary for comprehension”.28. www.dini.de/ (accessed April 10, 2010).29. http://ec.europa.eu/information_society/eeurope/i2010/index_en.htm (accessed March 30, 2010).30. Most of the time European projects receive only 50 per cent of the estimated budget for funding. The other half needs to be contributed by the participating institutions (own contributions). Hence is it important to indicate when talking about European budgets if the numbers are including or excluding own contributions. As far as I understood the calculations, own contributions are not always monetary, but can be set against equipment such as computers, costs for Internet connection and such.31. www.iuwis.net/ (accessed April 13, 2010)32. www.uni-konstanz.de/ (accessed April 23, 2010).33. www.urheberrechtsbuendnis.de/index.html.de (accessed April 14, 2010).34. CMS are the facilities responsible for all computer and technical support at the HU situated in South-East Berlin in Adlershof. The director of the CMS is at the same time a professor at the IBI.35. http://lockss.stanford.edu/lockss/Home (accessed April 23, 2010).36. http://kopal.langzeitarchivierung.de/index_koLibRI.php.de (accessed April 23, 2010).37. www.europeanaconnect.eu/ (accessed April 5, 2010).38. http://europeana.eu/portal/ (accessed April 5, 2010).39. http://cordis.europa.eu/fp7/ict/language-technologies/project-galateas_en.html (accessed April 20, 2010).40. http://doarc.projects.isn-oldenburg.de/ (accessed April 5, 2010).41. www.eerqi.eu/ (accessed April 3, 2010).42. Translates as: “Measuring the diversity of research”43. See: www.fu-berlin.de/ (accessed April 15, 2010).44. www.carpet-project.net/ (accessed April 20, 2010).45. www.mpg.de/instituteProjekteEinrichtungen/weitereEinrichtungen/mpdl/index.html46. www.uni-koeln.de/47. www.fotomarburg.de/ (accessed April 12, 2010).48. http://medienportal.hu-berlin.de/ (accessed April 15, 2010).
BL 49. www.dini.de/projekte/oa-netzwerk/ (accessed April 15, 2010).23,4 50. www.uni-osnabrueck.de/ (accessed April 25, 2010). 51. www.dini.de/projekte/oa-netzwerk/ (accessed April 15, 2010). 52. www.ams.org/mathscinet/msc/msc2010.html (accessed April 16, 2010). 53. www.geschichte.hu-berlin.de/ (accessed April 25, 2010).166 54. www.zzf-pdm.de/ (accessed April 2, 2010). 55. http://arxiv.org/ (accessed April 2, 2010). 56. http://arxiv.org/help/replace (accessed April 2, 2010). 57. Source: http://www.investopedia.com/terms/r/returnoninvestment.asp (accessed April 16, 2010) 58. www.bibliotheksportal.de/hauptmenue/bibliotheken/bibliotheken-in-deutschland/ bibliothekslandschaft/unterhaltstraeger/ (accessed April 16, 2010) “Wegen der ¨ grundgesetzlich verbrieften Kulturhoheit sind in Deutschland die Lander die wichtigsten ¨ Trager wissenschaftlicher Bibliotheken.” Translates as: “Due to the chartered independence in educational and cultural matters in Germany, federal states are the fundamental funding bodies for academic libraries.” ¨ ¨ ¨ 59. The original question in German: Wie hauﬁg benutzen Sie fur Ihre Antrage Materialien, die ¨ auch von der Universitatsbibliothek in irgendeiner Form (Datenbanken, eBooks, Bucher, ¨ ¨ Zeitschriften, elektronische Zeitschriften, etc.) zur Verfugung gestellt werden? Bitte beziehen ¨ Sie Materialien vom edoc-Server auch mit ein. Um die Antwort zu vereinfachen schatzen Sie Ihre Benutzung bitte auf einer Scala von 1 – 5, eins bedeutet 0 percent, 2 ¼ 25 percent, 3 ¼ 50 percent, 4 ¼ 75 percent und 5 ¼ 100 percent. Eins bedeutet dass Ihre Zitierungen ¨ nicht mit Hilfe der UB gefunden werden konnen und auch nicht mit Hilfe der UB darauf ¨ ¨ zugegriffen hatte werden konnen. 100 percent bedeutet dass Ihre Zitierungen alle mit Hilfe ¨ der UB gefunden und zuganglich gewesen waren. ¨ 60. http://forschung.hu-berlin.de/fdb/ (accessed April 20, 2010). The Forschungsdatenbank (database for research projects) at the HU lists all current and older projects accomplished by institutions at the HU. It is possible to search by institution (subject area), project leader, keyword and funding body. References Aabø, S. (2009), “Libraries and return on investment (ROI): a meta-analysis”, New Library World, Vol. 110 Nos 7/8, pp. 311-24. Arrow, K., Solow, R., Portney, P.R., Leamer, E.E., Radner, R. and Schuman, H. (1993), “Report of the NOAA panel on contingent valuation”, available at: www.google.de/url?sa¼t& source ¼web&ct¼res&cd¼1&ved¼0CBAQFjAA&url¼http%3A%2F%2Fciteseerx.ist.psu. edu%2Fviewdoc%2Fdownload%3Fdoi%3D10.1.1.129.2114%26rep%3Drep1%26type% 3Dpdf&ei¼zmSFS-eCNKTqmgP-8cGtAg&usg¼AFQjCNE3g7V508WEU8gUbIigWvmf -No_CQ&sig2¼Sb7IC6GJzU9hotNT-kHoUQ (accessed February 21, 2010) Bennekom, van F.C. (2002), Customer Surveying. A Guidebook for Service Managers, Customer Service Press. ¨ Blanck, S. (2006), Neues fur Bibliotheken – Neues in Bibliotheken. Wert und Wirkung von Bibliotheken, BIT Verlag, Wiesbaden. British Library (2004), “Measuring our value”, available at: www.bl.uk/pdf/measuring.pdf (accessed February 21, 2010).
Busch, R. (2004), Wie viele Bibliotheken brauchen wir?, Bock þ Herrchen, Bad Honnef. ROI in GermanCARPET (n.d.), “carpet-project.net: CARPET – Community for Academic Reviewing, Publishing libraries and Editorial Technology: Startseite”, available at: www.carpet-project.net/ (accessed April 20, 2010).Fett, O. (2004), “Impact – Outcome – Beneﬁt. Ein Literaturbericht zur Wirkungsmessung fur ¨ Hochschulbibliotheken”, in Umlauf, K. (Ed.), Berliner Handreichungen zur Bibliothekswissenschaft, Vol. 142, pp. 1-71. 167Grifﬁth, J-M. (2004), “Taxpayer return on investment in Florida public libraries: Summary Report September 2004”, available at: http://dlis.dos.state.ﬂ.us/bld/roi/pdfs/ROISummaryReport. pdf (accessed March 23, 2010).Havemann, F. (2004), “Eprints in der wissenschaftlichen Kommunikation”, available at: www.ib. hu-berlin.de/, fhavem/E-prints.pdf (accessed April 5, 2010).Holt, G.E., Elliott, D. and Dussold, C. (1996), “A framework for evaluating public investment in urban libraries”, The Bottom Line: Managing Library Finances, Vol. 9 No. 4, pp. 4-13.Imholz, S. and Weil Arns, J. (2008), “Worth their weight: an assessment of the evolving ﬁeld of library evaluation”, Public Library Quaterly, Vol. 26 Nos 3/4, pp. 31-48.Kaufman, P.T. (2008a), “The library as strategic investment: results of the University of Illinois Return on Investment Study”, Online Information 2008 Proceedings, pp. 29-36.Kaufman, P.T. (2008b), “The library as strategic investment: results of the University of Illinois Return on Investment Study”, Library Quarterly, Vol. 18, pp. 424-37.KOBV (n.d.), “KOBV: Startseite”, available at: www.kobv.de/ (accessed April 16, 2010).(The) Krafty Librarian (2008), available at: http://kraftylibrarian.com/2008/02/how-much-are- you-worth.html (accessed April 6, 2010).Luther, J. (2008), “University investment in the library: what’s the return? A case study at the University of Illinois at Urbana-Champaign”, White paper 1-18, 2010), available at: http:// libraryconnect.elsevier.com/whitepapers/lcwp0101.pdf (accessed January 2, 2010).Medienportal (n.d.), “Medienportal – JadisNet”, available at: http://medienportal.hu-berlin.de/ (accessed April 15, 2010).Meta-Image (n.d.), available at: www.leuphana.de/meta-image/ (accessed April 10, 2010).Missingham, R. (2005), “Libraries and economic value: a review of recent studies”, Performance Measurement and Metrics, Vol. 6 No. 3, pp. 142-58.Mitchell, R.C. and Carson, R.T. (1993), Using Surveys to Value Public Goods: The Contingent Valuation Method, Johns Hopkins University Press, Baltimore, MD.Mitchell, R.C. and Carson, R.T. (2000), Using Surveys to Value Public Goods: The Contingent Valuation Method, Johns Hopkins University Press, Baltimore, MD.Oder, N. (2009), “Study at UIUC suggests $4,38 in grant income for each library dollar”, Library Journal, 22 January, available at: www.libraryjournal.com/article/CA6631202.html (accessed March 30, 2010).Payne, P. and Conyers, A. (2005), “Measuring the impact of higher education libraries: the LIRG/SCONUL Impact Implementation Initiative”, Measuring the Impact of Higher Education Libraries: The LIRG/SCONUL Impact Implementation Initiative, Library and Information Research, Vol. 29 No. 91, pp. 1-9.Poll, R. and Boekhorst, P. (2007), Measuring Quality: Performance Measurement in Libraries, ¨ K.G. Saur, Munchen.Poll, R. and Payne, P. (2006), “Impact measures for libraries and information services”, available at: http://eprints.rclis.org/9161/1/payne_poll_ﬁnal_web.pdf (accessed February 27, 2010).
BL Strouse, R. (2003), “Demonstrating value and return on investment: the ongoing imperative – assessing your library’s value statement”, Information Outlook, March, available at: http://23,4 ﬁndarticles.com/p/articles/mi_m0FWE/is_3_7/ai_99011610/?tag¼content;col1 (accessed February 25, 2010).168 Further reading About the iSchools (n.d.), available at: www.ischools.org/site/about/ (accessed February 15, 2010). ¨ Aktionsbuendnis (n.d.), “Aktionsbuendnis – Urheberrecht fur Bildung und Wissenschaft”, available at: www.urheberrechtsbuendnis.de/index.html.de (accessed April 14, 2010). arXiv.org (n.d.), “arXiv.org e-Print archive”, available at: http://arxiv.org/ (accessed April 2, 2010). arXiv.org help (n.d.), “arXiv.org help – to replace an article”, available at: http://arxiv.org/help/ replace (accessed April 2, 2010). ¨ ¨ Ausgewahlte Statistiken – Humboldt Universitat zu Berlin (n.d.), available at: http://forschung. hu-berlin.de/statistik/ (accessed March 16, 2010). ¨ Frdgliotheksportal (n.d.), “Frdgliotheksportal: Unterhaltstrager”, available at: www.frdgliotheks portal.de/hauptmenue/frdgliotheken/frdgliotheken-in-deutschland/frdgliotheksland schaft/unterhaltstraeger/ (accessed April 16, 2010). BMBF (n.d.a), “BMBF: Exzellenzinitiative”, available at: www.bmbf.de/de/1321.php (accessed February 21, 2010). ¨ BMBF (n.d.b), “BMBF: Bundesministerium fur Bildung und Forschung”, available at: www. bmbf.de/ (accessed March 23, 2010). Bundesangestelltentarifvertrag (n.d.), “Bundesangestelltentarifvertrag – Wikipedia”, available at: http://de.wikipedia.org/wiki/Bundesangestelltentarifvertrag (accessed March 26, 2010). CORDIS (n.d.), “CORDIS: ICT: programme: language technologies”, available at: http://cordis. europa.eu/fp7/ict/language-technologies/project-galateas_en.html (accessed April 20, 2010). Dawson, S.M. (1983), “A synthesis of alternative techniques for calculating the return on investment”, International Journal of Hospitality Management, Vol. 2, pp. 135-9. ¨ DFG (n.d.a), “DFG – Deutsche Forschungsgemeinschaft – Formulare und Merkblatter”, available at: www.dfg.de/foerderung/formulare_merkblaetter/index.jsp (accessed January 12, 2010). DFG (n.d.b), “DFG – Deutsche Forschungsgemeinschaft”, available at: www.dfg.de/index.jsp (accessed March 23, 2010). DFG (n.d.c), “DFG – GEPRIS”, available at: http://gepris.dfg.de/gepris/OCTOPUS/;jsessionid¼ 54F0262DC449F16AAE3FDF3184DCB689 (accessed March 23, 2010). ¨ DINI (n.d.a), “DINI – Deutsche Initiative fur Netzwerkinformation e.V.: OA-Netzwerk”, available at: www.dini.de/projekte/oa-netzwerk/ (accessed April 5, 2010). ¨ DINI (n.d.b), ”DINI – Deutsche Initiative fur Netzwerkinformation e.V.: Startseite”,available at: www.dini.de/ (accessed April 10, 2010). DNB (n.d.), “DNB, Deutsche Nationalfrdgliothek – home”, available at: www.d-nb.de/ (accessed April 26, 2010). DOARC (n.d.), “DOARC – Prototyp”, available at: http://doarc.projects.isn-oldenburg.de/ (accessed April 5, 2010). EERQI (n.d.), “About EERQI”, available at: www.eerqi.eu/ (accessed April 3, 2010).
Europeana (n.d.), “Europeana – homepage”, available at: http://europeana.eu/portal/ (accessed ROI in German April 5, 2010). librariesEuropeanaConnect (n.d.), available at: www.europeanaconnect.eu/ (accessed April 5, 2010).Flockhart, A. (2005), “Raising the proﬁle of social enterprises: the use of social return on investment (SROI) and investment ready tools (IRT) to bridge the ﬁnancial credibility gap”, Social Enterprise Journal, Vol. 1 No. 1, pp. 29-42.Forschungsdatenbank der HU (n.d.), .),”Forschungsdatenbank der HU – Humboldt Universitat ¨ 169 zu Berlin”, available at: http://forschung.hu-berlin.de/fdb/ (accessed April 20, 2010). ¨ ¨Freie Universitat Berlin (n.d.), “Freie Universitat Berlin: Startseite”, available at: www.fu-berlin. de/ (accessed April 15, 2010). ¨ ¨Georg-August-Universitat Gottingen (n.d.), available at: www.uni-goettingen.de/ (accessed February 18, 2010).Gordon, L.A. and Iyengar, R.J. (1996), “Return on investment and corporate capital expenditures: empirical evidence”, Journal of Accounting and Public Policy, Vol. 15, pp. 305-25.Home – LOCKSS (n.d.), available at: http://lockss.stanford.edu/lockss/Home (accessed April 23, 2010). ¨Homepage – Humboldt Universitat zu Berlin (n.d.), available at: www.hu-berlin.de/ (accessed April 25, 2010). ¨Humboldt Universitat zu Berlin (2009), Berlin School of Library and Information Science, ¨ Humboldt Universitat zu Berlin, Berlin.i2010/Europa (n.d.), available at: http://ec.europa.eu/information_society/eeurope/i2010/index_ en.htm (accessed March 30, 2010). ¨ ¨Institut fur Frdgliotheks (n.d.), “Institut fur Frdgliotheks- und Informationswissenschaft – IBI”, available at: www.ibi.hu-berlin.de/ (accessed April 25, 2010). ¨ ¨Institut fur Geschichtswissenschaften HU-Berlin (n.d.), “Institut fur Geschichtswissenschaften HU-Berlin – Startseite”, available at: www.geschichte.hu-berlin.de/ (accessed April 25, 2010).IUWIS (n.d.), available at: www.iuwis.net/ (accessed April 13, 2010).kopal (n.d.), “kopal – Kooperativer Aufbau eines Langzeitarchivs digitaler Informationen – koLibRI: kopal library for Retrieval and Ingest”, available at: http://kopal. langzeitarchivierung.de/index_koLibRI.php.de (accessed April 23, 2010).Library of Michigan (n.d.) Vol. 2, “Library of Michigan return on investment calculator”, available at: http://mel.org/ﬁles/calculatorcode.php (accessed March 23, 2010).Max Planck Gesellschaft (n.d.), “Max Planck Gesellschaft – Max Planck Digital Library (MPDL)”, available at: www.mpg.de/instituteProjekteEinrichtungen/weitere Einrichtungen/mpdl/index.html (accessed April 24, 2010).MSC2010 (n.d.), “MSC2010 database”, available at: www.ams.org/mathscinet/msc/msc2010.html (accessed April 16, 2010). ¨ ¨ ¨Niedersachsische Staats- und Universitatsfrdgliothek Gottingen (n.d.), available at: www.sub. uni-goettingen.de/ (accessed February 18, 2010). ¨ ¨Offentlicher-Dienst.Info (n.d.), “Offentlicher-Dienst.Info – TV-L – Berlin”, available at: http:// oeffentlicher-dienst.info/tv-l/berlin/ (accessed March 26, 2010). ¨ ¨Phillipps-Universita t Marburg (n.d.), “Phillipps-Universitat Marburg – Deutsches ¨ Dokumentationszentrum fur Kunstgeschichte – Bildarchiv Foto Marburg: Willkommen – Bild”, available at: www.fotomarburg.de/ (accessed April 12, 2010).
BL ¨ Proﬁl – Universitatsfrdgliothek der HU Berlin (n.d.), available at: www.ub.hu-berlin.de/ueber- uns/proﬁl (accessed February 15, 2010).23,4 Return on Investment (n.d.), “Return on investment (ROI)”, available at: www.investopedia.com/ terms/r/returnoninvestment.asp (accessed April 16, 2010). Seymann, M. and Kleinhanzi, B. (2004), “Return on directors: maximizing return on investment in the board room”, Handbook of Business Strategy, Vol. 5 No. 1, pp. 23-8.170 ¨ ¨ ¨ Tarifvertrag (n.d.), “Tarifvertrag fur den offentlichen Dienst der Lander – Wikipedia”, available at: http://de.wikipedia.org/wiki/Tarifvertrag_f%C3%BCr_den_%C3%B6ffentlichen_ Dienst_der_L%C3%A4nder (accessed March 26, 2010). ¨ Universitat Konstanz (n.d.), available at: www.uni-konstanz.de/ (accessed April 23, 2010). ¨ ¨ Universitat Osnabruck (n.d.), available at: www.uni-osnabrueck.de/ (accessed April 25, 2010). ¨ ¨ Universitat zu Koln (n.d.), available at: www.uni-koeln.de/ (accessed April 25, 2010). van Bennekom, F.C. (2002), Customer Surveying. A Guidebook for Service Managers, Customer Service Press, Bolton, MA. Yapp, M. (2009), “Measuring the ROI of talent management”, Strategic HR Review, Vol. 8 No. 4, pp. 5-10. You Tube (n.d.), “You Tube – libraries return on investment (ROI)”, available at: www.youtube. com/watch?v¼TgqoM5ZNu3Q (accessed March 23, 2010). Zajas, J.J. (1999), “Measuring brand communication: return on investment”, Journal of Consumer Marketing, Vol. 16 No. 6, pp. 616-29. ¨ Zentrum fur Zeithistorische Forschung Potsdam (n.d.), available at: www.zzf-pdm.de/ (accessed April 2, 2010). Appendix 1. Grant proposals . Applicant body: Christen, W., Havemann, F., Hilf, E.R., Mellert, V. and Schirmbacher, P. (2008), Erschließung von Zitationen in verteilten Open-Access Repositorien (Distributed ¨ Open Access Reference Citation Services) Acronym: DOARC. Antrag auf Forderung durch ¨ die DFG im Fo rderungsbereich Wissenschaftliche Literaturversorgungs- und Informationssysteme (LIS), pp. 1-26. . Applicant body: Dieckmann, L., Schirmbacher, P. and Warnke, M. (2008), Meta-Image – ¨ ¨ Forschungsumgebung fur den Bilddiskurs in der Kunstgeschichte. Antrag auf Forderung ¨ durch die DFG im Forderungsbereich Wissenschaftliche Literaturversorgungs- und Informationssysteme (LIS), pp. 1-23. . ¨ ¨ Applicant body: Glaser, J., Havemann, F. and Heinz, M. (2008), Messung der Diversitat der ¨ Forschung. Antrag auf Forderung durch das BMBF, pp. 1-15. . ¨ Applicant body: Gradmann, S., Lossau, J., Plumer, J. and Schirmbacher, P. (2009), Weiterentwicklung und Betrieb des Netzwerks zertiﬁzierter Open-Access-Repositorien fur ¨ Deutschland. (Fortsetzungsantrag) Kennwort: OA-Netzwerk 2. Antrag auf Forderung ¨ ¨ durch die DFG im Forderungsbereich Wissenschaftliche Literaturversorgungs- und Informationssysteme (LIS), pp. 1-42. . Applicant body: Kuhlen, R. and Seadle, M. (2009), Aufbau einer Informationsinfrastruktur ¨ ¨ zum Urheberrecht fur Bildung und Wissenschaft. Urheberrechtliches Wissen fur Bildung ¨ ¨ und Wissenschaft (urhWiss). Antrag auf Forderung durch die DFG im Forderungsbereich Wissenschaftliche Literaturversorgungs- und Informationssysteme (LIS), pp. 1-25. . ¨ Applicant body: Lossau, N., Plumer, J. and Schirmbacher, P. (2006), Aufbau eines Netzwerks zertiﬁzierter Open-Access Repositories. Kenntwort: OA-Netzwerk. Antrag auf
¨ ¨ Fo rderung durch die DFG im Fo rderungsbereich Wissenschaftliche ROI in German Literaturversorgungs- und Informationssysteme (LIS), pp. 1-37. . Applicant body: Lossau, N., Romary, L. and Schirmbacher, P. (2007), Aufbau einer libraries ¨ Informationsplattform fu r das Publizieren auf der Basis generischer ¨ Publikationswerkzeuge. Kennwort: CARPET. Antrag auf Forderung durch die DFG im ¨ Forderungsbereich Wissenschaftliche Literaturversorgungs- und Informationssysteme (LIS), pp. 1-34. 171 . Applicant body: Niggemann, E., Seadle, M. and Schirmbacher, P. (2009), ¨ ¨ LOCKSS-und-KOPAL Infrastruktur-und-Interoperabilitat. Antrag auf Forderung durch ¨ die DFG im Fo rderungsbereich Wissenschaftliche Literaturversorgungs- und Informationssysteme (LIS), pp. 1-34. . Applicant body: Nippel, W., Sabrow, M. and Schirmbacher, P. (2007), Docupedia-Zeitgeschichte – thematische Netzwerke und informelles Publizieren mit dem ¨ Software-Framework MediaWiki. Antrag auf Gewahrung einer Sachbeihilfe durch die DFG, in Bezugnahme auf das DFG-Schwerpunktprogramm: Informations-Infrastrukturen ¨ fur netzbasierte Forschungskooperation und digitale Publikationen und Elektronische Publikationen im Literatur- und Informationsangebot wissenschaftlicher Bibliotheken, pp. 1-48. . Applicant body: Schirmbacher, P. (2008), Entwicklung und Implementierung einer ¨ Open-Source-Repository Solution fur vernetztes Arbeiten mit wissenschaftlichen Bild- ¨ und Multimediasammlungen. Kennwort: MUNIN-RS. Antrag auf Forderung durch die ¨ DFG im Forderungsbereich Aufbau und Vernetzung von Repositorien, pp. 1-21. . eContentplus. EuropeanaConnect (2008), Description of Work, pp. 1-140. . European Educational Research Quality Indicators, EERQI (2008), Grant agreement No. 217549, Annex I, Description of Work, pp. 1-96. . GALATEAS Generalized Analysis of Logs for Automatic Translation and Episodic Analysis of Searches (2009), Proposal Part B, pp. 1-88.(Further Appendices overleaf)
BL 23,4 172 Table AI. Consisting of Scholarly Money calculated E Staff costs E equipment E Travel expenses E Publishing E Other costs E CommentsIUWIS 347,499.00 255,984.00 0.00 6,990.00 38,700.00 9,825.00LuKII 280,726.00 222,276.00 10,000.00 11,100.00 1,350.00 36,000.00 Appendix 2. Grant calculations ﬁnalEuropeanaConnect 191,986.00 £ £ £ £ £ EU projectGalateas 62,356.00 £ £ £ £ £ EU projectDOARC 183,692.00 160,560.00 7,482.72 13,800.00 1,850.00 0.00EERQI 136,720.00 £ £ £ £ £ EU project ¨Forschungsdiversitat 230,013.00 103,645.00 32,996.00 33,500.00 6,910.00 52,962.00Carpet 348,940.00 321,120.00 0.00 23,2220.00 4,600.00 0.00Meta-Image 271,520.00 209,520.00 0.00 27,000.00 5,000.00 30.000.00MUNIN-RS 276,880.00 214,080.00 0.00 9,800.00 0.00 53,000.00OAN 241,164.00 202,464.00 12,900.00 23,100.00 2,700.00 0.00OAN2 328,022.00 186,272.00 2,000.00 31,550.00 8,200.00 0.00Docupedia 290,984.00 255,984.00 5,500.00 16,000.00 1,200.00 12,300.00Total amount 3,190,502.00
IDWIS Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 1. Helmholtz-Gemeinschaft 1 2. Lsting Not applicable 3. ¨ ¨ Gottinger Erklarung 1 4. Stellungnahme der deutschen Akademien der Wissenschaften 1 5. IDW Pressemitteilung 1 Appendix 3. Citations 6. Allianz Schwerpunktinitiative URL not found 7. Helmholtz Newsletter 2007 1 8. Max Planck Institut Pressemitteilung 1 9. ¨ Sieber/Hoeren Urheberrecht fur Bildung und Wissenschaft 110. Referentenentwurf zweites Gesetz/Regelung des Urheberrechts 2004 111. Rechtspolittisches Positionspapier des Dtsch. Bibliotheksverbundes 112. UK initiative 113. Dtsch. Physikalische Gesellschaft e.V 114. VG Wort 115. Deutscher Hochschulverband Kurzinformation (2/08) 116. Uni Stuttgart/Rechtsfragen 117. ¨ Various internet resources, i.e. Link to Borsenverein des dtsch. Buchhandel or law-blog.de 118. DINI Dokumente 119. Dritte Stellungnahme zum Ersten Korb (DINI) 120. DINI-Netzwerk 121. Openaccess-germany.de 122. Max Planck Publikationen 123. ¨ ¨ Verschiedene universitare juristische Einrichtungen: Munster, Hannover, Saarbru ¨cken, Karlsruhe 124. Deutsches Forschungsnetz 1 URL not found25. ¨ ¨ Institut fur Urheber und Medienrecht, Munchen 126. UB Uni Heidelberg/Urheberrecht in der Informationsgesellschaft 127. Bibliotheksverband Website 1 URL not found28. Schulen ans Netz e.V. 1 (continued) libraries ROI in German Table AII. 173
BL 23,4 174 Table AII.IDWIS Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments29. Bundesministerium der Justiz URL not 1 complete30. iRights Urheberrecht in der digitalen Welt 131. Institute for Science Networking Oldenburg 132a. Information on publications by Kuhlen all listed in the bibliography Not applicable32b. Polterman, A. (2002) Gut zu Wissen 133. Kuhlen, R. (2008) Erfolgreiches Scheitern 134. ¨ Anhorung des Bundestag/Urheberrecht 135. Information Not applicable36. Information Not applicable37. Information Not applicable 1. Urheberrechtsbu ¨ ¨ ¨ndnis, Gottinger Erklarung 1 2. Benkler, Y. (2006), The wealth of networks. How social production transforms markets and freedom 1 3, ¨ Presseinformation des Borsenverein des deutsch. Buchhandels 2006 1 4. Stellungnahme des Bundesrates. Entwurf eines Zweiten Gesetzes 1 5. Castells, M. (1996) The rise of the network society. The information age: Economy, society and culture 1 6. ¨ DFG Empfehlungen des Ausschusses fur wiss. Bibliotheken “Aktuelle Anforderungen der wiss. Informationsversorgung” 1 7. DFG “Publikationsstrategien im Wandel”. Ergebnisse einer Umfrage 1 8. DFG-Positionspapier: “Elektronisches Publizieren”. Empfehlungen des Unterausschusses 1 9. ¨ Europaische Kommission: Mitteilung der Kommission an das EU Parlament 110. Council Conclusions on scientiﬁc information in the digital age Nov. 2007 111. Abschlußbericht des European Research Advisory Board 112. Fournier, J. (2007) OA in der dtsch. Forschungsgemeinschaft 113. ¨ Gounalakis, G. (2007) Ein neuer Morgen fur den Wissenschaftsparagrafen 1 (continued)
IDWIS Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments14. ¨ Die Grunen: Urheberrecht im digitalen Zeitalter 115. Hansen, G. (2005) Zugang zu wiss. Information – alternative ¨ urheberrechtliche Ansatze GRUR 116. Hansen, G. (2006) In die Zukunft publizieren (Stempfhuber) 117. Hilty, R.M. (2006) Das Urheberrecht und der Wissenschaftler GRUR 118. ¨ Hilty, R.M. (2007) Sundenbock Urheberrecht? 119. Hoeren, T. (2007) Urheberrecht in der Wissensgesellschaft In: Aus Politik und Wissenschaft 120. ¨ Hoeren, T and Kocher J.K. (2005) Der Wissenschaftler als Autor 121. Hoeren, T. and Kallberg, N. (2006) Der amerikanische TEACH Act 122. Hugenholtz, P.B. and Okediji, R.L. (2008) Conceiving an international instrument on limitations and exceptions to copyright 123. Jaszi, P. (2005) Public interest exceptions in copyright 124. ¨ ¨ Kuhlen, R. (2008) Gotterdammerung 125. Kuhlen, R. (2006) Open Innovation: Teil eins 126. Litman, J. (2001) Digital Copyright: Protecting intellectual property on the internet 127. Lutterbeck, B. and Gehring, R. (2003) Kritik aus der Sicht eines Hochschullehrers und eines Wissenschaftlers, den Gesetzentwurf der Bundesregierung zum UrhG und die Unterrichtbestimmung fur ¨ Unterricht und Forschung betreffend. 128. Nentwich, M. (2003) Cyberscience. Research in the age of the internet 129. ¨ Pﬂuger, T. (2007) Open Access, Chancen und Herausforderungen – ein Handbuch 130. Royal Academy (2003) Keeping Science Open 131. Spindler, G. (2006) Rechtliche Rahmenbedingungen von OA-Publikationen 132. ¨ ¨ ¨ Suttorp, A. (2005) Die offentliche Zuganglichmachung fur Unterricht und Forschung 1 0 12 16 36 Altogether 64 libraries ROI in German Table AII. 175
BL 23,4 176 Table AIII.LuKII Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments1. Open DOAR 1 Link available via OPAC2. Statistic @ StatCounter 13. ACM Portal/Conference Proceedings 2008 ACM/IEEE-CS joint conference 14. Seadle/Greifeneder “In Archiving we trust” 1 Emerald5. Open DOAR 1 Link available via OPAC6. Heritrix 17. Installing LOCKSS 1 2 0 2 3 Altogether 7
Europeana Connect Paid 4 Internet Internet-References Resource Loan sharing @ UB based Comments 1. Information Not applicable 2. Information Not applicable 3. Link zu Europeanalocal.se Projektbesrkivening0508 1 Description of project 4. Wikipedia 1 5. Information on Milestones Not applicable 1. Link in text/Creative Commons Lizensen 1 2. Link in text/OAI-ORE 1 3. Link in text/European Commission Joint Research Centre 1 4. Link in text/EuroWordNet Final Results 1 5. Link in text/XDXF Dictionary 1 6. Link in text/Online dictionary – Look way up 1 7. Link in text/Online translater 1 8. Link in text/Online translator 1 9. Link in text/Tiny URL for google maps location 110. Link in text/European Commission INSIRE Geoportal 111. Link in text/Web Widget for Visualizing Temporal Data 112. As above w/ different depiction 113. Link in text/DISMARC audio storage database 114. Link in text/DBPedia 115. Link in text/TextGrid Vernetzte Forschungsumgebung in den eHumanities 116. Link in text/Cyber Infrastructure OurCulturalCommonwealth 1 Not applicable/Link broken17. Link in text/Bibnet Luxembourg 118. Link in text/Nationalbibliothek Luxembourg 119. Link in text/Russian Library Heritage online 120. Link in text/Frank van Harmelen Website 121. Link in text/Large Knowledge Collider 122. Link in text/Antoine Isaac Website 123. ¨ Link in text/SUB Gottingen 124. Link in text/University of Oxford 1 0 0 1 25 Altogether 26 libraries ROI in German Table AIV. 177
BL 23,4 178 Table AV.Galateas Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 1. Information Not applicable 2. Information Not applicable 3. Information Not applicable 4. Information Not applicable 5. Fuegi, D. and Jennings, M. (2004), “International library statistics” 1 1. Proceedings of the 7th IWPT (Roux, Chanod, Salah) 2001 Listed at Uni Trier, accessible via 1 CiteSeer 2. ICSD Proceedings, Bernadi et al., Multilingual Access to Libr. Cataloguesl 1 3. The Annals of Applied Statistics, Blei and Lafferty KOBV/ZDB free access after 36 months via Euclid but no 1 subscription via UB 4. CLEF 2008, Bosca and Dini 1 5. ICSD Proceedings, Bosca and Dini (2009), The Role of Logs in Improving . . . 1 6. Proceedings of the Workshop on Statistical Machine Translation, Callison-Burch, Fordyce, Koehn, et al. 1 7. Church, K. and Hovy, C. (1993), “Good applications for . . .“, Mach. Tranls. 8 1 8. Cucerzan, S. and Yarowsky, D. (1999), Proceedings Joint SIGDAT Conference 1 9. Curtoni, P. and Dini, L. (2006), CLEF 2006 Working Notes 110. Information Processing and Management, Dunlavy, D.M. and O’Leary D.P. (2007) 111. Communications of the ACM, Etzioni, O. et al. (2008), Open Inf. Extraction from the Web 112. Guiliano, C. Proceedings of the 13th Conference on Computational Nat. Lang. Learning (2009) (CoNLL) 113. Proceedings of the National Academy of Science, Grifﬁths, T. and Steyvers, M. (2004) 1 Journal (continued)
Galateas Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments14. Grifﬁths, T., Technical Report 1 Via CiteSeer15. Heinrich, G., Technical Report 1 Via CiteuLike16. Hofmann, T., Proceedings of UAI (1999) Source has moved from UAI 1 website17. Library and Information Science Research (2006), Jansen, B.J. 1 National licence18. Steve, J. et al. (2000), Int. Journal on Dig. Libraries 119. Proceedings of ICASSP, Knight, K. and Marcu, D. (2005) 120. Koehn, P. and Monz, C. (2006), Proceedings of NAACL 1 ACM21. Koehn, P. and Monz, C. (2005), Proceedings of ACL Workshop 122. Koehn, P. and Hieu, H. (2007), Conference on Empirical Methods . . . (EMNLP) 1 Via KOBV23. Koehn, P. et al. (2007) Annual Meeting of the Association for Computational Linguistics (ACL) 124. Lopez, A. (2008), ACM Computing Surveys 125. Mikheev, A. et al. (1999), Proceedings of EACL 126. Oard, D.W. and Och, F.J. (2003), Proceedings MT Summit IX 1 Only 1989 via KOBV27. Popescu et al. (2007), Workshop on Semantic Evaluations 128. Qiang Pu and Guo-Wei Yang (2006), Advances in Neural Works 129. Lingvisticæ Investigationes (2007), Steiberger, R. and Poliquen, B., Band 30 1 Yes, but not No. 30/200730. Wei, X. and Croft, W.B., Proceedings of ACM SIGIR 1 12 6 1 12 Altogether 31 libraries ROI in German Table AV. 179
BL 23,4 180 Table AVI.DOARC Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 1. OAI-PMH 1 2. Science Citation Index 1 3. Web of Science 1 4. Information Not applicable 5. Hilse, H.-W. and Kothe, J. (2006), Implementing Persistent Identiﬁers 1 6. Larewnce, S. et al. (1999), IEEE Computer, 32 1 7. CiteSeer 1 8. Brody, T. (2003), Conference on Worldwide Coherent Workforce 1 9. Brody, T. et al., “Citation Impact of OA Articles vs Articles available . . . ” (ongoing) 1 10. Google Scholar 1 11. Edoc-Server/Dini-Schriften 1 12. McVeigh, M.E. (2004), “Open Access in the ISI . . . ” 1 13. Hardy, R. et al. (2005), “OA Citations Information/eprints” 1 JISC and University of Southampton 14. Kurtz, M.G. et al., “The effect of use and access on citations” 1 15. Tong, J. (2006), Citation Style Guide for Internet and Electronic Sources 1 16. Brandes, J. (2006), Guide to Citation: apa style 1 Link broken 17. van Hillard, E., Full Text Magazine Article from Database 1 18. Mayr, P. (2006), “Research Evaluation, Constructing experimental indicators . . . ” 1 ¨ 19. Gundler, J. (2005), “In die Zukunft publizieren – Herausforderungen an das Publizieren . . . ” 1 20. IFQ 1 21. ACM Portal 1 22. DBLP Computer Science Library 1 23. ArXiv 1 34. SPIRES HEP 1 25. Krichel, T., RePEc Reports in Economics 1 (continued)
DOARC Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 26. Edoc-Server Dissertations-Formatvorlage 1 27. Bibster 1 28. Haase, P. (2004), “Bibster – A Semantic . . . ,” in Proceedings of the Int. Semantic Web Conference 1 29. Haase, P. et al., in Proceedings of the Int. Semantic Web Conference 1 30. Bibster, Linux-Developer Fassung 1 31. Richard Cameron/CiteULike Not applicable 32. VIKEF 1 33. Kaplan, A., Sandor, A. and Rondeu, G. (2006), “Discourse and citation . . . ” 1 34. EERQI 1 35. Hyperjournal 1 36. DBIS-Datenbank Infosystem 1 37. Catalogue Bn-Opale plus 1 38. SPIN and MySCitation 1 39. EBSCO 1 40. Bibsonomy 1 41. Information Not applicable 42. The DOI System 1 43. OpenURL 1 44. Powell, A., Distributed Systems: OpenURL demonstrator 1 45. Hirsch, J.E., Proceedings of the National Academy of Sciences, 102 1 46. Marshakova, (1973), I.V. Nachno-Tekhnicheskaya Informatsiya Seriya 2 1 47. Small, H. (1994), Journal of American Society for Information Science, 24 1 48. Kessler, M.M. (1963), American Documentation 1 National licence 49. Small, H. (1994), Scientometrics 1 (continued) libraries ROI in German Table AVI. 181
BL 23,4 182 Table AVI.DOARC Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 50. Chen, C. and Carr, L. (1999), “Visualizing the Evolution of a Subject Domain: A Case Study“ 1 51. Katz, S. (2006), Science and Public Policy 1 Via ACM version from 2000 found, version from 2006 neither at ACM nor at author’s website 52. Soler, J. (2006), “A Rational Indicator of Scientiﬁc Creativity” 1 53. Berners-Lee, T. et al., Scientiﬁc American, “The Semantic Web” 1 54. Berners-Lee, T. et al. (2005), “Journal publishing and author self- archiving: Peaceful . . . ” 1 55. Bollen, J. et al. (2005), Information Processing and Management 1 56. Brody, T. et al. (2006), Journal of the American Association for Information Science and Technology 1 57. Garﬁeld, E. (1955), “Citation Indexes for Science: A New Dimension . . . ” 1 58. Garﬁeld, E. (1962-1973), “Citation Frequency as a Measure of Research Activity and Performance” 1 59. Harnad, S. (2001), “Reseach access, impact and assessment” 1 60. Harnad, S. et al. (2003), “Mandated online RAE CVs linked to . . . Ariadne” 1 61. Kleinberg, M.J., “Hubs, Authorities, and Communities”, ACM 1 62. Kurtz, M.J. (2004), “The Effect of Use and Access on Citations” 1 63. Landauer, T.K. (1998), “Introduction to Latent Semantic Analysis” 1 Not available for HU 64. Newman, M.E.J., Proceedings of the National Academy of Sciences 1 65. Page, L. et al., “The PageRank Citation Ranking: Bringing Order to the Web” 1 66. Smith, A.; Eysenck, M. (2002), “The correlation between RAE ratings and citation counts in Psychology” 1 67. Moed, H.F. (2005), “Citation Analysis in Research Evaluation” 1 (continued)
DOARC Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 68. “The effect of open access and downloads (‘hits’) on citation impact: a bibliography of studies” 1 ¨ 69. Publikationsarchiv des Instituts fur Physik, Oldenburg 1 70. Publikationen des Institute for Science Networking 1 71. Dienste-Entwicklungen des Institute for Science Networking 1 72. Zimmermann, K. et al. (2001), Dissertationen Online, “Workﬂow ¨ und Nachweis fur Dissertationen” 1 73. Dissertation Online 1 74. PhysNet Physics Network Worldwide 1 75. My Meta Maker 1 76/ Open Archives Distributed OAD 1 77. DC-Checker 1 78. LiLi – Linklisten der Physik: eLearning Materialien 1 79. Documenten Retrieval System DoRe des GSI Großforschungsinstituts, Darmstadt: 1 80. Engine ErzeugerInnen-NutzerInnen-GutachterInnen-Interaktion bei professionellem Nachweis verteilter multimedialer eLearning-Objekte 1 81. Hilf, E.R. and Mimkes, J. (2002), “Zu einem verlustfreien Publizieren und Archivieren – Mathematische Aussagen in Physik und Chemie” 1 82. Hilf, E.R. (2005), Kann man TeX beibringen, Physik zu verstehen 1 83. Hilf, E.R. et al. (2008), Mathematical Knowledge Management 1 84. Krichel, T., Academic Contributor Information System 1 85. Hilf, E.R. and Krichel, T. (2002), 42nd Street Paper: “Scholarly Communication is author-driven rather than reader-driven” 1 86. Euroscience Conference, Munich 2006 1 87. Shadbolt, N. et al. (2006), “Open Access: Key Strategic, Technical and Economic Aspects” 1 88. Harnad, S. et al. (2004) Serials Review, 30 1 (continued) libraries ROI in German Table AVI. 183
BL 23,4 184 Table AVI.DOARC Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 89. Havemann, F., Schriftenverzeichnis 1 ¨ 90. Havemann, F. (2002), “Bibliometrische Daten fur die Debatte um den Wandel der Universitat” ¨ 1 91. Havemann, F. (2003), “Bibliometric indicators and their use for research evaluation – an analysis of highly productive biomedial teams” 1 92. Havemann, F. (2001), “Collaboration behaviour of Berlin life science researchers in the last two decades . . . ”, Scientometrics 1 93. Havemann, F. (2001), “Bibliometrische Analyse von Kooperation ¨ und Produktivitat biomedizinischer . . . ” 1 94. Havemann, F., Heinz, M. and Kretschmer, H. (2006), Journal of Biomedical Discovery and Collaboration 1 95. Schmidt, M. et al. (2006), International Workshop on Webometrics, Informetrics and Scientometrics and Seventh COLLNET Meeting 1 96. Berendt, B. and Havemann, F. (2007), “Beschleunigung der Wissenschaftskommunikation durch Open Access . . . ” 1 97. Havemann, F. (2004), “Eprints in der wissenschaftlichen Kommunikation” 1 98. Havemann, F. (2004), “Growth dynamics of German university enrolments and of scientiﬁc disciplines in the 19th century” 1 99. Havemann, F. et al. (2005), Journal of the American Society for Information Science and Technology 1100. Liang, L. et al. (2006), “Structural similarities between science growth dynamics in China . . . ” 1101. Christen, W. (2001), Cluster Science Net CSN. 1102. DOARC 1103. Information Not applicable104. PhysNet 1105. Information Not applicable (continued)
DOARC Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments106. The ACIS Academic Contributor Information System Consortium 1107. Information Not applicable ¨108. Publikationsliste des Instituts fur Physik, Oldenburg 1109. Physik, Oldenburg 1110. Information Not applicable111. Information Not applicable 22 4 13 64 Altogether 103 libraries ROI in German Table AVI. 185
BL 23,4 186 Table AVII.EERQI Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 1. Lee, K.P. et al. (2002), JAMA 1 2. Butler, L (2006), “Bibliometrics and Research Performance Framework Indicators Forum/University of New South Wales” 1 Link broken 3. CERIF 1 Link broken 4. Boor, R.M. (1982), American Psychologist 1 5. Moed, H.F. (2005), Citation Analysis in Research Evaluation, Springer 1 6. Hicks, D. (2004), Handbook of Quantitative Science and Technology Research 1 7. Philippe, J. and Devillard, J. (2005), “Implementing relevant disciplinary evaluations in the social sciences” 1 8. European Commission: Study on the economic and technical evolution of the scientiﬁc publication markets in Europe 1 9. Information Not applicable10. Moed, H.F. (2005), Citation Analysis in Research Evaluation, Springer 111. Moed, H.F. (2005), Journal of the American Society for Information Science and Technology 112. Brody, T (2004), “Citation Analysis in the Open Access World” 113. Park, H.W. and Thelwell, M. (2003), “Hyperlink Analyses of the World Wide Web: A Review” 114. Brody, T. et al. (2006), Journal of the American Association for Information Science and Technology (JASIST), 57(8) 115. Carr, L. et al. (2006), “Extending journal-based research impact assessment to book-based disciplines” 116. vanLeeuwen, Th.N. et al. (2001), “Language biases in the coverage of the Science Citation Index and its consequences for international . . . ” Scientometrics 117. Perrson, O. et al. (2004), “Inﬂationary bibliometric values, the role of scientiﬁc collaboration . . . ”, Scientometrics 1 (continued)
EERQI Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments18. Perrson, O. et al. (2004), “Handbook of quantitative science and technology research” 119. Schneider, J. (2006), “Concept Symbols Revisited . . . ”, Scientometrics 120. CNRS/Franz. Website 121. Information 122. Link in text/EERA website 123. Link in text/Physnet 124. Link in text/Marine Research Inst. 125. Link in text/Projekt Uni Karlsruhe 126. Link in text/CNRS 127. Link in text/Physik Multimedia Projekt Oldenburg 128. Link in text/Metager 129. Link in text/Hit Counter und Life Statistiken 130. Link in text/ResearchPortal.net 1 Link broken31. Link in text/Leibniz Uni Hannover 132. Link in text/Botte, A. (2004), “Achievement or performance: observation of productivity . . . ” 133. Link in text/Elsevier (Learning and Instruction, Journal ) 1 Source by Elsevier but not part of the HU deal34. Link in text/Elsevier (Educational Research, Journal ) 1 Source by Elsevier but not part of the HU deal ¨35. Astrom, F. and Pettersson, L. (2006), Libraries and Culture, 41/2 1 ¨36. Perrson, O. and Astrom, L. (2005), Bibliometric Notes, 7/2 1 ¨37. Astrom, F. (2002), “Emerging Frameworks and Methods”, CoLIS4 138. Visser, M.S. and Moed, H.F. (2004), “Measuring the impact of non-ISI source items” 1 (continued) libraries ROI in German Table AVII. 187
BL 23,4 188 Table AVII.EERQI Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments39. Visser, M.S. and Moed, H.F. (2005), “Developing bibliometric indicators or research performance in computer science” 140. Smeyers, P. and Depaepe, M. (2003), “Beyond Empiricism: On Criteria for Educational Research” 141. Schneider, J. et al. (2007) Proceedings of ISSI 2007 142. Schneider, J. and Borlund, P. (2007) Matrix comparison/JASIST 143. Schneider, J. et al. (2006) “Bibliometri: En biblioteks-og informationsvidenskabelig kompetence” 144. Schneider, J. (2006), “Concept symbols revisited”, Scientometrics 1 13 3 4 23 Altogether 43
¨Forschungsdiversitat Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 1. Information Not applicable 2. Information Not applicable 3. Pointer to a reference Not applicable 4. Pointer to references Not applicable 1. Adams, J. and Smith, D. (2003), Funding Research Diversity 1 2. Alter, O. et al. (2000), Proceedings of the National Academy of Sciences 1 3. Bordons, M. et al. (2004), Handbook of Quantitative Science and Technology Research 1 4. Callon, M. (1995), “Four Models for the Dynamics of Science” 1 5. Callon, M. et al. (1983), Social Science Information, 22 1 6. Deerwester, S. et al. “Indexing by latent semantic analysis”, JASIST 1 7. Egghe, L. and Rousseau, R. (1990), “Introduction to Informetrics”, Quantitative Methods in Library and Information Science 1 8. Evans, J. (2008), “Electronic Publication and the Narrowing of Science and Scholarship” 1 9. ¨ Glaser, J. (2006), “Wissenschaftliche Produktionsgemeinschaften: Die soziale Ordnung der Forschung” 110. ¨ Glaser, J. et al. (2008), “Evaluationsbasierte Forschungsﬁnanzierung und ihre Folgen/Wissen fur ¨ Entscheidungsprozesse” 111. ¨ Glaser, J. and Laudel, G. (2007), “Evaluation without Evaluators: The impact of funding formulae on Australian University Research” 112. ¨ Glaser, J. et al. (2002), “Impact Evaluation-based Funding on the . . . ” 113. Grupp, H. (1990), “The concept of entropy in scientometrics and innovation research” 1 (continued) libraries ROI in German Table AVIII. 189
BL 23,4 190 Table AVIII. ¨Forschungsdiversitat Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments14. Harley, S. and Lee, F.S. (1997), “Research selectivity, managerialism, and the academic labor process” 115. Havemann, F. et al. (2007), “Measuring Diversity of Research in Bibliographic-Coupling Networks” 116. Heinz, M. et al. (2009), “Selbstorganisation in Wissenschaft und Technik. Jahrbuch Wissenschaftsforschung 2008” 1 ¨17. HRK (2007), Die Zukunft der kleinen Facher: Potenziale – Herausforderungen – Perspektiven. Bonn 118. Janssens, F. et al. (2007), “A Hybrid Mapping of Information Science” 119. Janssens, F. et al. (2006), Scientometrics 120. Joint statement (2003), The Higher Education White Paper and research funding selectivity. 18th June 2003 121. Kessler, M.M. (1963), “Bibliographic coupling between scientiﬁc papers”, American Documentation 122. Knorr-Cetina, R. (1982), “Scientiﬁc Communities or Transepistemic Arenas of Research? . . . ”, Social Studies of Science, 12 123. Knorr-Cetina, R. (1999), “Epistemic Cultures: How the Sciences Make Knowledge” 124. Landauer, T. et al. (2007), Handbook of Latent Semantic Analysis 125. Latour, B. (1988), “A Relativistic Account of Einstein’s Relativity/Social Studies of Science”, 18 126. Magurran, A. (2004), Measuring Biological Diversity 127. Mann, G.S. et al. (2006), JCDL ’06: Proceedings of the 6th ACM/ IEEE-CS joint conference on Digital Libraries 128. Marshakova, I.V. (1973), “Sistema svyazey mezhdu dokumentami, postroyennaya na osnove ssylok (po ukazatelyu ‘Science Citation Index’)” 1 (continued)
¨Forschungsdiversitat Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments29. Mitesser, O. (2008), “Latente semantische Analyse zur Messung ¨ der Diversitat von Forschungsgebieten – Methodendiskussion und Anwendungsbeispiel” 130. Mitesser, O. et al. (2008), “Measuring Diversity of Research by Extracting Latent . . . ”, Proceedings of WIS 2008 131. Molas-Gallart, J. and Salter, A. (2002), “Diversity and Excellence: Considerations on Research Policy”, IPTS Report 132. Noyons, E.C. and Van Ran, A.F.J. (1998), “Monitoring scientiﬁc developments from a . . . ”, Journal of the American Society for Information Science 133. Perrson, O. et al. (2004) “Inﬂationary bibliometric values: the role . . . ”, Scientometrics 134. Porter, A. and Chubin, D. (1985), “An indicator of cross- disciplinary research”, Scientometrics 135. Rafols, I. and Meyer, M. (2007), ”Diversity measures and network . . . ”, Proceedings of ISSI 2007 136. Ricotta, C. (2004), “A Recipe for Unconventional Evenness Measures”, Acta Biotheoretica, 52 137. Ricotta, C. and Szeidl, L. (2006), “Towards a unifying approach to diversity measures . . . ”, Theoretical Population Biology, 70 138. Rousseau, R. and Hecke, P.V. (1999), “Measuring biodiversity”, Acta Biotheoritica 139. Rousseau, R. et al. (1999), “The relationship between diversity proﬁles”, . . . Environmental and Ecological Statistics 140. Sanz-Menendez, L. et al. (2001), “Interdisciplinarity as a multidimensional . . . ”, Research Evaluation, 10 141. Schmidt, M. (2006), Entropie eines Forschungsgebietes. Theoretische Erarbeitung und Durchfu ¨hrung einer Kozitations- Clusteranalyse im Projekt “Testing the Homogenisation Thesis – Measuring the Diversity of Research” 1 (continued) libraries ROI in German Table AVIII. 191
BL 23,4 192 Table AVIII. ¨Forschungsdiversitat Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments42. Schmidt, M. et al. (2006), “A methodological Study for Measuring the . . . ”, International Workshop on Webometrics, Informetrics . . . 143. Simpson, E. (1949), “Measurement of diversity”, Nature, 163 144. Small, H. (1973), “Co-Citations in the Scientiﬁc . . . ”, Journal of the American Society for Inform. Science 145. Star, S. (1989), “The structure of ill-structured solutions . . . ”, Distributed Artiﬁcial Intelligence 146. Stirling, A. (2007), “A general framework for . . . ”, Journal of the Royal Society Interface47. van Leeuwen, T and Tijssen, T. (2000), “Interdisciplinary dynamics of modern . . . ”, Research Evaluation 148. Whitley, R. (2007), “Evaluation without Evaluators . . . ”, The Changing Governance of the Sciences 149. Wolgar, S. (1979), “The Identiﬁcation and Deﬁnition of Scientiﬁc Not found anywhere/not Collectives”, Perspectives on . . . applicable50. Zitt, M. and Bassecoulard, E. (2006), “Delineating complex scientiﬁc ﬁelds . . . ”, Information Processing and Management 1 17 10 14 7 Altogether 48
Carpet Paid 4 InternetReferences Resource Loan sharing @ UB Internet-based Comments 1. Budapest OA Initiative 1 2. Berliner Declaration 1 3. Public Knowledge Project 1 4. Hyper Journal 1 5. Dpubs/Digital Publishing System 1 6. Driver 1 7. Igitur/Publishing and Archiving Service University Library Utrecht 1 8. AePIC/Advanced e-publishing Infrastructures 1 9. Digital Peer Publishing NRW 110. Revues. Org /French electr. publishing site 111. NDLTD/e-publishing website 112. Living Reviews (21, 22 and 24) 113. Read Write Web/ 114. DINI 115. edoc-Server 116. SCOPE/edoc-Server 117. Digitale Dissertationen Online 118. Langzeitarchivierung DE/Nestor 119. TEX Document Centre 120. ¨ Mediaconomy/Forschungsverbund Internetokonomie der ¨ ¨ Georg-August-Universitat Gottingen 123. Hermes/semantic XML etc. self-publishing tool 125. Max Planck edoc 126. www. escidoc.de 127. Information Not applicable28. Software Reviews and Ratings 129. Various Links such as: ohloh, iterating and jot.com (now google) 130. Warner, S. (2004), Overlay Journals 1 @ E-LIS 0 0 5 20 Altogether 25 libraries ROI in German Table AIX. 193
BL 23,4 194 Table AX.Meta-Image Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 1. Warburg, A. (2003), “Gesammelte Schriften/Der Bilderatlas MNEMOSYNE” 1 @ UB only 1. ed. ¨ ¨ 2. Warburg, A. (1992), “Ausgewahlte Schriften und Wurdigungen” 1 3. Flickr 1 4. digilib (information) 1 5. HyperImage (information) (&9.) 1 6. Warnke, M. (1998), “Eine digitale Ordnung der Dinge/Ein Hypermediales Bild-Text-Archiv zu . . . ” 1 7. Warnke, M. (2003) Daten und Metadaten – Onlineressourcen f.d. Bildwissenschaft/Zeitenblicke 1 8. Warnke, M. (2007), HyperImage – Image Oriented e-Science Networks 1 Internet Resource ¨10 Information on HyperImage at Uni Luneburg Not applicable11. Information Not applicable12. Prometheus-Bildarchiv 113. Bildarchiv Photo Marburg Mikroﬁche bis 1998/later 1 Link14. Census/Antique works and architecture pic of the Renaissance (database or website) 1 ¨15. Luhmann, N. (1992), “Kommunikation Mit Zettelkasten: Ein Erfahrungsbericht” 116. s.o. 117. Iconclass 1 0 2 7 5 Altogether 14
MUNIN-RS Paid 4 InternetReferences Resource Loan sharing @ UB Internet-based Comments 1. Information Not applicable 2. HU OA-Erklarung ¨ 1 3. Haffner, D. (2006), Digitale Bibliotheken und Bildarchive/ Rundbrief Fotograﬁe, 13 1 4. ¨ ¨ Winkelmann Institut fur klassische Archaologie 1 5. Wessel, A and Hoch, A. (2007), “Cave planthoppers on Hawaii . . . ”, Evolution in Action/Als das Leben laufen lernte 1 6. Burrows, M. et al. (2007), “Jumping behaviour in a gondwanan relict insect”, The Journal of Experimental Biology 1 7. UMAC Worldwide Database of University Museums and Collections/Academic Heritage and Universities/more projects . . . 1 8. dl-forum.de/deutsch/projekte 1 Link broken 9. CISC Study on cybermetrics (Spanish) 1 Link broken10. Schirmbacher, P. (2007), “Open Access – Informations-und Repository-Netzwerk in Deutschland/Beitrag zur Arbeitsgruppe Elektronisches Publizieren” 111. Medienportal der HU 112. ¨ Vollmer, A. (2005), “Mneme: Das digitale Gedachtnis” 113. Link in Text/Standardized Hyper Adaptable Metadata Editor 1 Not applicable 0 1 4 7 Altogether 12 libraries ROI in German Table AXI. 195
BL 23,4 196 Table AXII.OAN Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 1. DINI Website/Repositories 1 2. OAIster database 1 3. Scopus 1 4. portal.isi.knowledge 1 5. Google Scholar 1 6. Directory of OA Journals/DOAJ 1 7. Directory of OA Repositories/DOAR 1 8. Registry of OA Repositories/ROAR 1 9. Registry of Open Access Repository Material Archiving Policies/ROARMAP 110. Information Not applicable11. Networked Dig. Libr. of Thesis and Dissertation 112. DINI Website/Policies 113. edoc-Server HU/DINI Paper 114. Berlin Declaration 115. DFG Website 116. DINI Workshop 2005 117. DINI Workshop 2005/Programme 118. Scholz, F. and Dobratz, S. (2006), “Institutional Repositories and Enhanced and Alternative Metrics of Publication Impact (. . .)Directory of OA Journals 119. Sherpa/Romeo 110. Website Project for OA-Policies 121. www. alastor.di.oua.gr/DRIVER 1 Link broken22. www. Gap-portal.de No access to this 1 wiki23. OA version of gap works 124. Website OA Germany 125. Information Not applicable26. Information Not applicable (continued)
OAN Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments27. Publishing plattform for geoscience 128. Link to University of Cologne 129. Link to Gesis/information for social science 130. Link to a website on history 131. Link to website on programming/www. typo3.net 132. Information Not applicable33. Information guiding to DINI Website 134. Information guiding to edoc-Server 135. As above but different location 136. As above but different location 137. Information Not applicable38. Information Not applicable39. Link to website on standards 140. Math and Industry a Portal 141. ¨ Link to University of Gottingen 142. Dspace 143. Information Not applicable44. Link to DNB/Information on DDC (Dewey Decimal Classiﬁcation) 145. As above but in English 146. Information Not applicable47. ProPrint/Print on Demand Service 148. Information Not applicable 0 0 8 31 Altogether 39 libraries ROI in German Table AXII. 197
BL 23,4 198 Table AXIII.OAN2 Paid 4 Internet Loan @ Internet-References Resource sharing UB based Comments 1. oanet.cms.hu-berlin.de (& 5.) 1 Link broken 2. Liste deutscher Dokumentenserver/DINI 1 3. Information Not applicable 4. Open DOAR 1 6. Information Not applicable 7. Repositories Support Project (JISC Repository Net) 1 8. Dewy Dezimal Klassiﬁkation Website 1 9. APS Journals/Physics and Astronomy Classiﬁcation Schemew (PACS) 110. Mathematics Subject Classiﬁcation (Old ones available in print via 1 loan sharing)11. Henzinger, M. (2006), “Finding Near Duplicate Web Pages: A Large Scale Evaluation of Algorithms” 112. Stamou, S. et al. (2006), “Classifying Web Data in Directory Structures”, Computer Science 113. ArXiv.org 114. Cheng, P.C. et al. (2008), “Domain-Speciﬁc Ontology Mapping by Corpus-Based Semantic Similarity”, Proceedings of NSF CMMI Engineering Research and Innovation Conference 115. CCS (The ACM Computing Classiﬁcation System) 116. ZDM (International Reviews on Mathematical Education) 117. ICD (International Statistische Klassiﬁkation der Krankheiten und verwandter Gesundheitsprobleme) 118. OPS (Operationen- und Prozedurenschlu ¨ssel Internationale Klassiﬁkationen der Prozeduren in d. Medizin einschließlich . . .) 119. Object Reuse and Exchange 120. Europeana 1 0 0 4 13 Altogether 17
Docupedia Paid 4 InternetReferences Resource Loan sharing @ UB Internet-based Comments 1. Publikationsstrategien im Wandel (2005), DFG 1 2. See above 1 3. ¨ Lorenz, M. (2006), “Wikipedia. Zum Verhaltnis von #Struktur und Wirkungsmacht eines heimlichen Leitmediums”, WerkstattGeschichte, 43 1 4. Link/Wikimatrix 1 5. O’Reilly, T. (2005), “What is Web 2.0?” 1 6. Graham, P., Web 2.0 1 7. Heller, L. (2006), “Wissenschaftliches Publizieren mit Wikis . . .“, Open Source Jahrbuch 1 8. Information Not applicable 9. Meyer, B. (2006), “Defense and Illustration of Wikipedia” 110. Rosenzweig, R. (2006), “Can History be Open Source? Wikipedia and the Future of the Past”, The Journal of American . . . 111. Link to Wikipedia “Theorieﬁndung” 112. Information Not applicable13. Information Not applicable14. Link to wikipedia “wikiversity” 115. Link to Scholarpedia 116. Link to Heise.de “Citizendium soll bessere Wikipedia werden” (2006) 117. Link to a project by BMBF/WIKINGER 118. Clio Online Survey 119. Information Not applicable20. Samida, S. (2006), “Wissenschaftskommunikation im Internet. ¨ Neue Medien in der Archaologie” 121. Link to Jakob Nielsons Alertbox (2006) 122. Link to DINI 123. Link to arxiv.org 124. ¨ Open Access politics at the Georg-August University Gottingen 1 (continued) libraries ROI in German Table AXIV. 199
BL 23,4 200 Table AXIV.Docupedia Paid 4 InternetReferences Resource Loan sharing @ UB Internet-based Comments25. Link to edoc/DiML 126. Link to edoc/uploading an article with metadata 127. Link to arxiv.org/How to replace an article 128. Link to Clio Online/General Terms and Conditions Act 129. Link to Wikipedia/GNU Free Documentation Licence 130 Link to creative commons 131. Link to Digital Peer Publishing, NRW 132. Link to Clio Online/Guides 133. Link to Wikibooks 134. Link to edoc/Historisches Forum 135. Link to Case Wiki 136. Link to WikiMedia/Shibboleth Authentiﬁcation 1 Link broken37. Link to Wikipedia/Page by Page Access 1 Link broken38. Link to Wikimedia/Index of trunk 139. Link to ODF Add-In 140. Link to Microsoft Dowload Centre 141. Link to O’Reilly xml.com 142. Link to html2wikipedia 143. Link to CPAN 144. Link to Wikimedia/Word macros 1 Link broken45. Link to ART-Dok 146. Link to DINI/DINI Zertiﬁkat 147. ¨ Schmidt, B. (2006) Geschaftsmodelle des Open Access- Publizierens: Welche Perspektiven . . . 148. Neumann, J. (2006), “Auf dem Weg zu einem Open-Access- ¨ Geschaftsmodell”, Open Source Jahrbuch 149. Link to Clio Online/Bekanntheit und Ausbau von HsozuKult 150. Information Not applicable 1 3 3 38 Altogether 45
ROI in German librariesInternet-based 284@ UB 82Loan sharing 40 201Paid for Internet source 67190 citations count for UB 190 Table AXV.Total count 474 SummaryAbout the authorKathrin Grzeschik has recently graduated with a Master of Arts from the Berlin School forLibrary and Information Science and is now a member of research staff coordinating a project onlong-term preservation. Kathrin Grzeschik can be contacted at: firstname.lastname@example.orgTo purchase reprints of this article please e-mail: email@example.comOr visit our web site for further details: www.emeraldinsight.com/reprints