Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Libsys 7 to KohaData Migration , Customization & Implementationof Open Source ILMSCHAITANYA PRATAPSINGHMASTER OF COMPUTERA...
ABOUT THE ORGANIZATION National Institute of Science Communication andInformation Resources (NISCAIR),  located  at New D...
PROJECT STRUCTURECSIR has proposed to develop a CSIR wide knowledge gateway that will have the following modulesCSIR-Cloud...
OBJECTIVE OF CSIR-CAT To Implement Open Source Integrated Library System software Koha  at the place of proprietary softw...
NEED OF KOHA The open source software solutions are very cost effective as compared to proprietary software solutions thi...
CSIR-CATThings to be done in CSIR-CAT Koha Customization & Implementation Migration of data from Libsys 7.0 to Koha OPA...
WHY CSIR-CAT?1. Reduction of cost of ownership of ILMS 2. Networking of CSIR KRCs3. Implementation of uniform & internatio...
SYSTEM ARCHITECTURECSIR-CATData Migration Federated Search
SYSTEM OVERVIEW
DATA MIGRATIONPROCESS
ISSUES WITH LIBSYS  1. There is no support from LibSys as it paid service2. All modules are not purchased3. Export / impor...
HOW DATA HAS BEEN MIGRATEDFROM LIBSYS7 TO KOHA?1. Generated  multiple  text  report  files  with  different  filelds. Acce...
CONT…5. Processed records through program to make proper rows (data got printed in multiple rows so it was concatenated)6....
DATA COLLECTION MODEL1. Bibliographic Record2. Authority Record3. Patron Record4. Serial Record5. Acquisition Record6. Cir...
PROBLEM AND SOLUTION WHILEFETCHING THE DATA OF LIBSYS 7.0 As the existing software does not provide import/exportfeature,...
DATA CLEANING Generated multiple reports with differentcolumns, Trimmed the extra space between the words, Deleted all ...
FORMATTING OF THE TEXT FILE Figure 1. Original text file (accession number, title and authorfield).
Figure 2: Original text file (accession number, edition, publisherlocation,publisher name and year of publishing).
PROBLEM IN TEXT FILEN-Number of blank lines are present, data shown is having slash todistinguish author and title but in ...
CONT…
TEXT IN HINDI
IMPORTING TEXT INTO EXCEL
SOLUTION :In order to solve this we wrote macro’s for1. Deleting blank lines2. Deleting page numbers3. Bringing the record...
MACRO FOR DELETING BLANKROWS Sub DeleteBlankRows()  This macro deletes all rows on the active worksheet  that have no v...
MERGING INTO EXCELFigure 3: Multiple spreadsheets merged to form a single spreadsheet(control number, accession number/bar...
CONVERTING FROM EXCEL FORMATINTO .MRK FORMAT
You will be prompted for mapping the fields torecognize the fields by standard marc format.Suppose for Field 0 that is fir...
MAPPING OF FIELDS TO MARC TAGS
ADDITION OF DELETION OF ANYFIELD
.MRK FILE
MRK STRUCTURE FOR SINGLERECORD=LDR 00421nam a2200193Ia 45e0=001 1=003 CSIR-NISTADS=008130228s9999xx0000undd=040 $aCSIR-NIS...
CONVERT .MRK FILE TO .MRC Convert .mrk file into raw Marc format that canbe directly imported into Koha. For this again ...
CONVERTING .MRK FILE TO .MRC
.MRC FILE
ABOUT KOHA Koha is an integrated library system (ILS)  It was the first open source ILS.  Koha was created in 1999 by K...
KOHA SCRIPT We have made a script to install koha on CentOS, which makes it easy to install and saves time and effort.
LOGIN PAGE
CUSTOMIZED KOHA MAIN PAGE
IMPORTING RECORDS IN KOHA
CATALOGING
ADVANCE SEARCH PAGE
Z39.50 SEARCH
OPAC CUSTOMIZATION
ADMINISTRAION
OPAC CONFIGURATION Decide how you want your OPAC to look andwhat content you want on the main page. Create a library bra...
OPAC SEARCH PAGE
OPAC SEARCH
PROBLEM WITH Z39.501. Implementation not easy2. Does not scale well (if nodes > 100)3. Network bandwidth4. Z39.50 implemen...
ARCHITECTUREDESIGN
LEVEL 0 DFD OF KOHA
LEVEL 1 DFD
Flowchart of Koha
CONCLUSION & FUTUREWORK Data from proprietary software migrated to Koha. Barcode Scanner will be attached. Now Union ca...
THANK YOU
Upcoming SlideShare
Loading in …5
×

Libsys 7 to koha

7,463 views

Published on

Published in: Technology, Education

Libsys 7 to koha

  1. 1. Libsys 7 to KohaData Migration , Customization & Implementationof Open Source ILMSCHAITANYA PRATAPSINGHMASTER OF COMPUTERAPPLICATIONS,SOUTH ASIAN UNIVERSITY, NEWDELHI
  2. 2. ABOUT THE ORGANIZATION National Institute of Science Communication andInformation Resources (NISCAIR),  located  at New Delhi, India,  is  one  of  the  premier  information  science institutes  in  India  under the umbrella  of  CSIR  (Council of Scientific  and  Industrial  Research)  that  comprise  38  other labs/institutes  of  different  disciplines  spread  across  the country. NISCAIR came into existence on 30 September 2002 with the  merger  of  National Institute of ScienceCommunication (NISCOM)  and  Indian NationalScientific Documentation  Centre  (INSDOC).  Both NISCOM  and  INSDOC,  the  two  premier  institutes  of  the Council of Scientific and Industrial Research (CSIR), were devoted  to  dissemination  and  documentation  of  S&T information, respectively.
  3. 3. PROJECT STRUCTURECSIR has proposed to develop a CSIR wide knowledge gateway that will have the following modulesCSIR-Cloud Capacity and Capability Building: CSIR Open Source Cloud ComputingInfrastructure and Open Source Software Technology Solution CellCSIR-Cat CSIR Distributed Library/Virtualized Union OPAC of CSIR Holdings,using Z39.50 protocol & Open Source Integrated Library ManagementSoftwareCSIR-Trend Multi-dimensional Analysis System (MDAS) - Extended informationaccess for enabling excellence 
  4. 4. OBJECTIVE OF CSIR-CAT To Implement Open Source Integrated Library System software Koha  at the place of proprietary software which are already in use.  To do federated search in Koha for distributed libraries i.e. 39 National Libraries of India.
  5. 5. NEED OF KOHA The open source software solutions are very cost effective as compared to proprietary software solutions this initiative will also boost-up the movement of open source in India and thus the millions of Rupees can be saved on software. Libsys-  Rs. 4,50,000 They charge Rs. 10,000 on each arrival. You have to purchase different modules otherwise it will not work.
  6. 6. CSIR-CATThings to be done in CSIR-CAT Koha Customization & Implementation Migration of data from Libsys 7.0 to Koha OPAC Customization
  7. 7. WHY CSIR-CAT?1. Reduction of cost of ownership of ILMS 2. Networking of CSIR KRCs3. Implementation of uniform & international standard across all CSIR KRCs like MARC 21, Z39.50 so that data can be migrated to any other format4. Avoid vendor locking for ILMS by using open source software5. Increase in efficiency for Information Scientists due to reduced classification efforts of knowledge managers/ information scientists by importing/sharing catalogues from each other or from other online sources like library of congress6. Optimum utilization/sharing of  information resources through ILL available  in KRCs7. Avoid duplication of resources  like books, monographs, reports, thesis, standards, patents, etc among CSIR  KRC
  8. 8. SYSTEM ARCHITECTURECSIR-CATData Migration Federated Search
  9. 9. SYSTEM OVERVIEW
  10. 10. DATA MIGRATIONPROCESS
  11. 11. ISSUES WITH LIBSYS  1. There is no support from LibSys as it paid service2. All modules are not purchased3. Export / import module is not working4. Libsys 7.0 stores data  in RDBMS but NPL library do not have access to database management system which is placed in IT Division5. Only information available is terms of reports which are available in text files6. In text files, regional language data is not directly readable7. No information is available in public how it has been stored8. OPAC module is not operational
  12. 12. HOW DATA HAS BEEN MIGRATEDFROM LIBSYS7 TO KOHA?1. Generated  multiple  text  report  files  with  different  filelds. Accession  number  is  printed  in  all  the  files  to  join  them latter on. It took three days because connection was too slow2. Converted these text files to excel3. Removed headers, footers and blank rows through macro4. Converted these files in RDBMS tables
  13. 13. CONT…5. Processed records through program to make proper rows (data got printed in multiple rows so it was concatenated)6. joined all the processed tables7. converted back to excel8. koha need .mrc files therefore “MarcEdit tool” was used which took excel file generated at step 7  as input 
  14. 14. DATA COLLECTION MODEL1. Bibliographic Record2. Authority Record3. Patron Record4. Serial Record5. Acquisition Record6. Circulation Record
  15. 15. PROBLEM AND SOLUTION WHILEFETCHING THE DATA OF LIBSYS 7.0 As the existing software does not provide import/exportfeature, but it does provide report generation to a file.During this process we took the output as a text file coveringall the fields in the catalogue such as, Title; authors; edition; place of publication; publisher name; year; pagination; ISBN; class number; book number; accession number;
  16. 16. DATA CLEANING Generated multiple reports with differentcolumns, Trimmed the extra space between the words, Deleted all blank lines Wrote a program to bring multi-line text to singleline, If title was distributed in 3 lines then weconverted that multi-line to single line
  17. 17. FORMATTING OF THE TEXT FILE Figure 1. Original text file (accession number, title and authorfield).
  18. 18. Figure 2: Original text file (accession number, edition, publisherlocation,publisher name and year of publishing).
  19. 19. PROBLEM IN TEXT FILEN-Number of blank lines are present, data shown is having slash todistinguish author and title but in some records we don’t have slash also
  20. 20. CONT…
  21. 21. TEXT IN HINDI
  22. 22. IMPORTING TEXT INTO EXCEL
  23. 23. SOLUTION :In order to solve this we wrote macro’s for1. Deleting blank lines2. Deleting page numbers3. Bringing the record in a Single Line withcorrect Access number
  24. 24. MACRO FOR DELETING BLANKROWS Sub DeleteBlankRows() This macro deletes all rows on the active worksheet that have no value in column D. Dim iRow As Long Dim LastRow As Long LastRow = ActiveSheet.UsedRange.Rows.Count +ActiveSheet.UsedRange.Row - 1 For iRow = LastRow To 1 Step -1 If Cells(iRow, 1) = "" And Cells(iRow, 2) = "" And Cells(iRow, 3) = "" AndCells(iRow, 4) = "" And Cells(iRow, 5) = "" Then Rows(iRow).Delete If Cells(iRow, 1) <> "" And Cells(iRow, 2) = "" And Cells(iRow, 3) = "" AndCells(iRow, 4) = "" And Cells(iRow, 5) = "" Then Rows(iRow).Delete Next iRow End Sub
  25. 25. MERGING INTO EXCELFigure 3: Multiple spreadsheets merged to form a single spreadsheet(control number, accession number/barcode, title, author, isbn,publishing location, class number, publisher name andpagination).
  26. 26. CONVERTING FROM EXCEL FORMATINTO .MRK FORMAT
  27. 27. You will be prompted for mapping the fields torecognize the fields by standard marc format.Suppose for Field 0 that is first column Ientered Map to: 008 (control number) and thenclick on Apply.
  28. 28. MAPPING OF FIELDS TO MARC TAGS
  29. 29. ADDITION OF DELETION OF ANYFIELD
  30. 30. .MRK FILE
  31. 31. MRK STRUCTURE FOR SINGLERECORD=LDR 00421nam a2200193Ia 45e0=001 1=003 CSIR-NISTADS=008130228s9999xx0000undd=040 $aCSIR-NISTADS$cCSIR-NISTADS=100 $aBrown, Michael Barratt=245 $aEconomics of Imperialism=260 $aLondon=260 $bPenguin=300 $a380=500 $a1=850 $aCSIR-NISTADS=902 $a335.412, BRO=942 $cBK=952 $p1
  32. 32. CONVERT .MRK FILE TO .MRC Convert .mrk file into raw Marc format that canbe directly imported into Koha. For this again open MarcEdit and Select MARCTools. Next Select MarcMaker to convert .mrk fileinto .mrc format. Locate your input file and name your output file.Then Click Execute.
  33. 33. CONVERTING .MRK FILE TO .MRC
  34. 34. .MRC FILE
  35. 35. ABOUT KOHA Koha is an integrated library system (ILS)  It was the first open source ILS.  Koha was created in 1999 by Katipo Communications for the Horowhenua Library Trust in New Zealand.  The first installation went live in January of 2000.
  36. 36. KOHA SCRIPT We have made a script to install koha on CentOS, which makes it easy to install and saves time and effort.
  37. 37. LOGIN PAGE
  38. 38. CUSTOMIZED KOHA MAIN PAGE
  39. 39. IMPORTING RECORDS IN KOHA
  40. 40. CATALOGING
  41. 41. ADVANCE SEARCH PAGE
  42. 42. Z39.50 SEARCH
  43. 43. OPAC CUSTOMIZATION
  44. 44. ADMINISTRAION
  45. 45. OPAC CONFIGURATION Decide how you want your OPAC to look andwhat content you want on the main page. Create a library branded stylesheet using CSS. Create a custom XSLT stylesheet to change theway search results and bibliographic recordsappear in the OPAC. Define OPAC system preferences. Set up your cron jobs.
  46. 46. OPAC SEARCH PAGE
  47. 47. OPAC SEARCH
  48. 48. PROBLEM WITH Z39.501. Implementation not easy2. Does not scale well (if nodes > 100)3. Network bandwidth4. Z39.50 implementation at client(“Origin’) end5. Time Consuming6. Slow Processing7. All Servers should be on.
  49. 49. ARCHITECTUREDESIGN
  50. 50. LEVEL 0 DFD OF KOHA
  51. 51. LEVEL 1 DFD
  52. 52. Flowchart of Koha
  53. 53. CONCLUSION & FUTUREWORK Data from proprietary software migrated to Koha. Barcode Scanner will be attached. Now Union catalogue for distributed libraries will bemade by using oai-pmh protocol and harvester forfederated searching. Using harvester, data can be converted back to marcfor implementing Z39.50 protocol in koha forimporting records from distributed libraries.
  54. 54. THANK YOU

×