Fluor sakai la 2011

871 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
871
On SlideShare
0
From Embeds
0
Number of Embeds
37
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Make researchers aware of the importance of sharing data.Sharing data becomes even more a requirement than a wish.Support publications
  • Role of the library is to support researchers managing and storing data
  • N = amount of participants
  • Virtualdatastreams: services (image resize, file conversion)
  • Updates from Fedora are sent by JMSThe rest/soap interface is not used
  • Request based: user needs to create a request. Works like a shopping cart. The request needs to be approved. Uploads need to be reviewed also.
  • Solr 1.3
  • Fluor sakai la 2011

    1. 1. Fluor: Your connection to the Fedora Digital Objects Repository<br />Roland Groen, Edia<br />
    2. 2. Overview<br />Project goals & drivers<br />History of the project<br />Short walkthrough<br />Overall Architecture<br />The features of the fluor tool<br />Setting up a collection<br />Project Status<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />2<br />
    3. 3. Project Goals<br />Make researchers share research data in a controlled community<br />Integrate Sakai with the Fedora Content Repository<br />Support searching and browsing<br />Support different access models<br />Open vs. closed<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />3<br />
    4. 4. Project Drivers<br />UvALibrary: make researchers aware of the importance of sharing data<br />Making research data publically available becomes more and more a requirement than a wish<br />Publishing: Support publications by disseminate the underlying research data<br />Teaching: have students work with actual research data<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />4<br />
    5. 5. A bit of history<br />And now...<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />5<br />
    6. 6. Project history: testweeklab<br />‘Testweeklab’ project (2008)<br />Work with 40 years of privacy sensitive research data<br />Strong security requirements<br />Only metadata (publically) accessible<br />Complicated access procedure for accessing the actual data<br />Very specific metadata schema, search and browse requirements<br />Very specific fields (year, N, type of test, scale)<br />Build as Sakai tool for connecting to a Fedora repository<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />6<br />
    7. 7. Project history: next steps<br />Findings from testweeklab<br />User Interaction improvements<br />Configurability<br />Support more types of usage<br />Make the tool flexible to support different collections and types of use<br />Make the access model flexible<br />Support personalization<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />7<br />
    8. 8. A short functional walkthrough<br />And now…<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />8<br />
    9. 9. Searching<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />9<br />
    10. 10. Browsing<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />10<br />
    11. 11. My Items<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />11<br />
    12. 12. Upload<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />12<br />
    13. 13. The overview of the architecture<br />And now...<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />13<br />
    14. 14. Overall architecture<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />14<br />
    15. 15. Overall architecture: components<br />Fedora: act as a content repository.<br />Generic search: do the updates and transformations to Solr<br />Solr: indexing, provide a search and browse interface<br />Sakai FLUOR tool: create a UI for researchers to work with<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />15<br />
    16. 16. Fedora<br />Content repository<br />Content managed as data objects<br />Unique identifier: PID<br />Metadata<br />Datastreams<br />Relation between objects<br />Virtual datastreams<br />Versioning, logging<br />Multiple collections<br />Objects handled as XML (FOXML)<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />16<br />
    17. 17. Fedora generic search<br />Enables browsing and search with Lucene, Solr and Zebra<br />Gets notifications about updates from Fedora and fetches the objects<br />XSLT transforms FOXML into documents for the search engine<br />a Rest and SOAP interface, search and browse based on SRW/SRU.<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />17<br />
    18. 18. Solr<br />Search engine<br />Build on top of Lucene<br />Easy to deploy and configure<br />Advanced full-text searching and indexing<br />Open interfaces, Rest, JSON, XML<br />Admin interfaces<br />Plugin architecture<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />18<br />
    19. 19. the fluor tool<br />And now…<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />19<br />
    20. 20. Fluor tool features<br />Access research data<br />Search and browse<br />Access items in the repository<br />Create favorites<br />Upload new items<br />Added directly depending on security model<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />20<br />
    21. 21. Data access security model<br />Metadata is always accessible<br />Access on datastreams is limited<br />Open: no restrictions<br />Request based: user needs to create a request, and admin reviews them. <br />Fluor tool features<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />21<br />
    22. 22. Fluor tool features<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />22<br />
    23. 23. Fluor tool features<br />The access model is configurable. <br />Open<br />Request based<br />Per object configurable<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />23<br />
    24. 24. Fluor tool features<br />Support for versioning<br />Enables the download of previous versions.<br />Configurable<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />24<br />
    25. 25. Fluor tool features<br />Data encryption<br />The ability to encrypt datastreams<br />Backups etc. cause no threat to privacy<br />Configurable on the datastream<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />25<br />
    26. 26. Setting up a repository<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />26<br />
    27. 27. Setting up a collection<br />Describe the collection<br />What datastreams are there?<br />What metadata is there?<br />Set up the Fedora repository<br />Configure the Fedora datamodel<br />Set up generic search and Solr<br />Configure the FLUOR tool<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />27<br />
    28. 28. Setting up a collection<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />28<br />
    29. 29. The status of the project<br />And now…<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />29<br />
    30. 30. Project status<br />The project is currently being tested by targeted end-users<br />Common UI bugs and issues<br />Search and index has problems<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />30<br />
    31. 31. Solrvs. Generic search<br />Generic search 2.2<br />Browse functionality broken with Solr.<br />Does not use facet browsing, instead access lucene index on file system. <br />Browse not limited to collection, results polluted.<br />Solution: Access Solr directly instead of generic search<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />31<br />
    32. 32. Any questions?<br />An finally…<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />32<br />
    33. 33. Thank you!<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />33<br />

    ×