A New Jersey Statewide Video Portal
                             Based on Open Source Technologies



 Isaiah Beard
 Digit...
Outline & Overview

 Concepts and History
 Architecture and
 Usage Scenarios
 Challenges unique to
 NJVid
 Demos/
 Proof o...
Beginnings
Concepts & History
Predecessor Technologies
    New Jersey Digital Highway (njdigitalhighway.org)
    Statewide repository - IMLS grant
    E...
Predecessor Technologies


Existing Video Collections
  Partner Institutions with video content
    New Jersey Digital Hig...
Collection/Video Types

Three Major Video Collection Types
    Video Commons
      Locally Owned/Locally produced

•   Com...
Nuts & Bolts
Architecture & Workflow
Reference Architecture

    A Trusted Repository
      Reliable content delivery
      Standards-based
      digitization
...
Reference Architecture:
                Technologies in Use
          Area                    Software Used
Applications/W...
Reference Architecture
                                                  NJVid Commons
            User Input
            ...
Architectural Challenges


    Large Master Video Files
    Master DV/AVI files @ 20GB+ per hour
      •   Ingest, present...
Architectural Challenges
            Object Architecture
                                          Descriptive
   Reposito...
Infrastructure Demos




                       13
Large Files:
                The Digital Video Object
                   Archival Masters
    Film transfer/VHS/Betacam/An...
Large Files:
               The Digital Video Object
             Presentation Streams
    Streaming Protocol: MPEG-4 H.26...
Large Files:
           The Digital Video Object
          Presentation Streams
Codec Selection Criteria
Easy to Use/Insta...
Large Files:
        The Digital Video Object
           Content Demo



Demo Video Clip from Existing Collections




   ...
Large Files:
           The Digital Video Object
          Presentation Streams

Open Source-able architecture -
Darwin St...
Large Files:
           The Digital Video Object
          Presentation Streams
Transcripts
When available
Searchable & In...
Application Architecture

                           Partner/Custom Portals
                                        Middle...
Usage Scenarios
The Front-End Interface
End User Scenarios


    Faculty Annotation for Lectures on Demand
    Specific clips, segments for dissemination
•   Gene...
Lectures on Demand:
                Annotated Video Clip
Workflow
Instructor previews video and selects segments for
stude...
Lectures on Demand:
                Annotated Video Clip
Workflow
Instructor previews video and selects segments for
stude...
Lectures on Demand:
                           Annotated Video Clip
    Workflow
    A structure map with appropriate time...
Development Needs
                           for NJVID
Finalization of Video Architecture
(Summer 2008)
Implement Shibbole...
Questions?


 Isaiah Beard
 Digital Standards & Workflow Manager
 Scholarly Communication Center

 Rutgers University Libr...
Watch This Space!


View our blog, sample videos
and progress reports at:


               www.njvid.org




Internet2 Spr...
Upcoming SlideShare
Loading in …5
×

A New Jersey Statewide Video Portal Based on Open Source ...

698 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
698
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

A New Jersey Statewide Video Portal Based on Open Source ...

  1. 1. A New Jersey Statewide Video Portal Based on Open Source Technologies Isaiah Beard Digital Standards & Workflow Manager - SCC Repository Architects: Ron C. Jantz and Grace Agnew Rutgers, the State University of New Jersey Internet2 Spring Member Meeting Arlington, VA - April 23, 2008
  2. 2. Outline & Overview Concepts and History Architecture and Usage Scenarios Challenges unique to NJVid Demos/ Proof of concept 2
  3. 3. Beginnings Concepts & History
  4. 4. Predecessor Technologies New Jersey Digital Highway (njdigitalhighway.org) Statewide repository - IMLS grant Established Foundation Platform RUcore - Rutgers Community Repository • Expansion of NJDH technology • Customization, portals • Born Digital Archiving 4
  5. 5. Predecessor Technologies Existing Video Collections Partner Institutions with video content New Jersey Digital Highway Local Collections - WPUNJ, Montclair, etc. 5
  6. 6. Collection/Video Types Three Major Video Collection Types Video Commons Locally Owned/Locally produced • Commercial Videos - Consortia • Lectures on Demand 6
  7. 7. Nuts & Bolts Architecture & Workflow
  8. 8. Reference Architecture A Trusted Repository Reliable content delivery Standards-based digitization Preservation Platform Rights Enforcement • Authentication/ Authorization 8
  9. 9. Reference Architecture: Technologies in Use Area Software Used Applications/Web Interface PHP / MySQL Journals Open Journal System (PKP) Search Engine Amberfish PHP / MySQL Workflow Mangement (developed in-house) PHP / MySQL Collection Services (developed in-house) Handles/Persistent IDs CNRI Handle Server Video Streaming Server Darwin (Apple) Digital Library Framework FEDORA OS/Web Server Linux/Apache 9
  10. 10. Reference Architecture NJVid Commons User Input (Metadata) Partner Portals Collection/Preservation Services Workflow Management FEDORA Repository Service System <XML> Digital Object Matrox Repository Digitized Video Axio (FEDORA) Video Master Encoder 10
  11. 11. Architectural Challenges Large Master Video Files Master DV/AVI files @ 20GB+ per hour • Ingest, presentation, preservation • Lectures on Demand - Annotate Video • Authentication/Authorization Facility 11
  12. 12. Architectural Challenges Object Architecture Descriptive Repository ID Technical Metadata MD Structure Behaviors Source (dissemintaors) Rights Data Streams Digital Provenance SMAP1 - StrMap (TOC) FLV1-Download MOV1-Quicktime Stream PDF1 - Transcript XACML Policy ARCH1 - Archival Master 12
  13. 13. Infrastructure Demos 13
  14. 14. Large Files: The Digital Video Object Archival Masters Film transfer/VHS/Betacam/Analog Sources Uncompressed AVI as Master Digital (DVCAM, miniDV, HDV, etc.) • DV file with native format/encoding • DVDs • Disk Image (ISO) kept as archive Masters 14
  15. 15. Large Files: The Digital Video Object Presentation Streams Streaming Protocol: MPEG-4 H.264 (Quicktime) 15-20 frames/sec, 640x480 Data rate: 384-512 kbps Progressive Download • Flash Video (FLV with SWF wrapper) • 15 fps, 640 x 480 - 256-384 kbps • Intended as an alternate presentation mode 15
  16. 16. Large Files: The Digital Video Object Presentation Streams Codec Selection Criteria Easy to Use/Install Supports Multiple Platforms Built on established industry standards Excellent quality/bandwidth ratio Widely Used (Akamai, YouTube, etc) 16
  17. 17. Large Files: The Digital Video Object Content Demo Demo Video Clip from Existing Collections 17
  18. 18. Large Files: The Digital Video Object Presentation Streams Open Source-able architecture - Darwin Streaming Server (DSS) Can run on all major OS platforms Free, open source license (APSL) 18
  19. 19. Large Files: The Digital Video Object Presentation Streams Transcripts When available Searchable & Indexable Text/XML Will require labor (transcribing & data entry) 19
  20. 20. Application Architecture Partner/Custom Portals Middleware (Host Server/Shibboleth) Progressive Download (Flash Video) Quicktime/H.264 Stream Digital Object Repository (FEDORA) Backend Storage Subsystem Archival Master Darwin Streaming Server Retrieve Streams in Files FEDORA via NFS (Video Content Delivery) - External Storage - Checksum Integrity Validation 20
  21. 21. Usage Scenarios The Front-End Interface
  22. 22. End User Scenarios Faculty Annotation for Lectures on Demand Specific clips, segments for dissemination • General Public Access - NJVid Commons • Student Access to Licensed Videos • A/A required for selective access 22
  23. 23. Lectures on Demand: Annotated Video Clip Workflow Instructor previews video and selects segments for students 23
  24. 24. Lectures on Demand: Annotated Video Clip Workflow Instructor previews video and selects segments for students Instructor authenticates, and creates annotation objects for the video, specifying in and out points 24
  25. 25. Lectures on Demand: Annotated Video Clip Workflow A structure map with appropriate time segments and persistent ID of the source video is created. All pieces fall into place. Object ID Presented Video Object Video for Class Metadata 101:01 Structure Map Behaviors Intro: 0:00.00 - 11:01.29 History: 20:00.09 to 45:08.10 Data Stream Darwin Wrap-Up: 65:22.24 to 70:01.18 Streaming TOC Server 25
  26. 26. Development Needs for NJVID Finalization of Video Architecture (Summer 2008) Implement Shibboleth for Authentication and Authorization (Fall 2008) Fine-Grained object access via XACML (Fall 2008) Video Table of Contents (early to mid 2009) Multiple Structure Map Annotations for Complex Segments (mid 2009) NJVID Custom Installation Configuration
  27. 27. Questions? Isaiah Beard Digital Standards & Workflow Manager Scholarly Communication Center Rutgers University Libraries isaiah.beard@rutgers.edu Internet2 Spring Member Meeting Arlington, VA - April 23, 2008
  28. 28. Watch This Space! View our blog, sample videos and progress reports at: www.njvid.org Internet2 Spring Member Meeting Arlington, VA - April 23, 2008

×