Frans Ward

                                      Technical Product Manager
                                      SURFnet ...
Agenda


         25 min.

            SURFnet Video Services
            SURFmedia
            MediaMosa Architecture
   ...
SURFnet Video Services
1998         Audio & Video hosting service (FTP) - 1st generation

2003         SURFnet Video Porta...
3rd   generation Video                                 Services
        Architecture Requirements




                    ...
SURFmedia
SURFnet’s online mediaportal




               www.surfmedia.nl
 Expertise seminar: MediaMosa, Weblectures & Op...
SURFmedia                                   Front-end
SURFnet’s online mediaportal




               www.surfmedia.nl
 Ex...
SURFmedia Facts and Figures
              +
                  /- 25.000 user accounts

              +
                  /...
MediaMosa Architecture
    •   Common base for MediaMosa
        is Drupal:
        ✓   Open Source
        ✓   Content Ma...
MediaMosa Architecture
                                                                  Back-end
    •   Common base for ...
REST
                    Representational State Transfer

• All interactions (messages) with the              [GET] .../as...
Webservices                                    http://mediamosa.org/api
Over 150, divided in services for....


 •   Play ...
Flexible Metadata
        Element Sets
Metadata Element Sets Provided:
• Standard Dublin Core (DC)
• Qualified Dublin Core ...
Metadata Harvesting
                using OAI-PMH
      Open Archives Initiative - Protocol for Metadata Harvesting

     ...
Metadata Harvesting
                using OAI-PMH
      Open Archives Initiative - Protocol for Metadata Harvesting

     ...
Access Management
     Default: Media is accessible for everyone.
     Option to set access restrictions for playing media...
Upload Services
•   POST upload using End User Application
     (limited to 2 GB)

•   POST upload directly to MediaMosa P...
Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010
                   SURFnet. We make innovation work
End-user Application.
Web frontend for media distribution.
SURFnet: SURFmedia
Kennisnet: Teleblik




               Exper...
End-user Application.
Web frontend for media distribution.
SURFnet: SURFmedia
Kennisnet: Teleblik


Video backend infrastr...
End-user Application.
Web frontend for media distribution.
SURFnet: SURFmedia
Kennisnet: Teleblik


Video backend infrastr...
End-user Application.
Web frontend for media distribution.
SURFnet: SURFmedia
Kennisnet: Teleblik


Video backend infrastr...
VP-Core
•   Shared platform SURFnet and Kennisnet
•   Application, streaming-, transcoding servers + storage
•   Powered b...
VP-Core




              Intern Seminar, 16 November 2009
SURFnet, Pioneering Network for Higher Education and Research
VP-Core




              Intern Seminar, 16 November 2009
SURFnet, Pioneering Network for Higher Education and Research
Intern Seminar, 16 November 2009
SURFnet, Pioneering Network for Higher Education and Research
Intern Seminar, 16 November 2009
SURFnet, Pioneering Network for Higher Education and Research
Intern Seminar, 16 November 2009
SURFnet, Pioneering Network for Higher Education and Research
Intern Seminar, 16 November 2009
SURFnet, Pioneering Network for Higher Education and Research
Intern Seminar, 16 November 2009
SURFnet, Pioneering Network for Higher Education and Research
Open Source
                                                  GPLv2
                                   Open as in Open Sou...
MediaMosa: What is included?
                      ✓   The back-end code




  Expertise seminar: MediaMosa, Weblectures &...
MediaMosa: What is included?
              ✓   The MediaMosa Admin Application




  Expertise seminar: MediaMosa, Weblect...
MediaMosa: What is included?
       ✓   The White Label Enduser Application (WLE)




  Expertise seminar: MediaMosa, Webl...
MediaMosa Community




Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010
                   SURFnet. W...
MediaMosa Community


http://mediamosa.org




Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010
      ...
•   Code repository Subversion (SVN)
            •   Community Forum
            •   Documentation
            •   Issue T...
•   Code repository Subversion (SVN)
            •   Community Forum
            •   Documentation
            •   Issue T...
Planet MediaMosa
          WWW
          http://mediamosa.org/

          Forum
          http://mediamosa.org/forum

    ...
MediaMosa Status & Roadmap
                        Available on
                      mediamosa.org
                      ...
MediaMosa Highlights
★ MediaMosa is the basis for various successful video services
  that SURFnet and Kennisnet provide t...
Upcoming SlideShare
Loading in...5
×

MediaMosa architecture & features

1,034

Published on

Presentatie van Frans Ward van SURFnet tijdens het Expertiseseminar MediaMosa op 10 juni 2010 bij SURFnet.

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,034
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide














































  • REST Key Design Principles:
    Application state and functionality are abstracted into resources.
    Every resource is uniquely addressable using a universal syntax for use in web links.
    All resources share a uniform interface for the transfer of state between client and resource.

    Realworld REST:All static HTTP, Flickr, Amazon S3, most Yahoo! Services
















































  • MediaMosa architecture & features

    1. 1. Frans Ward Technical Product Manager SURFnet Advanced Services Frans.Ward@surfnet.nl MediaMosa: Architecture & Features Expertise seminar, 10 juni 2010 MediaMosa, Weblectures & Open Video `
    2. 2. Agenda 25 min. SURFnet Video Services SURFmedia MediaMosa Architecture MediaMosa Features MediaMosa Open Source MediaMosa Community MediaMosa Status & Roadmap 5 min. Questions
    3. 3. SURFnet Video Services 1998 Audio & Video hosting service (FTP) - 1st generation 2003 SURFnet Video Portal (SVP) - 2nd generation 2005 SURFnet-TV Live Netcasting 2007 Start new generation video services - 3rd generation Part of the SURFnet/Kennisnet Innovation program Separate backend - frontend functionality Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    4. 4. 3rd generation Video Services Architecture Requirements Front-end • Based on a Service Oriented SURFmedia Architecture (SOA) • Separation of frontend and backend functionality • Multiple end-user applications on a centralized video backend infrastructure MediaMosa • Flexibility: combining components Back-end • Performance and High availability • Scalable for future expansions • Open source and open source components ! Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    5. 5. SURFmedia SURFnet’s online mediaportal www.surfmedia.nl Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    6. 6. SURFmedia Front-end SURFnet’s online mediaportal www.surfmedia.nl Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    7. 7. SURFmedia Facts and Figures + /- 25.000 user accounts + /- 85.000 videos + /- 250.000 requested streams per month + /- 15 TB of video assets Content Suppliers: Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    8. 8. MediaMosa Architecture • Common base for MediaMosa is Drupal: ✓ Open Source ✓ Content Management System ✓ Web Application Framework ✓ Modulair, Hook-oriented and Scaleable • Service Oriented Architecture (SOA) • REST on the outside, REST on the inside • Scalability, Redundancy, High Availability Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    9. 9. MediaMosa Architecture Back-end • Common base for MediaMosa is Drupal: ✓ Open Source ✓ Content Management System ✓ Web Application Framework ✓ Modulair, Hook-oriented and Scaleable • Service Oriented Architecture (SOA) • REST on the outside, REST on the inside • Scalability, Redundancy, High Availability Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    10. 10. REST Representational State Transfer • All interactions (messages) with the [GET] .../asset?limit=10 MediaMosa platform are done with REST-calls. <?xml version="1.0"?> <response> • REST strictly refers to a collection of network <header> <item_count>8</item_count> <item_count_total>8</item_count_total> architecture principles which outline how <item_offset>0</item_offset> resources are defined and addressed. <request_process_time>0.0728</request_process_time> <request_query_count>55</request_query_count> <request_result>success</request_result> • REST is a Client-server, Stateless, <request_result_description></ request_result_description> Cacheable and Layered protocol. <request_result_id>601</request_result_id> <request_uri>[GET] asset? limit=10&amp;user_id=admin&amp;is_app_admin=TRUE</ request_uri> ✓ This reduces the complexity <vpx_version>1.7.3</vpx_version> </header> ✓ improves the effectiveness of performance <items> tuning <item id="1"> ✓ increases the scalability of pure server <asset_id>ZG3SmyybQ61abezpbVHrJkFF</asset_id> components ..... etc Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    11. 11. Webservices http://mediamosa.org/api Over 150, divided in services for.... • Play Video (PlayProxy HTML wrapper) • Authentication (DBUS for EUA) • Authorization (Domain, REALM, Group or mixed) • Upload (PUT, POST, FTP) • Transcoding • Media Management: mediafiles, assets and collections • Search: Contextual Query Language • Jobs • Metadata and OAI/PMH • Notification • Logging and Statistics Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    12. 12. Flexible Metadata Element Sets Metadata Element Sets Provided: • Standard Dublin Core (DC) • Qualified Dublin Core (QDC) • Learning Object Metadata (IEEE LOM) • ‘Content Zoek Profiel’ (CZP) Plus support for own (custom) Metadata Element Sets CRUD REST-calls on all objects possible. i.e.: • POST /asset/create?user=John • GET /asset/$asset_id • POST /mediafile/$mediafile?filename=NewName • POST /collection/$coll_id/delete?user=John Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    13. 13. Metadata Harvesting using OAI-PMH Open Archives Initiative - Protocol for Metadata Harvesting • is a low-barrier mechanism for repository interoperability. • Data Providers are repositories that expose structured metadata via OAI-PMH. • Service Providers then make OAI-PMH service requests to harvest that metadata. • OAI-PMH is a set of six verbs or services that are invoked within HTTP. http://oai.surfmedia.nl/request?verb=Identify http://oai.surfmedia.nl/request?verb=ListSets http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_qdc http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_dc http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_lom http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=czp http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_qdc&set=coll_id:794 Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    14. 14. Metadata Harvesting using OAI-PMH Open Archives Initiative - Protocol for Metadata Harvesting • is a low-barrier mechanism for repository interoperability. • Data Providers are repositories that expose structured metadata via OAI-PMH. • Service Providers then make OAI-PMH service requests to harvest that metadata. • OAI-PMH is a set of six verbs or services that are invoked within HTTP. http://oai.surfmedia.nl/request?verb=Identify http://oai.surfmedia.nl/request?verb=ListSets http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_qdc http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_dc http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_lom http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=czp http://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_qdc&set=coll_id:794 Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    15. 15. Access Management Default: Media is accessible for everyone. Option to set access restrictions for playing media on the following properties: • Domain, i.e only accessible from surfnet.nl • Groups of domains, i.e.: Academia group (all universities) • Realm, i.e. using ASelect, Entree, DigiD, SURFfederation • Groups of Realms, i.e.: '@teleblik' realm • User: only give rights to user=john • Groups of users, i.e.: only give rights to users of group "class-24". Combinations of the above are possible! De end-user application designer decides how and what to use. Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    16. 16. Upload Services • POST upload using End User Application (limited to 2 GB) • POST upload directly to MediaMosa Platform using ticket system (limited to 2 GB) • HTTP PUT upload using End User Application (i.e. Java Upload Applet) • FTP batch upload (“no” limits) including metadata in XML file • Quota per End User Application MediaMosa • Support for Master / Slave content sharing (Provider Application / CLA) Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    17. 17. Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    18. 18. End-user Application. Web frontend for media distribution. SURFnet: SURFmedia Kennisnet: Teleblik Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    19. 19. End-user Application. Web frontend for media distribution. SURFnet: SURFmedia Kennisnet: Teleblik Video backend infrastructure, including streaming- and transcoding servers and storage. SURFnet/Kennisnet: VP-Core Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    20. 20. End-user Application. Web frontend for media distribution. SURFnet: SURFmedia Kennisnet: Teleblik Video backend infrastructure, including streaming- and transcoding servers and storage. SURFnet/Kennisnet: VP-Core Support Applications: White Label EGA, Provider Application and OAI Provider / Harvester Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    21. 21. End-user Application. Web frontend for media distribution. SURFnet: SURFmedia Kennisnet: Teleblik Video backend infrastructure, including streaming- and transcoding servers and storage. SURFnet/Kennisnet: VP-Core Support Applications: White Label EGA, Provider Application and OAI Provider / Harvester Powered by MediaMosa: open source application for media management and distribution Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    22. 22. VP-Core • Shared platform SURFnet and Kennisnet • Application, streaming-, transcoding servers + storage • Powered by MediaMosa Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    23. 23. VP-Core Intern Seminar, 16 November 2009 SURFnet, Pioneering Network for Higher Education and Research
    24. 24. VP-Core Intern Seminar, 16 November 2009 SURFnet, Pioneering Network for Higher Education and Research
    25. 25. Intern Seminar, 16 November 2009 SURFnet, Pioneering Network for Higher Education and Research
    26. 26. Intern Seminar, 16 November 2009 SURFnet, Pioneering Network for Higher Education and Research
    27. 27. Intern Seminar, 16 November 2009 SURFnet, Pioneering Network for Higher Education and Research
    28. 28. Intern Seminar, 16 November 2009 SURFnet, Pioneering Network for Higher Education and Research
    29. 29. Intern Seminar, 16 November 2009 SURFnet, Pioneering Network for Higher Education and Research
    30. 30. Open Source GPLv2 Open as in Open Source, Open Technology, Open Formats, Open Content, Open Exchange. Partner for development: Main Entry: 1me·dia-mo-sa Pronunciation: ˈmē-dē-ә-mō-ˈzā Function: open source software to build a media management and distribution platform Release Date: 8 april 2009 Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    31. 31. MediaMosa: What is included? ✓ The back-end code Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    32. 32. MediaMosa: What is included? ✓ The MediaMosa Admin Application Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    33. 33. MediaMosa: What is included? ✓ The White Label Enduser Application (WLE) Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    34. 34. MediaMosa Community Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    35. 35. MediaMosa Community http://mediamosa.org Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    36. 36. • Code repository Subversion (SVN) • Community Forum • Documentation • Issue Tracker • Online Reference Guide • Wiki • Projects: MediaMosa Building Block for Blackboard RichMedia EGA for viewing weblecture recordings Open access English language http://mediamosa.org Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    37. 37. • Code repository Subversion (SVN) • Community Forum • Documentation • Issue Tracker • Online Reference Guide • Wiki • Projects: MediaMosa Building Block for Blackboard RichMedia EGA for viewing weblecture recordings Open access English language http://mediamosa.org Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    38. 38. Planet MediaMosa WWW http://mediamosa.org/ Forum http://mediamosa.org/forum Lists announce@lists.mediamosa.org devel@lists.mediamosa.org trac@lists.mediamosa.org Issue Tracker http://mediamosa.org/trac Subversion (SVN) http://mediamosa.org/trac/browser Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    39. 39. MediaMosa Status & Roadmap Available on mediamosa.org Release 2.1 Continued development: 2010: Three major releases based on new Drupal 7 framework Focus to provide a better and more supported community version for open source development Some Topics: • Rich Media - Weblecture recording support • Transcripting Technology Scout • MediaMosa Open API / Cloud • Enhanced support for other content than audio/video Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work
    40. 40. MediaMosa Highlights ★ MediaMosa is the basis for various successful video services that SURFnet and Kennisnet provide to the Dutch educational sector ★ Open as in Open Source, Open Technology, Open Formats, Open Content, Open Exchange, Open Access ★ Options to set access restrictions for playing media ★ Modular and Highly Flexible ★ Features a Rich Feature set ★ New 2.x version introduces many improvements for open source developers Todo: - MediaMosa Demo and Labs environment - supply VM images for easier startup Expertise seminar: MediaMosa, Weblectures & Open Video, 10 juni 2010 SURFnet. We make innovation work

    ×