MediaMosa as a Mass-storage Solution - 11 december 2013, Brussels

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

The Challenge of Mass-storage

• The MediaMosa Foundation

MediaMosa as a Mass-storage Solution

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

About SURFnet

• Development and exploitation of - the Dutch National Network for

Higher Education and Research - innovative ICT platforms & services - Over 14,000 km dark fiber

• By and for the Dutch Higher Education and Research community - 180+ connected organisations,

serving 1 million users - Not for profit, 86 employees - In business since 1988

25th Anniversary!

!2

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

SURFnet’s history of streaming activities

!3

1998 Audio & Video hosting service (FTP) - 1st gen. !2003 SURFnet Video Portal (SVP) - 2nd gen. !2005 SURFnet-TV Live Netcasting !2007 Start new generation video services - 3rd gen. SURFnet/Kennisnet innovation program ! ! 2007: Start of open source based innovation !

SURFmedia (2007) VP-X Project (2007) VP-Core Platform (2008) MediaMosa Software (2009)

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Introducing MediaMosa

!4

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Digital Asset Management System

!5

Store Prepare Retrieve

Share

Any Digital Asset

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium !6

‣ Store Any Digital Asset

‣ Describe asset using Metadata Standardsexisting standards or custom sets

‣ Access Control to Protect Private Assets

‣ Upload, Ingest, Harvest, SFTP, ...

Store

Digital Asset Management System

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium !7

‣ Transcode video / audio / imagesMobile compatible, high/low quality, …

‣ Analyse filesCreate Still, Speech2text, OCR, …

‣ Index files and metadataFull-text, read technical metadata (id3, exif, ...) !

Prepare

Digital Asset Management System

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium !8

‣ CQL Contextual Query LanguageA formal language for representing queries to information retrieval systems

‣ Apache SOLR for indexing and searching

Retrieve

Digital Asset Management System

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium !9

Share / Play

Digital Asset Management System

‣ Authenticate Play Requests

‣ Serve Complete Player or Files

‣ Stream over HTTP progressive downloadOr add a streaming server to your setup

‣ Combine Multiple files per assets for advanced functionality

‣ OAI-PMH provisioning

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

REST based SOA

✓ Flexibility by combining components ✓Open source and using open source components ✓ Scalable for future expansion

!10

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Open & Public from the start

!11

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

A growing community

!12

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Transcription Technology Project

!13

MediaMosa Transcription by Spraak

Multi-Source Player

•  Enhanced Search •  Optional Subtitles •  Mashup info

Web lecture recording

App

•  Recognize the Speech •  Produce time-coded

Transcript •  CMU Sphinx for English

•  Recording of Teacher •  Recording of Slides •  Reference material

•  Transcode into audio •  Store all into an asset

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Time Coded Transcript

!14

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

The Challenge of Mass-Storage

!15

‣Cost considerations

‣ Indexing and Searching options

‣Open standards and formats

‣Migration paths

‣Scalability

‣ Long term storage for archival purposes

‣Accessibility

‣Sharing and access control

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

MediaMosa Storage Solutions

!16

‣Hosted on Open Source stack ‣Storage on both Open Source

and commercial solutions ‣Use any storage mount points ‣Build Petabyte scale solutions

using Ceph, Glustre, MooseFS etc. ‣Use cloud provided solutions like

Amazon S3

Or use MediaMosa-as-a-Service: MediaSalsa http://www.mediasalsa.eu

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Some Use Cases

!17

‣ Video websitesSpecific topics, freemium model

‣ MOOCs & e-LearningBuild your own or integrate with existing tools

‣ Centralised media repositoryCreate once, publish everywhere

‣ Archival Well described data on flexible storage mount points

!

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Open Source is....

!18

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Open Source is....

!19

“The realisation of an open source

project does not guarantee the creation

of a community”

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Why a foundation?

!20

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Founded! January 8th 2013

!21

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

MediaMosa Foundation - Core Activities

!22

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Foundation Governance

!23

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Foundation Governance

!24

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Foundation Governance

!25

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Foundation Governance

!26

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

Foundation Governance

!27

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium !28

‣ Join the community ‣ Talk to us ‣ Will do BoF sessions to go into specifics ‣ Contribute ‣ Become a sponsor ‣ Use MediaMosa and tell us about it ‣ Have fun

Call to Action

http://foundation.mediamosa.org <[email protected]>

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium

MediaMosa Directions and Q&A

!29

WWW http://mediamosa.org http://foundation.mediamosa.org !Twitter http://twitter.com/mediamosa !Online Demo http://demo.mediamosa.org

Source Code https://github.com/mediamosa !Slideshare http://www.slideshare.net/mediamosa

Lecture Capture Workshop-11 December 2013 AGORA Learning Centre, KU Leuven, Belgium !30

[email protected]

For a sustainable

future...