Frédéric (Fred) Lavigne Bluemix Developer Advocate @L2FProd Dark Vision video processing ServerlessConf May 26 & 27, 2016 with IBM Bluemix OpenWhisk
Frédéric (Fred)LavigneBluemixDeveloperAdvocate@L2FProd
DarkVisionvideoprocessing
ServerlessConfMay 26 & 27, 2016
withIBMBluemixOpenWhisk
PleaseNote• IBM’sstatementsregardingitsplans, directions, andintentaresubjecttochangeorwithdrawalwithoutnoticeatIBM’ssolediscretion.
• Informationregardingpotentialfutureproducts isintendedtooutlineourgeneralproductdirectionanditshould notberelied oninmakingapurchasingdecision.
• Theinformationmentionedregardingpotentialfutureproductsisnotacommitment,promise, orlegalobligationtodeliveranymaterial,codeorfunctionality. Informationaboutpotentialfutureproductsmaynotbeincorporatedintoanycontract.
• Thedevelopment, release,andtimingofanyfuturefeaturesorfunctionality described forourproductsremainsatoursolediscretion.
• Performanceisbasedonmeasurementsandprojections usingstandardIBMbenchmarks inacontrolledenvironment.Theactualthroughputorperformancethatanyuserwillexperiencewillvarydepending uponmanyfactors,including considerations suchastheamountofmultiprogrammingintheuser’s jobstream,theI/Oconfiguration,thestorageconfiguration, andtheworkloadprocessed.Therefore,noassurancecanbegiventhatanindividual userwillachieveresults similartothosestatedhere.
2
Videowillaccountfor80to90%ofallconsumer Internettrafficby2019
2.5quintillionbytesofdataeveryday
400hoursofvideouploadedeveryminute
Whatalargeamountofdatatoanalyze!
Places,products,objects, faces,people, texts
GuyFieri
Boat
MoulinRouge
Nivea
Usethedatatoimprovesearch,navigation, recommendation, brandresonance
Improvesearchresults
Betternavigation
Makerecommendations
Detectbrands
Agood fitforaserverlessarchitecture
Scalewiththenumberofvideos
Runasynchronously
Severalindependentactions
DarkVision isanapplicationtodiscoverthesedata.Let’sseeitinaction.
DEMO
Usingthedatawediscovered,wecandeliveranimproveduserexperience.
Adeeperlookattheresults.
Moreresultsforothervideos.
ImageAnalysis
BuiltwithIBMBluemix,OpenWhisk,Watson
PUBLIC NETWORK CLOUD NETWORK
OPENWHISK
REST APIMOBILEAPP STORAGE
VideoExtractor
Whathappened:extractingFrameswithaDockeraction
OPENWHISK
REST APIMOBILEAPP STORAGE
VideoExtractor
ImageFrames
1 2
3
4
5
DockerimagestoredonDockerHub
Extractorusesffmpeg, ImageMagick
Whathappened:analyzingframeswithaJavaScriptaction
ImageAnalysis
OPENWHISK
STORAGE
ImageFrame
Watson Visual Recognitionand Alchemy Vision API
12
3
4
5
ImageanalysisusedImageMagick,WatsonVisualRecognitionandAlchemyVision
NewVideoRule
VideoExtractor ImageAnalysis
OpenWhiskartifactsusedbyDarkVision
TR
STORAGE
A
NewVideoTrigger NewImageTrigger
NewImageRuleule
ction
rigger
Contributions welcometoperformaudioanalysis(speechtotext,toneandsentimentanalysis)
Getthecode
https://github.com/IBM-Bluemix/openwhisk-darkvisionapp
TryOpenWhisk
IBMBluemixOpenWhiskofferinghttps://new-console.ng.bluemix.net/openwhisk/
OpenWhiskopensourceprojecthttps://github.com/openwhisk/openwhisk
Variationonthesametheme,Drones!
NoticesandDisclaimers• Copyright ©2016byInternational BusinessMachinesCorporation (IBM).Nopart ofthisdocument maybereproduced ortransmitted inanyformwithout written permissionfromIBM.
• U.S.GovernmentUsersRestrictedRights- Use,duplication ordisclosure restrictedbyGSAADPSchedule Contractwith IBM.
• Information inthesepresentations (including information relatingtoproducts thathavenotyetbeenannounced byIBM)hasbeen reviewedforaccuracyasofthedateofinitial publication andcould includeunintentional technical ortypographical errors.IBMshallhavenoresponsibility toupdatethisinformation. THIS DOCUMENTISDISTRIBUTED"ASIS"WITHOUTANYWARRANTY,EITHEREXPRESSORIMPLIED.INNOEVENTSHALLIBMBELIABLEFORANYDAMAGEARISINGFROMTHEUSEOFTHISINFORMATION,INCLUDINGBUTNOTLIMITEDTO,LOSSOFDATA,BUSINESSINTERRUPTION,LOSSOFPROFITORLOSSOFOPPORTUNITY.IBMproductsandservicesarewarranted according tothetermsandconditions oftheagreementsunder whichtheyareprovided.
• Anystatements regardingIBM'sfuturedirection, intent orproduct plansaresubjecttochangeorwithdrawal without notice.
• Performance datacontained herein wasgenerallyobtained inacontrolled, isolatedenvironments.Customer examplesarepresented asillustrations ofhowthosecustomershaveusedIBMproducts andtheresultstheymayhaveachieved.Actualperformance, cost, savingsorother resultsinother operatingenvironments mayvary.
• References inthisdocument toIBMproducts, programs,orservicesdoesnotimplythatIBMintendstomakesuchproducts, programsorservicesavailableinallcountries inwhichIBMoperatesordoesbusiness.
• Workshops,sessionsandassociatedmaterialsmayhavebeenprepared byindependent sessionspeakers,anddonotnecessarilyreflecttheviewsofIBM.Allmaterialsanddiscussions areprovided forinformational purposesonly,andareneither intended to, norshallconstitute legalorother guidanceoradvice to anyindividualparticipant ortheirspecific situation.
• Itisthecustomerʼs responsibility toinsure itsowncompliance withlegalrequirements andtoobtain adviceofcompetent legalcounselastothe identification andinterpretation ofanyrelevantlawsandregulatoryrequirements thatmayaffectthecustomerʼsbusinessandanyactionsthecustomer mayneedtotaketocomplywithsuchlaws.IBM doesnotprovidelegaladviceorrepresent orwarrant thatitsservicesorproducts willensurethatthecustomer isincompliance withanylaw
NoticesandDisclaimersCon’t.
• Informationconcerningnon-IBMproductswasobtainedfromthesuppliersofthoseproducts,theirpublishedannouncements orotherpubliclyavailablesources.IBMhasnottestedthoseproducts inconnectionwiththispublicationandcannotconfirmtheaccuracyofperformance,compatibilityoranyotherclaimsrelatedtonon-IBMproducts. Questionsonthecapabilitiesofnon-IBMproductsshouldbeaddressedtothesuppliersofthoseproducts. IBMdoesnotwarrantthequalityofanythird-partyproducts,ortheabilityofanysuchthird-partyproductstointeroperatewithIBMʼsproducts. IBMEXPRESSLYDISCLAIMSALLWARRANTIES,EXPRESSEDORIMPLIED,INCLUDINGBUTNOTLIMITEDTO,THEIMPLIEDWARRANTIESOFMERCHANTABILITYANDFITNESSFORAPARTICULARPURPOSE.
• Theprovisionofthe informationcontainedherein isnotintendedto,anddoesnot,grantanyrightorlicenseunderanyIBMpatents,copyrights,trademarksorotherintellectualpropertyright.
• IBM,theIBMlogo,ibm.com,Aspera®,Bluemix,Blueworks Live,CICS,Clearcase,Cognos®,DOORS®,Emptoris®,EnterpriseDocumentManagementSystem™,FASP®,FileNet®,GlobalBusinessServices®,GlobalTechnologyServices®,IBMExperienceOne™,IBMSmartCloud®,IBMSocialBusiness®, InformationonDemand,ILOG,Maximo®,MQIntegrator®,MQSeries®,Netcool®,OMEGAMON,OpenPower,PureAnalytics™,PureApplication®,pureCluster™,PureCoverage®,PureData®,PureExperience®,PureFlex®,pureQuery®,pureScale®,PureSystems®,QRadar®,Rational®,Rhapsody®,SmarterCommerce®,SoDA,SPSS,SterlingCommerce®,StoredIQ,Tealeaf®,Tivoli®,Trusteer®,Unica®,urban{code}®,Watson,WebSphere®,Worklight®,X-Force®andSystemz®Z/OS,aretrademarksofInternationalBusinessMachinesCorporation,registeredinmanyjurisdictionsworldwide.OtherproductandservicenamesmightbetrademarksofIBMorothercompanies.AcurrentlistofIBMtrademarksisavailableontheWebat"Copyrightandtrademarkinformation"at:www.ibm.com/legal/copytrade.shtml.