Top Banner
DunavNET Augmented Reality - Connecting Physical and Virtual Worlds March 2015 Dr Boris Pokrić CTO DunavNET, Novi Sad, Serbia
49

Augmented Reality - Connecting Physical and Virtual Worlds

Jul 17, 2015

Download

Technology

DunavNET
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Augmented Reality - Connecting Physical and Virtual Worlds

DunavNET

Augmented Reality - Connecting

Physical and Virtual Worlds

March 2015

Dr Boris Pokrić

CTO

DunavNET, Novi Sad, Serbia

Page 2: Augmented Reality - Connecting Physical and Virtual Worlds

Boris Pokric - Short Bio

• CTO and co-founder of DunavNET last 8 years

• PhD degree in Artificial Vision Sciences

• 20+ years experience, 10 years in the UK

• Working previously for large customers such as

Motorola, Sagem, LG, Qualcomm and Samsung

• Business and product management in

DunavNET

• Managing R&D activities

Page 3: Augmented Reality - Connecting Physical and Virtual Worlds

About the Company

• Established in 2006, in Novi Sad, Serbia

– Office in Dublin, Ireland

• Number of employees: 50

– of which • 90% with university degrees

• 20% with PhD

– average experience: 5 years

• Founder member of International IoT Forum

– www.iotforum.org

• Founding member of Alliance for IoT Innovation

– http://ioti.eu

Page 4: Augmented Reality - Connecting Physical and Virtual Worlds

DunavNET

Smart Lab active in EC co-funded FP7 and H2020

programme

Focus on Internet of Things, smart cities, Future

Internet and AR. Currently 12 running EU projects

Spin-off

Development of novel mobile and web solutions

mTicketing, Augmented reality

DNET game studio develops complex mobile games

Own titles

Consulting services to clients in Germany and UK

More than 2mill downloads

Page 5: Augmented Reality - Connecting Physical and Virtual Worlds

Main focus areas

• Smart city technology and services– IoT

– Smart transport

– Environmental monitoring

– Cloud based solutions

• Mobile services and applications– mTicketing and mPayment

– Augmented Reality

– Games, Serious and Fun

Page 6: Augmented Reality - Connecting Physical and Virtual Worlds

Research and Innovation

• 6 projects funded in FP7 programme

• 2 projects funded in EU CIP-PSP programme

• 4 projects in H2020

• 2 projects funded by Innovation fund of Serbia

• Main partners– Engineering (Italy), Univ. of Surrey (UK), Mandate

International (Switzerland), Alexandra Institute (Denmark), Univ. of Murcia (Spain), Indra (Spain), NEC, Disney Research, ETH (Switzerland), Ericsson (Sweden), Tehnicolor (France)

– City of Novi Sad, Informatika (Novi Sad)

Page 7: Augmented Reality - Connecting Physical and Virtual Worlds

Products

• ekoNET – environmental monitoring IoT

service, http://ekonet.solutions

• ARgenie – SaaS and PaaS for building AR

apps, http://argenie.eu

• fleetNET – fleet management solution,

http://dunavnet.eu

• iotNET – scalable and flexible IoT platform

Page 8: Augmented Reality - Connecting Physical and Virtual Worlds

Augmented Reality

• The overlay of computer-presented information on top

of the real world

• Real world in this context is as experienced by the

utilised sensor technology

• Additional content includes any media such as sound,

image, videos

• Using mobile phone or wearable AR display such as

Google Glass, Epson Glasses or Microsoft HoloLens

Page 9: Augmented Reality - Connecting Physical and Virtual Worlds

TYPES…

Page 10: Augmented Reality - Connecting Physical and Virtual Worlds

Location-based AR

Page 11: Augmented Reality - Connecting Physical and Virtual Worlds

Image marker AR

Page 12: Augmented Reality - Connecting Physical and Virtual Worlds

Markerless

Page 13: Augmented Reality - Connecting Physical and Virtual Worlds

Wearable display

Page 14: Augmented Reality - Connecting Physical and Virtual Worlds

SENSING…

Page 15: Augmented Reality - Connecting Physical and Virtual Worlds

Location marker detection

• Using GPS for location

• Using gyroscope, accelerometer and

compass

• Determine the exact location in 3D space

(translation and rotational angles), 6 degrees

of freedom

• Render AR content in relation to the 3D

location of phone

Page 16: Augmented Reality - Connecting Physical and Virtual Worlds

Image marker detection

• Much more complicated

• Requires image recognition

• Matching with large marker database

• Needs 30 fps video processing

• Often uses cloud side processing

Page 17: Augmented Reality - Connecting Physical and Virtual Worlds

SIFT Example

Page 18: Augmented Reality - Connecting Physical and Virtual Worlds

Depth sensing AR

• Using 3D cameras

• Simulating 3D

camera using mono-

lens

• Detection of 3D

environment

• Placing AR content

in relation to the

sensed environment

Page 19: Augmented Reality - Connecting Physical and Virtual Worlds

PTAM – Oxford Labs

Page 20: Augmented Reality - Connecting Physical and Virtual Worlds

Vuforia™ Smart Terrain™

Page 21: Augmented Reality - Connecting Physical and Virtual Worlds

APPLICATIONS…

Page 22: Augmented Reality - Connecting Physical and Virtual Worlds

Advertising

Page 23: Augmented Reality - Connecting Physical and Virtual Worlds

Marketing

Page 24: Augmented Reality - Connecting Physical and Virtual Worlds

Industrial

Page 25: Augmented Reality - Connecting Physical and Virtual Worlds

Scientific

Page 26: Augmented Reality - Connecting Physical and Virtual Worlds

Environment

Page 27: Augmented Reality - Connecting Physical and Virtual Worlds

Arts and architecture

Page 28: Augmented Reality - Connecting Physical and Virtual Worlds

Education

Page 29: Augmented Reality - Connecting Physical and Virtual Worlds

Medical

Page 30: Augmented Reality - Connecting Physical and Virtual Worlds

Publishing

Page 31: Augmented Reality - Connecting Physical and Virtual Worlds

Sport

Page 32: Augmented Reality - Connecting Physical and Virtual Worlds

MAKING AR APP…

Page 33: Augmented Reality - Connecting Physical and Virtual Worlds

Process - conventional

Page 34: Augmented Reality - Connecting Physical and Virtual Worlds

Process – using SaaS

Page 35: Augmented Reality - Connecting Physical and Virtual Worlds

ARgenie

Page 36: Augmented Reality - Connecting Physical and Virtual Worlds

ARgenie Creator Main Features

• Number of templates available

– ARfie (taking AR photo with AR content)

– Postcards, birthday cards…

– Treasure hunt game

– AR books, newspapers (soon)

– Product promotion (soon)

– Company promotion (soon)

Page 37: Augmented Reality - Connecting Physical and Virtual Worlds

ARgenie Creator Web Portal

Page 38: Augmented Reality - Connecting Physical and Virtual Worlds

ARgenie Viewer

• Views the presentation content

• Presentations classified into

categories (business, games, …)

• Can be:

– private – just for your friends

– public – shared with everyone

• Includes market with pricing

Page 39: Augmented Reality - Connecting Physical and Virtual Worlds

Marker triggered 2D model – content fixed on screen

not marker dependent after triggeringResearchers' Night

MarkerMarker

Page 40: Augmented Reality - Connecting Physical and Virtual Worlds

Markerless 2D model – content fixed on screen

I drink wine

Page 41: Augmented Reality - Connecting Physical and Virtual Worlds

Markerless 2D model – content fixed on screen

selection among different 2D models availableKombank Arena Fan

Page 42: Augmented Reality - Connecting Physical and Virtual Worlds

Marker triggered 2D model – content fixed on screen

selection among different 2D models available

not marker dependent after triggering

Ariel

MarkerMarker

Page 43: Augmented Reality - Connecting Physical and Virtual Worlds

Markerless 2D model – content fixed on screen (frame)

+ Marker based 2D model - parallel position

marker dependent after triggering

Lion Group

MarkerMarker

Page 44: Augmented Reality - Connecting Physical and Virtual Worlds

Marker triggered 3D model with or without animation –

marker dependent after triggering

DunavNET AR

MarkerMarker

Page 45: Augmented Reality - Connecting Physical and Virtual Worlds

• List of products families

• Slider option

• product description

• Product selling points

• User notification to manufacturer if the product was not found at the selling point

• Scanning the products and AR content displayed

AR Custom Apps for Products

Page 46: Augmented Reality - Connecting Physical and Virtual Worlds

AR Custom Apps for Conferences

• Participants’ list

• Slider option

• Participants’ bios

• Conference programme

• Scanning the accreditation and AR content displayed

• Digital2014

Page 47: Augmented Reality - Connecting Physical and Virtual Worlds

AR Custom Apps for Wines

• List of wineries

• Wine information

• Wine selling points

• Wine ordering option

• Recognition of wine labels and AR content displayed

• vinAR

Page 48: Augmented Reality - Connecting Physical and Virtual Worlds

ar.NET & ps.NET

If you see the sign like one of these two then scan

the image and discover Augmented Reality content!!!

ps.NET is a Serbian translation of the ar.NET

(Augmented Reality.NET)

Page 49: Augmented Reality - Connecting Physical and Virtual Worlds

www.dunavnet.eu

www.argenie.eu

Thank you!

Q&A