Taking the purple pill

• 1. Taking the Purple Pill:
  Lessons Learned Building a Platform
  for Geo-Social Augmented Reality Games
  Terrance Cohen
  Vice President, Game Platforms
  Oriel Bergig
  Vice President, R&D
  

2. Taking the Purple Pill
Lessons Learned Building a Platform for Geo-Social Augmented Reality Games
3. Taking the Purple Pill
Lessons Learned Building a Platform for Geo-Social Augmented Reality Games
4. Taking the Purple Pill
Lessons Learned Building a Platform for Geo-Social Augmented Reality Games
5. Taking the Purple Pill
Lessons Learned Building a Platform for Geo-Social Augmented Reality Games
6. Taking the Purple Pill
Lessons Learned Building a Platform for Geo-Social Augmented Reality Games
7. Taking the Purple Pill
8. Taking the Purple Pill
9. Obligatory What is AR Slides
Ronald Azumas seminal work
A Survey of Augmented Reality
August 1997.
http://www.cs.unc.edu/~azuma/ARpresence.pdf
This is your first stop if you have any interest in AR.
10. In Augmented Reality, the user can see the real world around him, with computer graphics superimposed or composited with the real world. Instead of replacing the real world, we supplement it. Ideally, it would seem to the user that the real and virtual objects coexisted.
11. 12. Lesson: AR is Different
Rendering Pipeline
Augmented Reality pipeline
Presents the Virtual world to the Real world
One-way process
Also presents the Real world to the Virtual world
Round-trip process
13. Rendering Pipeline
14. Augmented Reality Pipeline
15. Lesson: Bridging Worlds
16. Lesson: The Tech Demo Drop
17. Sketch AR
[ Demo of Augmented Reality Hand Sketching Games, seconds 5 35 ]
18. Lesson: Bridging Worlds
19. Lesson: Bridging Tech Worlds
Model Transform
Lighting
CameraTransform
Viewport
Transform
3D Virtual Scene
Screen space (2D viewport)
20. Lesson: Bridging Tech Worlds
Model transform
Model Transform
Lighting
CameraTransform
Viewport
Transform
Screen space (2D viewport)
3D Virtual Scene
Real Scene
(the world)
Real Object
transform
HITLAB: AR Pancho project
21. Lesson: Bridging Tech Worlds
Lighting
Model Transform
Lighting
CameraTransform
Viewport
Transform
Screen space (2D viewport)
3D Virtual Scene
Real Scene
(the world)
Real Object
transform
Real lighting
VTT: Photorealistic rendering for Augmented reality
22. Lesson: Bridging Tech Worlds
Camera transform
Model Transform
Lighting
CameraTransform
Viewport
Transform
Screen space (2D viewport)
3D Virtual Scene
Real Scene
(the world)
Real Object
transform
Real camera
transform
Real lighting
23. Lesson: Bridging Tech Worlds
The live feed
Model Transform
Lighting
CameraTransform
Viewport
Transform
Screen space (2D viewport)
3D Virtual Scene
Real Scene
(the world)
Real Object
transform
Real lighting
Real camera
transform
24. Lesson: Bridging Tech Worlds
25. Lesson: Bridging Tech Worlds
Yawn!
I did that back in 68
26. Lesson: Choosing a Platform
1968
1980
2007
GDC 2009
27. Lesson: Choosing a Platform
1968
1980
2007
28. Lesson: Choosing a Platform
1968
1980
2007
Kinect AR: Augmented Reality Magic Mirror
29. Lesson: Choosing a Platform
1968
I cant see a thing!
1980
2007
GDC 2009
30. Lesson: Choosing a Platform
Mobile Phones!
1968
1980
2007
GDC 2011
AR Enabled
GDC 2009
31. Lesson: Sensor based AR
Image source : ompactGames
Image source: borntechie
32. Lesson: Sensor based AR
Lucky shot
Not so Lucky
33. Lesson: CV based AR
34. Lesson: Tangible Interaction
Printed Markers
Yeah, lets add interaction!
You again..
I did that back in 98
35. Lesson: Tangible Interaction
Here comes the sketch with the steps to print the marker
Printed Markers
You are FIVE steps away from an AR tangible experience
36. Lesson: In-Place AR
Sketch a
Marker
LINK: Shape recognition and pose estimation for mobile augmented reality
37. Lesson: In-Place AR
Sketch theContent!
38. Lesson: Bridging Worlds
39. Lesson: Geo-Social is Different
40. Paranormal Activity
41. 42. Geo-Social Under the Hood
GIS
Client OS
Analytics
Game Engine
Server Hosting
Broken Headlight
Transactional Database
Monetization
43. Calls Unwelcome at 4am
Server Alerts
44. ETL:
Leader
Boards
Courtesy of Jeff Arenberg,
Our Lead Platform Engineer
45. Data
Analysis:
Spells Cast,
by Location
(USA only)
Image by GeoIQ
from FortiusOne
46. 47. Lesson: Making the Witches Brew
48. Lesson: Embrace the Tech Soup
49. Tech Soup Client Example
Calling the Android SDK from Unity
50. Unity C#
51. C++ JNI
52. Java Android SDK
53. Taking the Purple Pill
Lessons Learned Building a Platform for Geo-Social Augmented Reality Games
54. Taking the Purple Pill

• AR is Different

55. Bridging Worlds