The Last Stop before Autonomous Navigation: Augmented Reality using Microsoft HoloLens by Samuel R. Pecota eNavigation Underway North America 2017
The Last Stop before Autonomous Navigation:
Augmented Reality using Microsoft HoloLens
bySamuel R. Pecota
eNavigation Underway North America 2017
The coming extinction of the merchant mariner
eNavigation Underway North America 2017
• Merchant sailors have been plying the oceans for over 3000 years
• The job wasn’t all that romantic though
• The work was, and still is, generally hard, dirty, and dangerous
• Autonomous cargo vessels of the future
• Rolls Royce• Kongsberg
But perhaps for not much longer…
eNavigation Underway North America 2017
• People will still be going to sea, but only for fun
• Not for the purpose of moving cargo from Point A to Point B
Unless you are a paying passenger of course…
eNavigation Underway North America 2017
• Which could still be set up for autonomous navigation too!
…or you have your own boat
eNavigation Underway North America 2017
• On the surface, underwater and in the air
The world’s navies are also going autonomous
eNavigation Underway North America 2017
• No one can say how long it will last…
• Or exactly what problems will need to be overcome
But there will be a transition period
eNavigation Underway North America 2017
• Super VTS• Direct, daily
fleet operational control
• A human always still on duty
Remotely controlled vessels may be a first step toward full autonomy
eNavigation Underway North America 2017
• Wire splicing?• Knot tying?• Line handling?• Sight reduction?
• All becoming obsolete skills
What does this mean for the future of Maritime Education and Training (MET)?
eNavigation Underway North America 2017
• Modern merchant bridge
• Modern warship bridge
Evolution not Revolution
eNavigation Underway North America 2017
• eNavigation lecture 2010
• Docking in Honolulu
MET is not accomplished overnight
eNavigation Underway North America 2017
• Paper chart navigation• ECDIS and radar
navigation• What is next?
One way might be to simplify the navigational task
eNavigation Underway North America 2017
• Cosco Busan (2007)• USS Fitzgerald (2017)
Navigational skills are in a state of slow decline
eNavigation Underway North America 2017
• Better electronics perhaps?
• Immersion without distraction
• Eyes out the window!
What can be done to fix this problem?
eNavigation Underway North America 2017
Microsoft HoloLens
eNavigation Underway North America 2016
• First announced Jan 2015
• We turned it into a navigational tool
HUD Holo (Oct 2016)
eNavigation Underway North America 2016
HoloLens HUD for Maritime (2017)
eNavigation Underway North America 2017
• Eyes out the window!
• Easy to learn and use
• Immediate and constant position information
• Enhanced situational awareness
Advantages of HoloLens HUD
eNavigation Underway North America 2017
• ECDIS interface• Display AIS targets in
proper location and orientation
• Provide collision avoidance advice
• Direct communication with autonomous vessels
More advantages (still to be developed)
eNavigation Underway North America 2017
Come to starboardyou idiot human!
I told himbut he’s notlistening!
• Full autonomy is the end game
• How we get there safely is critical
• HoloLens for HUD Maritime could help
Conclusion
eNavigation Underway North America 2017
Thank you!
eNavigation Underway North America 2017
eNavigation Underway North America 2017