Natural Language Understanding in Web Mapping Applications · „zoom to {"location“: „Antwerp“} antwerp“ Used to zoom in or zoom out or to zoom to a location. example: ViewProcessor

© con terra GmbH

Ralf Hackmann

r.hackmann@conterra.de

www.conterra.de

Natural Language Understanding in Web Mapping Applications

What if your map talked back to you?

© con terra GmbH

MAKETHE SCREEN

„Hello map.apps,

show me your maps!“

© con terra GmbH

Key Challenge: generate map interaction from spoken (written) words!

Natural Language Understanding

© con terra GmbH

Artificial Intelligence

Machine Learning

Deep Learning

NLU

The context…

© con terra GmbH

0

5

10

15

20

25

30

18 November 2010 01 April 2012 14 August 2013 27 December 2014 10 May 2016 22 September 2017 04 February 2019

Why now? ….Progress of technology!

Google's speech recognition error rate

© con terra GmbH

Speech Controller

Uses SpeechSynthesis (Text-to-Speech)

of the Web Speech API to output the

spoken response.

Rasa Controller

Recognizes the intent and entities. .

Named enitites are real-world objects

like persons or places.

Speech Recognition

Uses SpeechRecognition to

recognize the spoken word

and transcribe it to text

Processor Chain

Calls all processors.

How it works…in 4 basic steps!

{"location“: „Antwerp“}„zoom toantwerp“

Used to zoom in or zoom out orto zoom to a location.

example: ViewProcessor „Here is your location in antwerp“

Zoom toAntwerp „zoom to

antwerp“

© con terra GmbH

SpeechProcessor

Welcomes the user.

GreetingsProcessor

Helps the user.

HelpProcessor

For the amusement of the user.

EasterEggProcessor01

03

02 Enablels and disables layers.

Changes the basemap.

MapContentProcessor

Used to zoom in or zoom out or tozoom to a location.

ViewProcessor

Uses the OpenWeatherMap API toprovide weather information to theuser.

WeatherProcessor05

07

06 Gives the user additional

information.

InformationProcessor

Searches for features close to the user.

NearMeProcessor

Used to determine the user's position.

LocateMeProcessor09

11

10

Thanks the user.

ThankYouProcessor04 Prints the map.

PrintProcessor08 Provides voice output.

12

The Processor Chains

© con terra GmbH

Easy integration of processors in map.apps via “bundles”

Processor-Bundles

© con terra GmbH

„Show mesatellite images“

GIS Newbie„Switch to aerial view“

GIS Expert„Enable the

protected sites layer“

GIS Expert„Show me all protected sites“

GIS Rookie

Challenges: Different users – different wording!

© con terra GmbH

Conversation with Smart Machines will become more and morepart of our interaction with technologie

And why not also in WebGIS, for inst. INSPIRE Applications?

Bring INSPIRE into easy use!

10

And…what about INSPIRE?

© con terra GmbH

MAKETHE SCREEN

Demohttps://youtu.be/E

ItTpN1Ld5I

© con terra GmbH

con terra – Gesellschaft für Angewandte Informationstechnologie mbHMartin-Luther-King-Weg 2048155 MünsterTelefon +49 89 207 005 2200info@conterra.de

12

Visit us at our con terra stand G3…and talk to map.apps

Demo-movie (english): https://youtu.be/EItTpN1Ld5ILive-presentation-movie (german) https://youtu.be/okUzHlup10o

© con terra GmbH