Top Banner
Simon Lia-Jonassen CHATBOTS ARE COMING!
18

Chatbots are coming!

Mar 20, 2017

Download

Technology

Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Chatbots are coming!

Simon Lia-Jonassen

CHATBOTS ARE COMING!

Page 2: Chatbots are coming!

Why now?

• Excessive use of messaging services.• Market transition from Apps to IM.• Theoretical advancements in KD, DM,

ML and IR.• Massive amounts of information.• Nearly unlimited computational capacity.

Page 3: Chatbots are coming!

Messaging service boomhttp://w

ww

.slideshare.net/chatbotscomm

unity/2016-chatbots-com

munity-sections-61784553

• Motivators: free, effortless, fast, asynchronous, persistent, searchable, etc.

Page 4: Chatbots are coming!

Messaging as a platform

Page 5: Chatbots are coming!

Business model

• Apple Siri, Amazon Echo, Facebook M, Google Now, Microsoft Xiaoice/Cortana, and hundreds of startups.

Page 6: Chatbots are coming!

Request understanding and answering

http://www.slideshare.net/DADENMEDIA/introduction-to-chatbots

Page 7: Chatbots are coming!

Answering strategies

• Retrieval based methods– use a set of predefined responses.– E.g., search or template based methods

• Generation based methods– generate a new response from scratch.– E.g., ontology or deep learning based methods

• Multi-turn versus single-turn dialogues

Page 8: Chatbots are coming!

Simple chatbots

• IR and rule based methods: – Patterns, templates, similarity…

• Example libraries:– https://github.com/gunthercox/ChatterBot– https://sourceforge.net/projects/chatscript

• See also https://www.youtube.com/watch?v=IjKDO3ThlSc

– http://www.alicebot.org/aiml.html

Page 9: Chatbots are coming!

Traditional dialogue systems

• NLP, knowledge bases, state management.• Example libraries:

• http://www.ling.gu.se/projekt/trindi/trindikit/– A toolkit for building dialogue systems. Support for speech recognition, text-

to-speech synthesis, natural language understanding and natural language generation.

• http://www.ling.gu.se/grupper/dialoglab/godis/– A dialogue system implemented with TrindiKit– Can handle grounding, implicature, correction, clarification, etc.– See also

http://dspace.ou.nl/bitstream/1820/5390/1/INF_20140617_Woudenberg.pdf

• https://github.com/google/cayley– Inspired by the graph database behind Freebase and

Google's Knowledge Graph.

Page 10: Chatbots are coming!

Deep learning based systems

• Lots of ongoing research on different NNapproaches for question answering:– Convolutional, recursive or recurrent neural networks.

• General trend:– Lots of training data and processing power, and deep NN.

• Starting points:– http://www.hangli-hl.com/recent-publications.html

• http://www.hangli-hl.com/uploads/3/1/6/8/3168008/cikm_2015_hang_li.pdf

– http://dblp.uni-trier.de/pers/hd/t/Tian:Fei

Page 11: Chatbots are coming!

Autoencoders

• Read an input sentence one character/token at a time and produce another sentence one character/token at a time.

Page 12: Chatbots are coming!

Autoencoders

Page 13: Chatbots are coming!

Autoencoders

• Example libraries:– https://www.tensorflow.org/versions/r0.9/tutorials/seq2seq

• See also http://arxiv.org/pdf/1506.05869v2.pdf– https://github.com/karpathy/char-rnn– http://research.baidu.com/warp-ctc

• Further reading:– https://arxiv.org/pdf/1503.02364v2.pdf – http://arxiv.org/pdf/1409.3215v3.pdf– http://colah.github.io/posts/2015-08-Understanding-LSTMs– http://karpathy.github.io/2015/05/21/rnn-effectiveness– https://skillsmatter.com/skillscasts/6611-visualizing-and-understanding-

recurrent-networks

Page 14: Chatbots are coming!

SAAS products such as wit.ai

• Techniques:– Extract certain predefined entities, intent or sentiment.– Define and extract own entities.

• See also:– http://blogs.aspect.com/comparison-of-bot-frameworks-on-the-market– https://stanfy.com/blog/advanced-natural-language-processing-tools-for-bot-makers

Page 15: Chatbots are coming!

Recap – the main components

1. Input analyzer– NLP, syntactic, semantic, pragmatic, and sentiment analysis,

categorization, entity recognition, etc.2. Dialogue manager

– The current state, history, etc.

3. Specific agent(s)– Task execution, querying, etc.

4. Answer generator

Page 16: Chatbots are coming!

Interesting use cases

• Technical support• Virtual sales• Marketing research• Personal assistance• Application controls

– e.g., Appear.in• M2M/IOT interface

Page 17: Chatbots are coming!

A glimpse into the future

Page 18: Chatbots are coming!

Thank you! Questions?