May 16, 2015
.
Social Robotics
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 2/27...
2/27
.
Social Robotics is ...• ... when robots replace people in social networks
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 3/27...
3/27
.
.... that was a JOKE! (in case you have not figured it out)
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 4/27...
4/27
.
(the real) Social Robotics
02 E.Berger+4 "Inferring Guidance Information in Cooperative Human-Robot Tasks" HUMANOIDS (2013)
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 5/27...
5/27
.
Social Robotics in a Nutshell.The Problem.....
.... is that search space in a robot's decision making process is too big
.
... The Solution...
..
.
... is to reduce search space via social interactions betweenrobots and humans
• a fundamentally distinct approach to robotics 02 04 05
• social robotics is a new area 03 07, but tradition is still strong 06
• this paper: the same basic idea applied to software automation02 E.Berger+4 "Inferring Guidance Information in Cooperative Human-Robot Tasks" HUMANOIDS (2013)
04 A.Thomas+1 "Reinforcement Learning with Human Teachers..." 21st AAAI (2006)
05 H.Suay+1 "Effect of Human Guidance and State Space Size ...." IEEE RO-MAN (2011)
03 W.Knox+2 "Training a Robot via Human Feedback: A Case Study" Social Robotics (2013)
07 B.Mutlu+4 "Social Robotics" Springer LNAI vol.7072 (2011)
06 P.Corke+0 "Robotics, Vision and Control" Springer (2011)
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 6/27...
6/27
.
Hardware vs Software Robots
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 7/27...
7/27
.
Software Robots: the Missing Topic
01 "Software Robots: The Long Tail of Automation" http://www.wired.com (2013)
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 8/27...
8/27
.
Robots and ReBots as Complexity• software robots (rebots) are all about knowledge management• note: the same basic approach can be applied both to hardware and software
A very complex system
A less complex system
Tell what to do
Robot
Human
Search the space
Robot
Human
Search the space What
should I do?
Guide through feedback
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 9/27...
9/27
.
The Hardware and Software Stories
1. hardware: we always know exactly what the job is◦ software: we know the data, but we do not know what knowledge it contains
2. hardware: training is difficult because robots make decisions(humans are guides)◦ software: training it easy since humans make decisions◦ ... but robots have to visualize the outcome properly
3. hardware: long-term jobs are rare -- tasks are normally specific and now◦ software: long-term, even continuous, is the intended mode of operation◦ hence the ReBot -- recommendation bot is possible◦ recommendations can take time to be generated
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 10/27...
10/27
.
Similarities and Differences• ReBot is centered around a classification problem 08
• ReBots do not have or need eyes
• ReBots are dumb, humans make decision
Generic Use
Teaching, Guidance Reasoning
Human Role
Social Robotics
Wide range of behavior
Reinforced Learning
YES. Vision, recognition Guide only
The Rebot (proposal)
Any kind of context
Bayesian Classification
NO Not needed
Guide and decision - maker
08 C.Manning+3 "Introduction to Information Retrieval" Cambridge University Press (2008)
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 11/27...
11/27
.
ReBot the Recommendation Bot
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 12/27...
12/27
.
ReBot versus Tradition• in a way, ReBot is an ideal context manager -- compared to existing tools 09
• note: multiple items is when more than one item are linked by some kind ofstructure -- ReBots use metromaps 11
Multiple Items? Visual?
Underlying Structure? Learning?
Traditional Search NO NO NO NO
Facetted Search NO NO YES NO
Advanced Tools / Others NO YES YES YES
Rebot (the proposal) YES YES YES YES
09 M.Mas+0 "Faceted semantic search for personalized social search" Cornell University (2011)
11 K.Nesbitt+0 "Getting to more abstract places using the metro map metaphor" IV Conf. (2004)
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 13/27...
13/27
.
ReBot: Components
Rebot
(careless) Input
Human Human
{structure }
(pinpoint) Select
Browse (or use otherwise)
Some Knowledge
(folksonomies, knowledge bases, databases, indexes, ontologies, etc.)
(metromaps )
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 14/27...
14/27
.
ReBot: Where is The Originality?
1. folksonomy-style input is OK
◦ folksonomy means (1) many contributors, (2) no rules, (3) careless input 10
2. metromaps as the best visual interface 12
◦ traditional research only uses graphs,, metromaps are very very different◦ new layout engines are proposed -- out of scope here 13
3. recommendation engine based on classification -- hence the ReBot◦ classes are based on trains and stations in metromaps
4. social scalability 10
◦ allowing for large-scale social collaboration on publically shared metromaps
10 myself+0 "MetroMaps versus Facets: What Exactly is the Ontological Context?" IEICE AI研究会 (November 2013)
12 myself+0 "...the Most Cost Effective Method in Browser-Based Visualizations..." IIEEJ Visual Computing Workshop (2013)
13 myself "Rebot Project Page" http://www.github.com/maratishe/rebot (current)
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 15/27...
15/27
.
ReBot: Simple Implementation
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 16/27...
16/27
.
ReBot: Simple Implementation
• the simple design is:
1. learning during input via recommendation and feedback
• on input, ReBot recommends which trains to assign your paper to• you provide feedback by (possibly) picking an unexpected order
2. classification design which would make sure that ReBot getsbetter with time• Naive Bayes classifier is used
• but the design is unusual -- one item can belong to multiple classes
• next page shows that the engine gets better with time
3. build a great visual interface based onmetromaps and rings• metromaps: the traditional concept of metromaps
• rings: simpler 3D visual aggregates of items
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 17/27...
17/27
.
ReBot Part 1: Folksonomical Input• (1) read the item, (2) select tags from the order recommended by ReBot, (3) letReBot learn from your selection -- not all assignments need learning
1
2
2
3 3
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 18/27...
18/27
.
ReBot Part 2: Recommendation
0 5.2 10.4 15.6 20.8 26Time/Learning Sequence
0
4
8
12
16
20
Rebo
t Ord
er o
f Use
r Sel
ectio
n
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 19/27...
19/27
.
ReBot Part 3: Visual Interface• note: layouts are non-traditional 13 -- more suited to browser viewing
• note 2: rings are simplified metromaps -- like Tokyo city with its Yamanote ring
13 myself "Rebot Project Page" http://www.github.com/maratishe/rebot (current)
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 20/27...
20/27
.
ReBot.Papers: A Working Example
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 21/27...
21/27
.
ReBot.Papers: The Objective
• a ReBot which wouldmanage my papers◦ in submission, rejected, passed, ...
• a very powerful visual browsing function -- metromaps
• ReBot would recommend new stuff◦ similar papers in the Internet, references, etc.◦ recommendation to add more papers to the same train◦ recommendations for a more optimal metromaps for my papers
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 22/27...
22/27
.
ReBot.Papers: Smarter Interface• sorry, will omit small details ... but will show a demo!
Surface
Rebot Human
Knowledge Base (the data itself)
Maintain
Selectors (trains) Write
The Raw Metromap (papers)
Metromap (groupings) Create
Browse Depth
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 23/27...
23/27
.
Next Step: Collaborating ReBots
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 24/27...
24/27
.
ReBot in the Cloud• the screenshot: ReBot implemented asChrome Extension• with cloud storage there is no need for web servers -- APIs aresufficient
• makes large-scale collaboration possible -- same for recommendations, etc.
Places/members
Knowledge(in the wild)
{structure} (shared access)
Cloud Storage
Visual interface
Crawl, recommend,
maintain
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 25/27...
25/27
.
Wrapup
• software robots are proposed as recommendation bots◦ share the basic idea with social robotics
• simple design and a more complex working example are presented
• the socially scalable version is on its way
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 26/27...
26/27
.
That’s all, thank you ...
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 27/27...
27/27
.
[01] (2013)Software Robots: The Long Tail of Automationhttp://www.wired.com
[02] E.Berger+4 (2013)Inferring Guidance Information in Cooperative Human-Robot TasksHUMANOIDS
[03] W.Knox+2 (2013)Training a Robot via Human Feedback: A Case StudySocial Robotics
[04] A.Thomas+1 (2006)Reinforcement Learning with Human Teachers...21st AAAI
[05] H.Suay+1 (2011)Effect of Human Guidance and State Space Size ....IEEE RO-MAN
[06] P.Corke+0 (2011)Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 27/27
...
27/27
.
Robotics, Vision and ControlSpringer
[07] B.Mutlu+4 (2011)Social RoboticsSpringer LNAI vol.7072
[08] C.Manning+3 (2008)Introduction to Information RetrievalCambridge University Press
[09] M.Mas+0 (2011)Faceted semantic search for personalized social searchCornell University
[10] myself+0 (November 2013)MetroMaps versus Facets: What Exactly is the Ontological Context?IEICE AI研究会
[11] K.Nesbitt+0 (2004)Getting to more abstract places using the metro map metaphor
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 27/27...
27/27
.
IV Conf.
[12] myself+0 (2013)...the Most Cost Effective Method in Browser-Based Visualizations...IIEEJ Visual Computing Workshop
[13] myself (current)Rebot Project Pagehttp://www.github.com/maratishe/rebot
[14] myself (current)Graphviz: Graph Visualization Softwarehttp://www.graphviz.org/
Marat Zhanikeev -- [email protected] -- ReBoT: a Recommendation-Based Software Robot -- http://tinyurl.com/marat140213 -- 27/27...
27/27