Page 1
KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
Intelligente Prozessautomation und Robotik (IPR) ––– Institut für Anthropomatik und Robotik (IAR) ––– Fakultät für Informatik
www.kit.edu
Robotics in Silicon Valley
Prof. Dr.-Ing. Torsten Kröger
Page 2
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
2
Content
• Non-exhaustive overview of US robotics
activities
• Mostly based on personal experience
Page 3
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
3
Outline
(Un)related Stories from Silicon Valley
Robot Arms and Grasping
Robots in Logistics
Page 4
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
4
Open Source Robotics Foundation (OSRF)
• Willow Garage spinoff (May 2012)
• Non-profit organization
• Maintains ROS and Gazebo
• CEO: Brian Gerkey
• Current focus on developing ROS 2.0
• No safety, no proper real-time
Page 5
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
5
Open Source Robotics Corporation (OSRC)
• Taxable subsidiary of OSRF (Sep 2016)
• For-profit
• Initially funded by Toyota Research Institute
• OSRF will keep holding software copyright
• New website: http://www.openrobotics.org
Page 6
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
6
Southwest Research Institute
• Initiated ROS industrial (ROS-I)
• Non-safe, non-real-time connection to COTS
industrial robots
• Head of ROS-I: Shaun Edwards
Page 7
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
7
RTI – Real-Time Innovations
RTI Connext DDS
Distributed real-time middleware
Page 8
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
8
Toyota Research Institute (TRI)
• R&D in multiple robtoics domains:
• Self-driving
• Production and manufacturing
• Autonomous mobile manipulation
• CEO: Gil Pratt
• CTO: James Kuffner
Page 9
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
9
Toyota Research Institute (TRI)
• HSR, Human Support
Robot
Page 10
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
10
Huawei Technologies
• Mobile robot for kids and education
• Strong emphasis on social human-robot
interaction
Page 11
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
11
Mayfield Robotics (Bosch)
• Kuri
• Home robot
• Announced price: $699
• Inherently safe
• Focus on social human-
robot interaction
Page 12
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
12
Mayfield Robotics (Bosch)
Page 13
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
13
Mayfield Robotics (Bosch)
Page 14
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
14
Mayfield Robotics (Bosch)
Page 15
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
15
Mayfield Robotics (Bosch)
Page 16
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
16
Mayfield Robotics (Bosch)
Page 17
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
17
Mayfield Robotics (Bosch)
Page 18
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
18
Mayfield Robotics (Bosch)
Page 19
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
19
Savioke
• Delivery robot: Relay
• Hotels, logistics, home
• Founder and CEO: Steve Cousins
Page 20
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
20
Savioke
Page 21
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
21
Silicon Valley Robotics
Page 22
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
22
Verb Surgical
• F(o)unded by J&J and Alphabet
• „Surgery 4.0“: digital surgery platform
• Robotics
• Visualization
• Advanced instrumentation
• Data analytics
• Connectivity
Page 23
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
23
Auris Health (formerly Surgical Robotics)
• Founded by Fed Moll
• Monarch: Auris Robotic
Endoscopy System
• Out of stealth in 2018
• Acquisition of Hansen
Medical
• Device FDA approved
Page 24
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
24
Intuitive Surgical
• da Vinci Surgical System is still the sole product
• „Major“ product upgrade announced
Page 25
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
25
SRI International
Page 26
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
26
SRI International
Page 27
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
27
openAI
• F(o)unded by Elon Musk in 2015
• Non-profit
• Mission: „Friendly artificial intelligence“
Page 28
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
28
• Learning robot motions from human
demonstrations in VR
• Founder: Pieter Abbeel
Covariant.AI
Page 29
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
29
• On-demand supply-chains that enable
profitable, one-hour delivery for online
grocers.
• Based in Israel
• Investors from California
Commonsense Robotics
Page 30
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
30
Symb.io
• Machine learning for robotics
• Still in stealth mode
Page 31
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
31
Magic Leap
• Augmented realty devices and eco system
• Based in FL, CA, ,Switzerland, and Israel
Page 32
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
32
ARRAIY
• Content creation for AR and VR using computer
vision and deep learning
• Still in stealth phase
Page 33
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
33
Lighthouse
• Part of the Playground Global incubator
• Deep learning for visual object recognition
Page 34
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
34
Lighthouse
Page 35
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
35
Suitable Technologies
• F(o)under: Scott Hassan
• Tele-presence robots
• Beam Pro
• Beam Plus
Page 36
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
36
Outline
(Un)related Stories from Silicon Valley
Robot Arms and Grasping
Robots in Logistics
Page 37
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
37
Page 38
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
38
Page 39
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
39
Alphabet
• Robotics acquisitions 2013 and 2014
Holomni
Page 40
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
40
Interview from Dec 2016
Page 41
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
41
June 2017
Page 42
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
42
X
Page 43
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
43
Learning Hand-Eye Coordination
Input
512x512 pixels
Finger position
Output
Task space
gripper motion
Page 44
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
44
800,000 attempts
14 robot arms
Two months
CNNs for deep
reinforcement learning
Shared models
Learning Hand-Eye Coordination
Page 45
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
45
Data Driven Robotics
Page 46
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
46
Different Objects, Different Grasping Strategies
Page 47
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
47
Different Objects, Different Grasping Strategies
Page 48
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
48
Different Objects, Different Grasping Strategies
Page 49
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
49
New (Unknown) Objects
Page 50
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
50
X, Google Research
Page 51
Next Generation Arm Farm
Page 52
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
52
DexNet 2.0 (UC Berkeley)
Page 53
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
53
Outline
(Un)related Stories from Silicon Valley
Robot Arms and Grasping
Robots in Logistics
Page 54
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
54
RightHand Robotics
• Based in Massachusetts
• Autonomous picking for e-commerce order
fulfillment
Page 55
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
55
Kinema Systems
• Robot paletizing
• 3D vision using deep learning
• Founder: Sachin Chitta
Page 56
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
56
Kinema Systems
Page 57
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
57
Fetch Robotics
• Autonomous mobile robots for warehouses
• Founder: Melonee Wise
• ROS
Page 58
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
59
Fetch Robotics
Page 59
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
61
Outline
(Un)related Stories from Silicon Valley
Robot Arms
Robots in Logistics
Page 60
Thank you!
[email protected]
Page 61
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
63
De-hyping AI
1. Machine learning means learning from data; AI
is a buzzword
2. Machine learning is about data and algorithms,
but mostly data
3. Unless you have a lot of data, you should stick
to simple models
Prof. Dr.-Ing. Torsten Kröger
Page 62
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
64
Simplified: The “Four Revolutions”
1. Mechanical hardware
2. Electrical hardware
3. Software
4. Data
Prof. Dr.-Ing. Torsten Kröger
Page 63
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
65
Simplified: The “Four Revolutions”
1. Mechanical hardware
2. Electrical hardware
3. Software
4. Data
Prof. Dr.-Ing. Torsten Kröger
Page 64
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
66
Simplified: The “Four Revolutions”
1. Mechanical hardware
2. Electrical hardware
3. Software
4.Data
Prof. Dr.-Ing. Torsten Kröger
Page 65
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
67
Simplified: The “Four Revolutions”
1. Mechanical hardware
2. Electrical hardware
3. Software
4.Data
Prof. Dr.-Ing. Torsten Kröger