KIT – Die Forschungsuniversität in der Helmholtz-Gemeinschaft
Intelligente Prozessautomation und Robotik (IPR) ––– Institut für Anthropomatik und Robotik (IAR) ––– Fakultät für Informatik
www.kit.edu
Robotics in Silicon Valley
Prof. Dr.-Ing. Torsten Kröger
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
2
Content
• Non-exhaustive overview of US robotics
activities
• Mostly based on personal experience
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
3
Outline
(Un)related Stories from Silicon Valley
Robot Arms and Grasping
Robots in Logistics
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
4
Open Source Robotics Foundation (OSRF)
• Willow Garage spinoff (May 2012)
• Non-profit organization
• Maintains ROS and Gazebo
• CEO: Brian Gerkey
• Current focus on developing ROS 2.0
• No safety, no proper real-time
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
5
Open Source Robotics Corporation (OSRC)
• Taxable subsidiary of OSRF (Sep 2016)
• For-profit
• Initially funded by Toyota Research Institute
• OSRF will keep holding software copyright
• New website: http://www.openrobotics.org
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
6
Southwest Research Institute
• Initiated ROS industrial (ROS-I)
• Non-safe, non-real-time connection to COTS
industrial robots
• Head of ROS-I: Shaun Edwards
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
7
RTI – Real-Time Innovations
RTI Connext DDS
Distributed real-time middleware
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
8
Toyota Research Institute (TRI)
• R&D in multiple robtoics domains:
• Self-driving
• Production and manufacturing
• Autonomous mobile manipulation
• CEO: Gil Pratt
• CTO: James Kuffner
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
9
Toyota Research Institute (TRI)
• HSR, Human Support
Robot
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
10
Huawei Technologies
• Mobile robot for kids and education
• Strong emphasis on social human-robot
interaction
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
11
Mayfield Robotics (Bosch)
• Kuri
• Home robot
• Announced price: $699
• Inherently safe
• Focus on social human-
robot interaction
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
12
Mayfield Robotics (Bosch)
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
13
Mayfield Robotics (Bosch)
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
14
Mayfield Robotics (Bosch)
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
15
Mayfield Robotics (Bosch)
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
16
Mayfield Robotics (Bosch)
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
17
Mayfield Robotics (Bosch)
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
18
Mayfield Robotics (Bosch)
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
19
Savioke
• Delivery robot: Relay
• Hotels, logistics, home
• Founder and CEO: Steve Cousins
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
20
Savioke
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
21
Silicon Valley Robotics
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
22
Verb Surgical
• F(o)unded by J&J and Alphabet
• „Surgery 4.0“: digital surgery platform
• Robotics
• Visualization
• Advanced instrumentation
• Data analytics
• Connectivity
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
23
Auris Health (formerly Surgical Robotics)
• Founded by Fed Moll
• Monarch: Auris Robotic
Endoscopy System
• Out of stealth in 2018
• Acquisition of Hansen
Medical
• Device FDA approved
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
24
Intuitive Surgical
• da Vinci Surgical System is still the sole product
• „Major“ product upgrade announced
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
25
SRI International
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
26
SRI International
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
27
openAI
• F(o)unded by Elon Musk in 2015
• Non-profit
• Mission: „Friendly artificial intelligence“
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
28
• Learning robot motions from human
demonstrations in VR
• Founder: Pieter Abbeel
Covariant.AI
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
29
• On-demand supply-chains that enable
profitable, one-hour delivery for online
grocers.
• Based in Israel
• Investors from California
Commonsense Robotics
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
30
Symb.io
• Machine learning for robotics
• Still in stealth mode
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
31
Magic Leap
• Augmented realty devices and eco system
• Based in FL, CA, ,Switzerland, and Israel
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
32
ARRAIY
• Content creation for AR and VR using computer
vision and deep learning
• Still in stealth phase
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
33
Lighthouse
• Part of the Playground Global incubator
• Deep learning for visual object recognition
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
34
Lighthouse
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
35
Suitable Technologies
• F(o)under: Scott Hassan
• Tele-presence robots
• Beam Pro
• Beam Plus
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
36
Outline
(Un)related Stories from Silicon Valley
Robot Arms and Grasping
Robots in Logistics
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
37
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
38
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
39
Alphabet
• Robotics acquisitions 2013 and 2014
Holomni
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
40
Interview from Dec 2016
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
41
June 2017
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
42
X
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
43
Learning Hand-Eye Coordination
Input
512x512 pixels
Finger position
Output
Task space
gripper motion
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
44
800,000 attempts
14 robot arms
Two months
CNNs for deep
reinforcement learning
Shared models
Learning Hand-Eye Coordination
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
45
Data Driven Robotics
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
46
Different Objects, Different Grasping Strategies
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
47
Different Objects, Different Grasping Strategies
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
48
Different Objects, Different Grasping Strategies
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
49
New (Unknown) Objects
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
50
X, Google Research
Next Generation Arm Farm
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
52
DexNet 2.0 (UC Berkeley)
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
53
Outline
(Un)related Stories from Silicon Valley
Robot Arms and Grasping
Robots in Logistics
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
54
RightHand Robotics
• Based in Massachusetts
• Autonomous picking for e-commerce order
fulfillment
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
55
Kinema Systems
• Robot paletizing
• 3D vision using deep learning
• Founder: Sachin Chitta
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
56
Kinema Systems
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
57
Fetch Robotics
• Autonomous mobile robots for warehouses
• Founder: Melonee Wise
• ROS
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
59
Fetch Robotics
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
61
Outline
(Un)related Stories from Silicon Valley
Robot Arms
Robots in Logistics
Thank you!
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
63
De-hyping AI
1. Machine learning means learning from data; AI
is a buzzword
2. Machine learning is about data and algorithms,
but mostly data
3. Unless you have a lot of data, you should stick
to simple models
Prof. Dr.-Ing. Torsten Kröger
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
64
Simplified: The “Four Revolutions”
1. Mechanical hardware
2. Electrical hardware
3. Software
4. Data
Prof. Dr.-Ing. Torsten Kröger
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
65
Simplified: The “Four Revolutions”
1. Mechanical hardware
2. Electrical hardware
3. Software
4. Data
Prof. Dr.-Ing. Torsten Kröger
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
66
Simplified: The “Four Revolutions”
1. Mechanical hardware
2. Electrical hardware
3. Software
4.Data
Prof. Dr.-Ing. Torsten Kröger
Institute for Anthropomatics and Robotics (IAR)
Intelligent Process Control and Robotics (IPR)
67
Simplified: The “Four Revolutions”
1. Mechanical hardware
2. Electrical hardware
3. Software
4.Data
Prof. Dr.-Ing. Torsten Kröger