Top Banner
LightWeightRobotIGT – Interface Concept Tutorial Sebastian Tauscher Institute of Mechatronic Systems Leibniz Universität Hannover
17

Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

Mar 27, 2021

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

LightWeightRobotIGT – Interface Concept Tutorial

Sebastian Tauscher Institute of Mechatronic Systems Leibniz Universität Hannover

Page 2: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

2

Outline LightWeightRobotIGT – Interface Concept

Sebastian Tauscher - Institute of Mechatronic Systems

Introduction

Interface Concept

Visualisation

State control

State machine

Page 3: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

3

Motivation

Integration of robots into IGT systems

Time consuming process

Customized solution for each project

No widely accepted standard

Future vision

Standardized interface

Easy integration

LightWeightRobotIGT – Interface Concept

[Source: KUKA]

[Source: openIGTlink.org]

Sebastian Tauscher - Institute of Mechatronic Systems

Page 4: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

4

State of the art

Current research

IHE & DICOM for surgery

OR.NET

OpenIGTLink

Growing importance

Unmet needs

No widely accepted standard for inter device communication

Aim

Integration concept for a robot into IGT system

LightWeightRobotIGT – Interface Concept

[Source: KUKA]

[Source: openIGTlink.org]

Sebastian Tauscher - Institute of Mechatronic Systems

Page 5: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

5

Outline LightWeightRobotIGT – Interface Concept

Sebastian Tauscher - Institute of Mechatronic Systems

Introduction

Interface Concept

Visualisation

State control

State machine

Page 6: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

6

Interface – Concept LightWeightRobotIGT – Interface Concept

State control Visualisation

Robot Control

Robot as element of IGT system

Separate visualisation & state control interface

OpenIGTLink based

Small foot print & widely used

Open protocol for IGT

State machine for intuitive and direct control

OpenIGTLink OpenIGTLink

OpenIGTLink OpenIGTLink

Sebastian Tauscher - Institute of Mechatronic Systems

Page 7: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

7

Robot Control

Interface – Visualisation

Requirements

Real-time ability > 30 Hz

Latency < 100 ms

Unidirectional

Data type

Transformation matrices

Image space or robot coordinate system

End-effector or joint pose

OpenIGTLink TRANSFORM

LightWeightRobotIGT – Interface Concept

OpenIGTLink

OpenIGTLink

Sebastian Tauscher - Institute of Mechatronic Systems

Page 8: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

8

Interface – State control

Requirements

Reliability

„Is Alive“ check

Bidirectional

Data type

Command string + parameter (p)

Unified identifier (UID)

OpenIGTLink STRING

Data format

Device name: “CMD_UID”/”ACK_UID”

String: “Commandname;p1;…;pn;“

LightWeightRobotIGT – Interface Concept

State control

Robot Control

OpenIGTLink

OpenIGTLink

Sebastian Tauscher - Institute of Mechatronic Systems

Page 9: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

9

Outline LightWeightRobotIGT – Interface Concept

Sebastian Tauscher - Institute of Mechatronic Systems

Introduction

Interface Concept

Visualisation

State control

State machine

Page 10: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

10

State machine – Concept

Robotic workflow ≠ surgeon’s workflow

Direct and intuitive control of robot states

States for IGT

Registration (Free)

Pre-Positioning (Path, VirtualFixtures, MoveTo)

Targeting (MoveTo)

Save (IDLE)

LightWeightRobotIGT – Interface Concept

Sebastian Tauscher - Institute of Mechatronic Systems

Page 11: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

11

State machine – Concept

Registration (Free) Robot can be moved freely and

manually

Pre-Positioning (Path, VirtualFixtures, MoveTo) Robot can be moved freely in

restricted volume Geometries: plane, cone and path Targeting (MoveTo) Robot is moving position controlled to

target position Save (IDLE) Robot holds current position with

maximum stiffness

LightWeightRobotIGT – Interface Concept

Sebastian Tauscher - Institute of Mechatronic Systems

Page 12: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

12

State machine – Transitions

Transitions

By external request besides in case of error

LightWeightRobotIGT – Interface Concept

Sebastian Tauscher - Institute of Mechatronic Systems

Page 13: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

13

State machine – Transitions

Transitions

By external request besides in case of error

From position to impedance controlled states only via IDLE

LightWeightRobotIGT – Interface Concept

Sebastian Tauscher - Institute of Mechatronic Systems

Page 14: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

14

State machine – Transitions

Transitions

By external request besides in case of error

From position to impedance controlled states only via IDLE

To targeting state only after registration

LightWeightRobotIGT – Interface Concept

Sebastian Tauscher - Institute of Mechatronic Systems

Page 15: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

15

State machine – Control

3D Slicer module LightWeightRobotIGT

Sending command strings

Editing parameters for states

Acquiring points for point based registration

Visualisation of robot model, active virtual fixtures, force vector at TCP, and current robot state

Cyclic communication

LightWeightRobotIGT – Interface Concept

Sebastian Tauscher - Institute of Mechatronic Systems

Page 16: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

16

Test setup

Slicer workstation

3D Slicer module LightWeightRobotIGT as state control

KUKA control

Java robot application

Visualisation & state control interface thread

State machine thread

KUKA Light weight robot (LWR)

LightWeightRobotIGT – Interface Concept

Sebastian Tauscher - Institute of Mechatronic Systems

Page 17: Tutorial LightWeightRobotIGT Interface Concept€¦ · 3 Motivation Integration of robots into IGT systems Time consuming process Customized solution for each project No widely accepted

LightWeightRobotIGT – Interface Concept Tutorial

Sebastian Tauscher Institute of Mechatronic Systems Leibniz Universität Hannover