The video shows four modern methods to control a robot manually based on a digital twin.
The digital twin was created with Unity and realvirtual.io as kind of framework for Unity. The communication to the IPC is realized via ADS and to the microcontroller for the LEDs via MQTT. The digital twin contains a workspace monitoring and collision detection for the tool center point of the robot. The workspace is based on a CAD-file and can be changed during runtime in the digital twin.
The HMI (shown on the raspberry pi displays and in the digital twin) was created with TwinCAT3 HMI (incl. TwinCAT3 Scope Server) and is therefore web-based.
Mainly used hardware products:
IDEA-Box with C6015 IPC from Beckhoff,
robot application: IDEA-Box MC,
gamepad: SN30 pro+ from 8bitdo,
console: steam deck from valve,
hand-tracking: Leap2 motion controller from ultraleap and
augmented reality: Magic leap one
Mainly used software products:
TwinCAT 3, Unity and realvirtual.io.
keywords: IDEA-Box, digital twin, Beckhoff, unity, realvirtual.io, robotics, parallel manipulator, HMI, hand-tracking, augmented reality, workspace monitoring and collision detection.
Негізгі бет IDEA-Box MC robotics: four modern methods to control a robot manually based on a digital twin
No video
Пікірлер