| CARVIEW |
3rd Workshop on Representing and Manipulating Deformable Objects @ ICRA2023
... was held on 29.05.2023 9:00 GMT+01, in London ExCel ICC Capital Suite 12.Clothes, food, cables, and body tissue are just a few examples of deformable objects (DO) involved in both everyday and specialized tasks. Although humans are able to reliably manipulate them, automating this process using robotic platforms is still unsolved. Indeed, the high number of degrees of freedom involved in DOs undermines the effectiveness of traditional modelling, planning and control methods developed for rigid object manipulation. This paves the way for exciting questions from a research and application perspective. i) How to tractably represent the state of a deformable object? ii) How to model and simulate its highly complex and non-linear dynamics? iii) What hardware tools and platforms are best suited for grasping and manipulating? We aim to discuss these and more challenges that arise from handling deformable objects by connecting scientists from different subfields of robotics, including perception, simulation, control, and mechanics. Following the previous editions of the workshop at ICRA 2021 and ICRA 2022, the objective for the proposed third edition is to further identify promising research directions and analyze current state-of-the-art solutions with an emphasis on highlighting recent results since the 2022 workshop. We plan to facilitate this through invited talks and will foster new collaborations to connect young researchers with senior ones.
The workshop was held in hybrid mode
Links:
- InfoVaya: https://events.infovaya.com/event?id=103
- YouTube channel: https://www.youtube.com/channel/UCQFAnfbQK45enYDr8B0VdKw
- Link to 2nd edition of the workshop: https://deformable-workshop.github.io/icra2022/
- Link to 1st edition of the workshop: https://deformable-workshop.github.io/icra2021/
Content
Topics
The workshop aims to explore different aspects that will potentially allow robots to autonomously manipulate deformable objects in the near future. Enabling such manipulation is crucial for a variety of domains and tasks, e.g., domestic, industrial and surgical contexts, which involve various forms of object deformability. However, the complexity of representing and modeling the dynamics of these objects results in the lack of a current unified solution that can be adapted to a wide range of objects. Specifically, the workshop will focus on, but is not limited to, the following topics for deformable object manipulation:
- Representation and state estimation
- Simulation and modeling
- Transfer from simulation to reality
- Learning to manipulate using data-driven methods such as reinforcement learning and learning from demonstrations
- Perception: state tracking, parameter identification, property detection (e.g. landmarks for garments) and classification, etc.
- Control, visual servoing and planning
- Specialized tools, e.g. grippers, and sensors
- Multi-arm manipulation
- Application-specific challenges: cloth folding, surgical tasks, precision agriculture, etc.
Schedule
Time Zone: GMT +01
| Time | Activity |
|---|---|
| 09:00 - 09:15 | Workshop opening |
| 09:15 - 09:45 | Yashraj Narang: Using and building simulation models for deformable-object manipulation |
| 09:45 - 10:15 | Jia Pan: Nonprehensile manipulation of cloth pieces |
| 10:15 - 10:45 | Spotlight talks #1
|
| 10:45 - 11:30 | Coffee break + Posters session #1
|
| 11:30 – 12:00 | Yiannis Demiris: Robot-assisted Dressing: bimanual policies for deformable object manipulation |
| 12:00 – 12:30 | Elena De Momi: AI-based techniques for improving tool-tissue interaction in robotic surgery |
| 12:30 - 13:45 | Lunch |
| 13:45 – 14:15 | Jihong Zhu: Deformable Object Manipulation: Fundamental challenges and promising applications |
| 14:15 – 14:45 | Emo Todorov: New soft-body modeling capabilities in MuJoCo |
| 14:45 – 15:15 | Carme Torras: Cloth representation and manipulation within the CLOTHILDE project |
| 15:15 – 15:45 | Spotlight talks #2
|
| 15:45- 16:30 | Coffee break + Posters session #2
|
| 16:30 – 17:00 | Yunzhu Li: Structured Model Learning for Deformable Object Manipulation |
| 17:00 – 17:30 | Nima Fazeli: Recent advances in Multimodal Implicit Representations of Deformable Objects |
| 17:30 – 18:00 | Panel discussion |
| 18:00 – 18:15 | Closing remarks |
Call for papers
We invite participants to submit extended abstracts 3+n pages, with n pages (no page-limit) for the bibliography, in the IEEE conference style.
Submissions will be reviewed by experts of their respective field. The accepted abstracts will be made available on the workshop website but will not appear in the official IEEE conference proceedings. Participants are encouraged to submit their recent work on the topics of interest mentioned above. Contributions are encouraged, but are not required, to be original.
The review process will be single-blind, meaning the submitted paper does not need to be anonymized.
Abstracts can be submitted through Microsoft CMT: https://cmt3.research.microsoft.com/WDOICRA2023.
Important dates (final extension):
- Submission Deadline:
10.04.202319.04.2023 (23:59 PST) - Notification date:
30.04.202307.05.2023 (23:59 PST) - Final submission:
14.05.202321.05.2023 (23:59 PST) - Workshop date: 29.05.2023
IEEE RAS Computer & Robot Vision workshop award
We are happy to announce the WDO Best Paper Award sponsored by the IEEE RAS Technical Committee Computer & Robot Vision. The selected paper will receive a prize of 300$. Any contribution submitted to the workshop will be automatically considered for the award.
Update June 02, 2023: we are excited to announce that the winner of the best paper award at the workshop is:Mingrui Yu, Kangchen Lv, Changhao Wang, Masayoshi Tomizuka, Xiang Li. A Coarse-to-Fine Framework for Dual-Arm Manipulation of Deformable Linear Objects with Whole-Body Obstacle Avoidance.
Invited Speakers (alphabetical order)
Yiannis Demiris
Talk title: Robot-assisted Dressing: bimanual policies for deformable object manipulation
Elena De Momi
Talk title: AI-based techniques for improving tool-tissue interaction in robotic surgery
Nima Fazeli
Talk title: Recent advances in Multimodal Implicit Representations of Deformable Objects
Yunzhu Li
Postdoctoral Researcher
Stanford, USA
(Incoming) Assistant Professor, University of Illinois Urbana-Champaign, USA
Personal website
Talk title: Structured Model Learning for Deformable Object Manipulation
Yashraj Narang
Talk title: Using and building simulation models for deformable-object manipulation
Jia Pan
Talk title: Nonprehensile manipulation of cloth pieces
Emo Todorov
Talk title: New soft-body modeling capabilities in MuJoCo
Carme Torras
Talk title: Cloth representation and manipulation within the CLOTHILDE project
Jihong Zhu
Talk title: Deformable Object Manipulation: Fundamental challenges and promising applications
Organizers
- Daniel Seita, Carnegie Mellon University, USA
- Martina Lippi, Roma Tre University, Italy
- Michael C. Welle, KTH Royal Institute of Technology, Sweden
- Fangyi Zhang, Queensland University of Technology (QUT), Australia
Co-Organizers
- Hang Yin, University of Copenhagen, Denmark
- Danica Kragic, KTH Royal Institute of Technology, Sweden
- Alessandro Marino, University of Cassino and Southern Lazio, Italy
- David Held, Carnegie Mellon University, USA
- Peter Corke, Queensland University of Technology (QUT), Australia
Contact
If you have any questions please contact Daniel Seita at the email: dseita AT andrew DOT cmu DOT edu