HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Data-efficient learning of object-centric grasp preferences

Abstract : Grasping made impressive progress during the last few years thanks to deep learning. However, there are many objects for which it is not possible to choose a grasp by only looking at an RGB-D image, might it be for physical reasons (e.g., a hammer with uneven mass distribution) or task constraints (e.g., food that should not be spoiled). In such situations, the expert preferences need to be taken into account. In this paper, we introduce a data-efficient grasping pipeline (Latent Space GP Selector-LGPS) that learns grasp preferences with only a few labels per object (typically 1 to 4) and generalizes to new views of this object. Our pipeline is based on learning a latent space of grasps with a dataset generated with any state-of-the-art grasp generator (e.g., Dex-Net). This latent space is then used as a low-dimensional input for a Gaussian process classifier that selects the preferred grasp among those proposed by the generator. The results show that our method outperforms both GR-ConvNet and GG-CNN (two state-of-the-art methods that are also based on labeled grasps) on the Cornell dataset, especially when only a few labels are used: only 80 labels are enough to correctly choose 80% of the grasps (885 scenes, 244 objects). Results are similar on our own dataset (91 scenes, 28 objects).
Document type :
Preprints, Working Papers, ...
Complete list of metadata

Contributor : Yoann Fleytoux Connect in order to contact the contributor
Submitted on : Monday, December 6, 2021 - 11:04:38 AM
Last modification on : Wednesday, March 16, 2022 - 3:43:42 AM
Long-term archiving on: : Monday, March 7, 2022 - 6:30:37 PM


Files produced by the author(s)


  • HAL Id : hal-03466780, version 1


Yoann Fleytoux, Anji Ma, Serena Ivaldi, Jean-Baptiste Mouret. Data-efficient learning of object-centric grasp preferences. 2021. ⟨hal-03466780v1⟩



Record views


Files downloads