PrendoSim is a robot gripper simulator that allows scientists working on robotics to do generate and test viable grasps using a proxy-hand method and a novel grasp stability metric based on the amount of weight that can be withstand. This simulator takes advantage of Unity’s latest NVIDIA PhysX 4.1 integration to create physically realistic grasp simulations and outputs joint pose data of the grippers digits (json format), grasped object’s position, and images of the grasp from a specified point of view in png format.
Information about the project has been published in the paper:
Diar Abdlkarim, Valerio Ortenzi, Tommaso Pardi, Maija Filipovica, Alan M. Wing, Katherine J. Kuchenbecker, Massimiliano Di Luca (2021). PrendoSim: Proxy-Hand-Based Robot Grasp Generator, ICINCO 2021 Preprint available here .
Abstract: The synthesis of realistic robot grasps in a simulated environment is pivotal in generating datasets that support sim-to-real transfer learning. In a step toward achieving this goal, we propose PrendoSim, an open-source grasp generator based on a proxy-hand simulation that employs NVIDIA’s physics engine (PhysX) and the recently released articulated-body objects developed by Unity (https://prendosim.github.io). We present the implementation details, the method used to generate grasps, the approach to operationally evaluate stability of the generated grasps, and examples of grasps obtained with two different grippers (a parallel jaw gripper and a three-finger hand) grasping three objects selected from the YCB dataset (hammer, screwdriver, and scissors). Compared to simulators proposed in the literature, PrendoSim balances grasp realism and ease of use, displaying an intuitive interface and enabling the user to produce a large and varied dataset of stable grasps.
Before you begin, ensure that the following requirements are met:
2020.1.9f1
or higher.<Windows/Linux/Mac>
machine.Project Settings
and Build Settings
as stated here:New Unity Project
File
» Build Settings
:Build Setting
Edit
» Project Settings
change the following:Physics
player
To use
Linux and macOS:
2. In Unity top menu bar go to `Assets` >> `Import Package` >> `Custom Package` and go to where you have downloaded the `PrendoSim.unitypackage` to.
3. Make sure you import everything.
Windows:
2. In Unity top menu bar go to `Assets` >> `Import Package` >> `Custom Package` and go to where you have downloaded the `PrendoSim.unitypackage` to.
3. Make sure you import everything.
To use
1. Make sure you are in the PoseGen2 scene located in the Scenes folder.
2. Then press the Unity `play` button at the top.
3. You should now be able to select simulation parameter options in the user interface shown on the `Game` window.
To contribute to
git checkout -b <branch_name>
.git commit -m '<commit_message>'
git push origin <project_name>/<location>
Alternatively see the GitHub documentation on creating a pull request.
You ontributors.org/docs/en/emoji-key).
If you want to contact me, you can reach me at diarkarim@gmail.com.
This project uses the following license: MIT License .