Skip to content

Commit 12ae4bb

Browse files
committed
Added task gifs to the docs
1 parent 0a0689f commit 12ae4bb

File tree

1 file changed

+48
-3
lines changed

1 file changed

+48
-3
lines changed

docs/source/overview/imitation-learning/skillgen.rst

Lines changed: 48 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,8 @@ Before using SkillGen, you must understand:
2929

3030
Review the :ref:`teleoperation-imitation-learning` documentation thoroughly before proceeding with SkillGen.
3131

32+
.. _skillgen-installation:
33+
3234
Installation
3335
~~~~~~~~~~~~
3436

@@ -239,6 +241,13 @@ Generate demonstrations for the standard Isaac Lab Mimic cube stacking task. In
239241
2. Pick up the green cube and place it on the red cube
240242
3. Final stack order: blue (bottom), red (middle), green (top).
241243

244+
.. figure:: https://download.isaacsim.omniverse.nvidia.com/isaaclab/images/cube_stack_data_gen_skillgen.gif
245+
:width: 75%
246+
:align: center
247+
:alt: Cube stacking task generated with SkillGen
248+
:figclass: align-center
249+
250+
Cube stacking dataset example.
242251

243252
Small-Scale Generation
244253
^^^^^^^^^^^^^^^^^^^^^^
@@ -285,6 +294,14 @@ Task 2: Adaptive Cube Stacking in a Bin
285294
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
286295
SkillGen can also be used to generate datasets for adaptive tasks. In this example, we generate a dataset for adaptive cube stacking in a narrow bin. The bin is placed at a fixed position and orientation in the workspace and a blue cube is placed at the center of the bin. The robot must generate successful demonstrations for stacking the red and green cubes on the blue cube without colliding with the bin.
287296

297+
.. figure:: https://download.isaacsim.omniverse.nvidia.com/isaaclab/images/bin_cube_stack_data_gen_skillgen.gif
298+
:width: 75%
299+
:align: center
300+
:alt: Adaptive bin cube stacking task generated with SkillGen
301+
:figclass: align-center
302+
303+
Adaptive bin stacking data generation example.
304+
288305
Small-Scale Generation
289306
^^^^^^^^^^^^^^^^^^^^^^
290307

@@ -422,6 +439,23 @@ cuRobo Planner (GPU, collision-aware)
422439
* ``source/isaaclab_mimic/test/test_curobo_planner_franka.py``
423440
* ``source/isaaclab_mimic/test/test_generate_dataset_skillgen.py``
424441

442+
.. list-table::
443+
:widths: 50 50
444+
:header-rows: 0
445+
446+
* - .. figure:: https://download.isaacsim.omniverse.nvidia.com/isaaclab/images/cube_stack_end_to_end_curobo.gif
447+
:height: 260px
448+
:align: center
449+
:alt: cuRobo planner test on cube stack using Franka Panda robot
450+
451+
Cube stack planner test.
452+
- .. figure:: https://download.isaacsim.omniverse.nvidia.com/isaaclab/images/obstacle_avoidance_curobo.gif
453+
:height: 260px
454+
:align: center
455+
:alt: cuRobo planner test on obstacle avoidance using Franka Panda robot
456+
457+
Franka planner test.
458+
425459
These tests can also serve as a reference for how to use cuRobo as a standalone motion planner.
426460

427461
.. note::
@@ -451,10 +485,21 @@ When ``--use_skillgen`` is enabled in ``generate_dataset.py``, the following pip
451485
5. **Record and export**:
452486
- Accumulate states/observations/actions, set the episode success flag, and export the episode (the outer pipeline filters/consumes successes)
453487

454-
.. note::
488+
Visualization and Debugging
489+
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
490+
491+
Users can visualize the planned trajectories and debug for collisions using Rerun-based plan visualizer. This can be enabled by setting ``visualize_plan = True`` in the cuRobo planner configuration. Note that rerun needs to be installed to visualize the planned trajectories. Refer to Step 3 in :ref:`skillgen-installation` for installation instructions.
455492

456-
Check cuRobo usage license and the updated Isaac Sim license per project guidelines
493+
.. figure:: https://download.isaacsim.omniverse.nvidia.com/isaaclab/images/rerun_cube_stack.gif
494+
:width: 80%
495+
:align: center
496+
:alt: Rerun visualization of planned trajectories and collisions
497+
:figclass: align-center
498+
499+
Rerun integration: planned trajectories with collision spheres.
457500

458501
.. note::
459502

460-
SkillGen is an advanced system that builds on Isaac Lab Mimic. Ensure you're comfortable with the base system before tackling complex SkillGen workflows.
503+
Check cuRobo usage license in ``docs/licenses/dependencies/cuRobo-license.txt``
504+
505+

0 commit comments

Comments
 (0)