Add dVRK needle-pass environment and OpenXR teleoperation#6527
Draft
chrisvoncsefalvay wants to merge 3 commits into
Draft
Add dVRK needle-pass environment and OpenXR teleoperation#6527chrisvoncsefalvay wants to merge 3 commits into
chrisvoncsefalvay wants to merge 3 commits into
Conversation
9 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Part of the dVRK Extended Cinematic Universe: best read in conjunction with this PR.
This adds a contact-driven dVRK PSM needle-pass environment, its pinned PSM asset configuration, and OpenXR teleoperation support.
The environment starts with the needle physically retained in the donor jaws, drives transfer through measured jaw contact, and qualifies the hand-off without direct runtime needle-state writes or attachment shortcuts. It also hardens shared OpenXR controller validity handling and fixes the test dispatcher so Isaac Sim test failures propagate through CI.
The branch is intentionally a draft while NVIDIA/IsaacTeleop#769 remains open. CI installs its immutable merge revision (
790d6cb4e948de377975c76ed1e9cbf5098e10fc) for the dVRK retargeter tests; that test-only pin should be replaced by the corresponding released dependency before this PR is merged.Main changes
Isaac-Needle-Pass-dVRK-v0with differential IK, contact observations, load-backed hand-off phases, rewards, termination criteria, and CUDA-only validationCommit structure
fix(openxr): harden controller tracking and validationfeat(dvrk): add PSM asset and OpenXR teleoperationfeat(tasks): add dVRK needle-pass environmentValidation
git diff --checkpassedGrasp-generation evidence addendum
The fixed donor and receiver grasps came from Isaac Sim 5.1.0
isaacsim.replicator.grasping1.0.9 with seed 12: 256 centres by 32 orientations = 8,192 candidates. The selected, unmodified rows are donor 2321 and receiver 51. The retained evidence bundle is identified by SHA-256: asset2b317a61f93631a7192e7ed2839ef20f7a75c05aa5f84a3905696134a64f36d7, wrapper01bc820d1777a1655a5c42b3ebac997c6281335a12d12f7636c3e25721f3a2d5, configurationb308ec31bf9bf425c686007e0dc0ad72f09ae7e1f67e1015ac53dc92a017e798, candidates7c601982d72759ca901fad9b59fa1df80a092221d1cb91eda88938b2b83bc374, and manifest13c72a5fb58db7c211619b72dcbdf27890a25a35a5aa8e3185ab4ae3139970ee. The generation bundle is review evidence rather than installed package data. Happy to provide provenance.Type of change
Screenshots
Checklist
pre-commitchecks with./isaaclab.sh --formatconfig/extension.tomlfileCONTRIBUTORS.md