EgoWorld Dataset
Bimanual manipulation in LeRobot format
A compact egocentric bimanual manipulation dataset with world-frame 3D hand poses, MANO meshes, camera trajectories, depth maps, and 40D action/state vectors.
Schema validation for LeRobot v3
Small, but excellent for testing catalog pages, loaders, and schema conversions.
Inspect schema and run a bounded sample audit before committing to the full release.
Has observation and action/state proxy, but weak task-phase context.
fit 70 · confidence 55
Has visual observations plus geometry, calibration, depth, or reconstruction cues.
fit 82 · confidence 55
WAM-required observation, intent, and action alignment is not fully verified.
fit 50 · confidence 15
Verified facts and provenance
Claims, metadata verification, and sample verification are shown separately.
Unknown — no machine-readable schema facts have been captured.
Unknown — metadata conclusions do not prove sample coverage, alignment, or file integrity.
Declared loop signal coverage
Signals inferred from official metadata; Data pipeline verification is still pending.
Observation / ego video
camera pose · depth · RGB · A compact egocentric bimanual manipulation dataset with world-frame 3D hand poses, MANO meshes, camera trajectories, depth maps, and 40D action/state vectors.
Action / hand pose / robot state
hand pose · camera pose · actions · Bimanual action representation tests
Gaze / attention
No decision-grade evidence captured yet.
Language intent / task phase
No decision-grade evidence captured yet.
Feedback / correction / failure
No decision-grade evidence captured yet.
Sim-real pairing
camera pose · depth · A compact egocentric bimanual manipulation dataset with world-frame 3D hand poses, MANO meshes, camera trajectories, depth maps, and 40D action/state vectors.
License / format / access
Open · CC-BY-NC · LeRobot v3 · RGB
Model and task fit · OpenBot inference
Has observation and action/state proxy, but weak task-phase context.
fit 70 · confidence 55
Has visual observations plus geometry, calibration, depth, or reconstruction cues.
fit 82 · confidence 55
WAM-required observation, intent, and action alignment is not fully verified.
fit 50 · confidence 15
Failure, correction, intervention, and recovery annotations have not been verified.
fit 50 · confidence 15
Good tasks
Blockers and unresolved evidence
- Gaze / attentionunknownNot enough evidence to classify this signal. Verify metadata or a bounded sample.
- Language intent / task phaseunknownNot enough evidence to classify this signal. Verify metadata or a bounded sample.
- Feedback / correction / failureunknownNot enough evidence to classify this signal. Verify metadata or a bounded sample.
Raw dataset signals
OpenBot fit
- Schema validation for LeRobot v3
- Bimanual action representation tests
- Small smoke-test dataset for OpenBot Data
Related models and papers
Model references linked to similar loop signals.
OpenVLA
Open-source vision-language-action model for generalist robotic manipulation, trained on diverse real-world robot demonstrations.
RT-1
Robotics Transformer policy trained on large-scale real-world robot demonstrations for language-conditioned manipulation.
RT-X
Cross-embodiment RT model family trained from the Open X-Embodiment mixture to study transfer across robots and tasks.
pi0 / OpenPI
Generalist robot policy family and open-source robotics model package from Physical Intelligence.
SmolVLA
Compact open vision-language-action policy designed for practical robot fine-tuning and deployment through the LeRobot ecosystem.
RDT-1B
Diffusion foundation model for bimanual manipulation that uses large-scale robot data to generate action trajectories.
Integration notes
- Small, but excellent for testing catalog pages, loaders, and schema conversions.
- Treat as a development fixture rather than a training corpus.