OpenBot
Back to datasets
Egocentric datasetOpenReadiness 74 · confidence 34

Egocentric Activity Sample Dataset

Ego4D-style activity sample with narrations

<1Krows

A CC-BY-4.0 sample dataset for egocentric activity recognition, visual QA, temporal localization, narrations, hands, and objects.

Best for

Activity-recognition examples

Not for / blocker

Good open sample for testing language annotations around egocentric clips.

Download decision

Inspect schema and run a bounded sample audit before committing to the full release.

Policy learningUseful

Has observation, action/state proxy, and task or language context.

fit 85 · confidence 55

World modelUseful

Has rich observation and semantic context, but limited geometry/sim-real alignment.

fit 68 · confidence 55

WAMUseful

Contains observation, intent, and action/state, but feedback/correction signal is weak.

fit 72 · confidence 55

Verified facts and provenance

Claims, metadata verification, and sample verification are shown separately.

curated official source
Official claim · signals
VideoNarrationLanguageHand-object
Metadata verified · schema / annotations

Unknown — no machine-readable schema facts have been captured.

Sample / pipeline verification

Unknown — metadata conclusions do not prove sample coverage, alignment, or file integrity.

Declared loop signal coverage

Signals inferred from official metadata; Data pipeline verification is still pending.

4/7 categories present or partial

Observation / ego video

video · Video QA fixtures for egocentric agents

present

Action / hand pose / robot state

hand-object · A CC-BY-4.0 sample dataset for egocentric activity recognition, visual QA, temporal localization, narrations, hands, and objects.

partial

Gaze / attention

No decision-grade evidence captured yet.

unknown

Language intent / task phase

narration · language · Narration-aware curation · Good open sample for testing language annotations around egocentric clips.

present

Feedback / correction / failure

No decision-grade evidence captured yet.

unknown

Sim-real pairing

No decision-grade evidence captured yet.

unknown

License / format / access

Open · CC-BY-4.0 · Parquet · video

present

Model and task fit · OpenBot inference

Policy learningUseful

Has observation, action/state proxy, and task or language context.

fit 85 · confidence 55

World modelUseful

Has rich observation and semantic context, but limited geometry/sim-real alignment.

fit 68 · confidence 55

WAMUseful

Contains observation, intent, and action/state, but feedback/correction signal is weak.

fit 72 · confidence 55

Failure miningUnknown

Failure, correction, intervention, and recovery annotations have not been verified.

fit 50 · confidence 15

Good tasks

video-language reasoning

Blockers and unresolved evidence

  • Gaze / attentionunknown
    Not enough evidence to classify this signal. Verify metadata or a bounded sample.
  • Feedback / correction / failureunknown
    Not enough evidence to classify this signal. Verify metadata or a bounded sample.
  • Sim-real pairingunknown
    Not enough evidence to classify this signal. Verify metadata or a bounded sample.

Raw dataset signals

VideoNarrationLanguageHand-object

OpenBot fit

  • Activity-recognition examples
  • Narration-aware curation
  • Video QA fixtures for egocentric agents

Integration notes

  • Good open sample for testing language annotations around egocentric clips.
  • Small scale; use as an integration fixture.

Related by signals