Skip to content

Any timeline for official closed-loop benchmark support beyond DROID sim? #64

@yangjian253

Description

@yangjian253

Hi DreamZero team,

Thanks for releasing DreamZero.

I wanted to ask about the roadmap for broader closed-loop evaluation support. The current sim-evals setup seems to include only 3 scenes, so I am wondering:

  • Are there plans to support more scenes/tasks from DROID?
  • Is official support for PolaRiS, Genie 3.0, or LIBERO planned?
  • If so, is there any rough timeline or priority order for these benchmarks?
  • For now, what would you recommend as the best interim solution for broader closed-loop evaluation?

A rough roadmap would already be very helpful for planning research experiments.

Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions