bytedance/UI-TARS-desktop

Benchmark Evaluation Script

Open

#176 opened on Mar 10, 2025

View on GitHub
 (0 comments) (0 reactions) (0 assignees)TypeScript (3,644 forks)github user discovery
FeatureGood first issue

Repository metrics

Stars
 (36,199 stars)
PR merge metrics
 (PR metrics pending)

Description

I wonder if benchmark script can be provided to help reproduce the evaluation performance like android control and so on.

Contributor guide

Research direction
Review the repository's existing test and evaluation approaches, study the agent's API and configuration files, and design a script that measures performance metrics such as task completion time and accuracy.
Tech stack
typescript
Domain
testingdeveloper experience
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GitNode.js
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
75