Tongyi-MAI/MobileWorld

View on GitHub

Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments (ACL 2026)

Stars: 265
Forks: 46
Open beginner issues: 0
Indexed issues: 16

Dominant language: Python
License: Apache-2.0
Last GitHub push: Aug 25, 2026
Latest indexed: Sep 20, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

16 open issues indexed

Wuying-Mobile-Agent leaderboard submission Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

Tongyi-MAI/MobileWorld#63 · Opened Sep 20, 2026
Verify evals on Papers with Code Open

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

Tongyi-MAI/MobileWorld#62 · Opened Sep 14, 2026
Measured run-to-run variance on the GUI-Only suite (29 tasks × 10 repetitions) — data offered Open

Difficulty 5/5 Over a week Newbie friendliness 28/100

Tongyi-MAI/MobileWorld#58 · Opened Aug 27, 2026
MacOS support Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

Tongyi-MAI/MobileWorld#57 · 4 comments · Opened Jul 28, 2026
`InvoiceReceiptCopyAskUserTask` is missing the `agent-user-interaction` tag → paper Table 5 and `leaderboard.json` disagree by one task (116/45/40 vs 117/44/40) Open

Difficulty 1/5 Under an hour Newbie friendliness 90/100

Tongyi-MAI/MobileWorld#55 · 1 comment · Opened Jul 5, 2026
Route-planning SMS verifiers are un-passable: `check_sms_via_adb` returns `bool`, but the verifier uses it as the SMS text Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

Tongyi-MAI/MobileWorld#54 · 1 comment · Opened Jul 3, 2026
When will MobileWorld officially support Apple M5 chip? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

Tongyi-MAI/MobileWorld#51 · 1 comment · Opened Jun 15, 2026
Mattermost file click fails Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

Tongyi-MAI/MobileWorld#49 · 5 comments · Opened May 31, 2026
【严重问题】多次快照重载导致模拟器GPU状态污染，KVM锁无法释放，评测跑至64任务后必崩溃 Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

Tongyi-MAI/MobileWorld#48 · 1 comment · Opened May 19, 2026
Request for updated evaluation scripts to reproduce Qwen3.5-397B-A17B metrics Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

Tongyi-MAI/MobileWorld#39 · 3 comments · Opened Mar 9, 2026
error during evaluation Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

Tongyi-MAI/MobileWorld#36 · 2 comments · Opened Mar 4, 2026
Problems using ModelScope MCP servers Open

Tongyi-MAI/MobileWorld#34 · 1 comment · 1 assignee · Opened Feb 16, 2026
MobileWorld tasks running get stucked Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

Tongyi-MAI/MobileWorld#32 · 1 comment · Opened Feb 10, 2026
Evaluation Network issue Open

Tongyi-MAI/MobileWorld#28 · 2 comments · 1 assignee · Opened Jan 27, 2026
Request to Add AutoGLM-Phone-9B Implementation and Comparison Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

Tongyi-MAI/MobileWorld#26 · 3 comments · Opened Jan 26, 2026
Can not reproduce GPT-5.1 + UI-Ins-7B results Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

Tongyi-MAI/MobileWorld#24 · 1 comment · Opened Jan 16, 2026

Tongyi-MAI/MobileWorld

Get new issues in your inbox