Issues with the coordinates action space
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 25/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- python
- Domain
- ai-infra-agents
Research direction
Start by reproducing the reported mouse_click(1219, 228, button='left') failure with GenericAgent using the coord action space on WorkArena L1, and inspect the coordinate-action entry point. Done means the click activates the intended element rather than merely showing the blue cursor over it. A linked open pull request indicates work is already underway.
Written by the indexing model from the issue text.
Description
Hi,
In the following step, the action mouse_click(1219, 228, button='left') is not executed properly on WorkArena L1, even if the blue cursor shows the mouse is on the right element. I'm using GenericAgent with coord action space. See screenshots below:
Before:
After:
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 202
- Avg merge
- 6d 15h
- Merged PRs (30d)
- 3
Getting set up
This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from ServiceNow/BrowserGym
-
[Feature Proposal]: Add experiment lifecycle callbacks to `ExpArgs` in `loop.py`Possibly taken @sriram687 claimed this 2 days ago. Open
ServiceNow/BrowserGym#417 · 1 assignee ·
-
WebArena-Verified reward averages evaluator scores instead of using the benchmark's task score (partial credit for failed tasks)Possibly taken @salma2vec claimed this 6 days ago. Open
Difficulty 2/5 1-3 hours Newbie friendliness 32/100
ServiceNow/BrowserGym#412 ·
-
AssistantBench scorer treats a thousands separator as a decimal point: "3,080,000" scores 0 against gold 3080000, while "1,000" scores 1.0 against gold 1Possibly taken @Andiii208 claimed this 27 days ago. Open
Difficulty 3/5 1-2 days Newbie friendliness 25/100
ServiceNow/BrowserGym#404 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 28/100
ServiceNow/BrowserGym#401 ·
-
`miniwob.find-greatest` can be marked successful after selecting a non-maximum cardPossibly taken @jstar0 claimed this 104 days ago. Open
Difficulty 4/5 3-5 days Newbie friendliness 25/100
ServiceNow/BrowserGym#392 ·
All issues in ServiceNow/BrowserGym
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
ComposioHQ/awesome-claude-skills#2398 ·
Maintainers usually reply within 2 days
-
bug converter
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
grafana/sigma-rule-deployment#435 ·
Maintainers usually reply within 1 day
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 73/100
datamodel-code-generator/datamodel-code-generator#5589 ·
Maintainers usually reply within 1 day
-
Shell: serve the home app's Cookie Policy on a hard reloadPossibly taken @2001anshkaushik claimed this today. Openfeature module:ai
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
rocketride-org/rocketride-server#2899 · 1 comment ·
Maintainers usually reply within 2 days
-
GEFSv12
Difficulty 2/5 1-3 hours Newbie friendliness 70/100