Four CN Lite tasks have missing or mismatched source data (tasks 33, 207, 380, and 381)
Chưa có ai nhận issue này.
Đánh giá
- Độ khó
- 5/5
- Thời gian dự kiến
- Hơn một tuần
- Mức phù hợp với người mới
- 35/100
- Loại issue
- Lỗi
- Độ rõ ràng
- Khá rõ ràng
- Mức độ hoạt động
- Sôi nổi
- Lĩnh vực
- data-engineering, testing-qa
Hướng nghiên cứu
Bắt đầu bằng cách so sánh manifests và file_dep_graphs của các task 33, 207, 380 và 381 với các tệp Workspace thực tế được mô tả trong Issue. Xem xét các Prompt bị ảnh hưởng và các audit Rubric-Grounding, sau đó xác định liệu mỗi task cần các Asset được sửa hay một Contract được sửa đổi. Hoàn tất khi mọi kết quả bắt buộc đều có thể được suy ra từ các Input hiển thị đối với task và các Rubric bị ảnh hưởng đã được tạo lại.
Do mô hình lập chỉ mục viết ra từ nội dung của issue.
Mô tả
Summary
Four tasks in the Chinese Workspace-Bench Lite dataset appear to have missing or mismatched source data:
opendatabox-workspace-bench-33opendatabox-workspace-bench-207opendatabox-workspace-bench-380opendatabox-workspace-bench-381
I checked:
- The task metadata,
data_manifest, andfile_dep_graph - The actual files distributed with each Lite task
- The complete filename index of
filesys_cn.zipfromWorkspace-Bench/Workspace-Bench-Workspaces(28,023 entries) - The provided rubric-grounding audit
The issues are described below.
1. opendatabox-workspace-bench-33: hospital-grade data is unavailable
The task asks the agent to calculate the numbers of level-1, level-2, and level-3 hospitals in eastern, central, and western China.
The supplied inputs are:
1-12 2023年各地区按床位数分组的社区卫生服务中心(站)数.xlsx1-2 2023年各地区医疗卫生机构数.xlsx1-3 2023年各类医疗卫生机构数.xlsx
The files contain:
- Regional and province-level hospital totals
- Hospital counts by institution type
- Community health center/station bed-count groups
- National institution classifications
They do not contain regional or province-level hospital-grade fields.
A search of the complete Operations Manager workspace found no hospital-grade distribution workbook. The closest file is:
医疗分析/医院收支/4-12 2023年三级公立医院收入与支出.xlsx
That workbook contains national financial indicators by hospital grade, not regional or province-level hospital-grade counts.
As a result:
- The eastern, central, and western hospital totals are grounded.
- The community health center/station statistics are grounded.
- The required level-1, level-2, and level-3 counts for the three regions are not independently derivable.
- The Beijing and Shanghai hospital totals are grounded, but their grade-specific counts are not.
The current audit marks 10 of 19 rubrics as grounded and 9 as ungrounded.
Suggested maintainer action
Either:
- Add the intended regional hospital-grade source workbook to the Operations Manager workspace and the task manifest; or
- Remove the hospital-grade calculations and regenerate the affected rubrics using the available institution-type and bed-group data.
2. opendatabox-workspace-bench-207: required scoring-model workbook is missing
The task explicitly says:
基于5-通用人才画像(模型).xlsx评价四份简历,并且生成人才评价.xlsx到桌面
However, the task manifest contains only four resume files:
张浩然简历.docx王佳宁简历.docx赵思远简历.docx李雨辰简历.docx
The required 5-通用人才画像(模型).xlsx is absent from both the task manifest and file_dep_graph.
A full search of the Logistics Manager workspace found no file named:
5-通用人才画像(模型).xlsx5-通用人才画像(模型).xlsx
It also found no filename containing 通用人才画像.
The workspace contains only these related templates:
人才画像/模板/2-人才画像矩阵图.xlsx人才画像/模板/3-人才画像_履历模型_.xlsx人才画像/模板/4-人才画像_冰山模型_.xlsx人才画像/模板/6-核心岗位人才画像_模版_.docx
None can safely be assumed to be the missing model.
Without the model workbook, an agent cannot independently recover:
- The five scoring dimensions and their exact weights
- The grade thresholds
- The intended scoring formulas
- Exact candidate scores such as 82, 85, 88, and 92
Resume-derived facts remain grounded, but the scoring-model results do not. The current audit marks 10 of 20 rubrics as grounded and 10 as
ungrounded.
Suggested maintainer action
Recover and add 5-通用人才画像(模型).xlsx to:
- The Logistics Manager workspace
data_manifestfile_dep_graph- Any generated setup/input manifest
If the original workbook contains expected candidate answers, please publish a sanitized template containing only task-visible criteria,
weights, formulas, and grade thresholds, and regenerate rubrics that depend on hidden scores.
3. opendatabox-workspace-bench-380: prompt and source assets describe different business scenarios
The prompt claims the following assets are provided:
activity_photos/impact_chart.csvfeedback_wordcloud.pngfuture_plan.mdrecruitment_poster.png
None of these paths exists in the complete Chinese workspace image.
The actual task manifest contains:
post_1.jsonmarket_analysis_1.jsonuser_feedback_category_202601.mdstrategic_plan_1.mdtraining_module_1.md
These files describe corporate marketing operations rather than a volunteer association:
post_1.jsonis an Instagram marketing post and contains only a remoteexample.comimage URL.market_analysis_1.jsondescribes market size, growth, and competitors.user_feedback_category_202601.mdcontains product, UX, and customer-service feedback.strategic_plan_1.mdcontains customer-growth, product, and revenue targets.training_module_1.mdis a Marketing Operations training course.
Importantly, the files are not unrelated to the rubrics. Most exact rubric values come directly from these actual marketing files, including:
- Reach of
87,170,000 2,070,100new followers- A
3.51%engagement rate - Market size
318990B, growth6%, and CAGR11% - Feedback counts and percentages
- The 2024–2026 revenue targets
- The four-hour online Marketing Operations course
The current audit therefore marks 21 of 25 rubrics as grounded.
The defect is a semantic mismatch among:
- A volunteer-association prompt
- Corporate marketing inputs
- Rubrics primarily generated from the marketing inputs
Renaming the current files would not resolve the mismatch: a marketing post is not an activity-photo collection, and a marketing training
module is not a recruitment poster.
Suggested maintainer action
Either:
- Add the five intended volunteer-association assets and regenerate all content rubrics from them; or
- Rewrite the prompt as a corporate marketing annual-review task, retaining the current inputs and grounded rubric values while removing the
unsupported volunteer, activity-photo, word-cloud, and recruitment-poster requirements.
Given the existing rubric content, the second option may require fewer changes.
4. opendatabox-workspace-bench-381: filename, year, format, data-grain, and scoring-model mismatch
The prompt names five 2025 CSV files:
hospital_finance_2025.csvliabilities_2025.csvdrug_production_2025.csvmedical_expenses_2025.csvchronic_disease_2025.csv
None exists in the complete Chinese workspace image.
The actual task inputs are five Chinese-named 2023 XLSX workbooks:
4-12 2023年三级公立医院收入与支出.xlsx4-6 2023年各类医疗卫生机构资产与负债.xlsx4-4-2 2023年全国药品生产流通.xlsx4-20 2023年各地区公立医院门诊和住院病人次均医药费用.xlsx9-10 2023年调查地区15岁及以上居民慢性病患病率.xlsx
This is not only a filename mismatch. The data grains are incompatible with the requested province-level correlation analysis:
- Medical expenses: 31 province-level regions
- Drug production/distribution: 31 province-level regions
- Chronic disease: national, urban/rural, and broad eastern/central/western aggregates only
- Hospital income and expenditure: hospital-grade aggregates, not provinces
- Assets and liabilities: institution-type aggregates, not provinces
Therefore, the inputs cannot be merged into a 31-region dataset containing both financial-health and chronic-disease variables.
The task also does not define:
- The financial-health score
- The balance/surplus ratio formula
- Risk-score weights
- Low/medium/high-risk thresholds
- How the exact
5/23/3risk split should be produced
There are also apparent rubric inconsistencies:
- A value of
86.06%appears more consistent with an expense-to-income ratio than a conventional surplus ratio. A conventional surplus ratio
would instead be approximately13.94%. - If drug-production licenses are used as the industry-scale variable, the correlation with outpatient cost is approximately
r = +0.108,
not negative. - Using drug-distribution-business licenses instead gives approximately
r = -0.137, showing that the required negative conclusion depends
on an unspecified metric choice.
The current audit marks only 3 of 20 rubrics as grounded and 17 as ungrounded.
Suggested maintainer action
This task likely needs to be regenerated rather than fixed through filename aliases alone.
Either:
- Add the intended 2025 province-level CSV datasets, explicitly define all formulas and risk thresholds, and regenerate the rubrics; or
- Rewrite the task around the available 2023 XLSX workbooks, restrict analysis to supported aggregation levels, define all derived metrics,
and regenerate the correlation and risk rubrics.
Expected outcome
Please either correct the affected source assets and manifests or revise the task contracts and regenerate rubrics so that every required
result can be independently derived from task-visible inputs.
- Ngôn ngữ chính
- Python
- Star
- 72
- Fork
- 7
- Merge trung bình
- 7 phút
- Pull request đã merge (30 ngày)
- 6
Hướng dẫn đóng góp
Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này
Bắt đầu từ đâu
- Đọc hết issue, rồi đọc hướng dẫn đóng góp của dự án.
- Bình luận trên issue rằng bạn sẽ nhận — tránh hai người làm cùng một việc.
- Fork repository và làm thay đổi trên một nhánh.
- Mở pull request có tham chiếu số hiệu của issue.
Issue khác của OpenDataBox/Workspace-Bench
-
Độ khó 2/5 1-3 giờ Mức phù hợp với người mới 78/100
OpenDataBox/Workspace-Bench#24 · 1 bình luận · 1 reaction ·
-
Possible untranslated Chinese DOCX content in the English split (Task 102 as a reproducible example) Đang mở
Độ khó 4/5 3-5 ngày Mức phù hợp với người mới 48/100
-
Độ khó 3/5 1-2 ngày Mức phù hợp với người mới 68/100
OpenDataBox/Workspace-Bench#22 · 1 bình luận · 1 reaction ·
-
Độ khó 3/5 1-2 ngày Mức phù hợp với người mới 65/100
OpenDataBox/Workspace-Bench#12 · 4 bình luận ·
-
Độ khó 5/5 Hơn một tuần Mức phù hợp với người mới 35/100
OpenDataBox/Workspace-Bench#11 · 1 bình luận ·
Tất cả issue của OpenDataBox/Workspace-Bench
Issue tương tự
-
[Bug] reef-hermes tells me to resume with hermes --resume, which does not work from my shell Đang mởarea: harness bug status: needs-triage
Độ khó 2/5 1-3 giờ Mức phù hợp với người mới 75/100
Human-Agent-Society/reef#625 ·
-
Độ khó 2/5 1-3 giờ Mức phù hợp với người mới 70/100
-
Độ khó 1/5 Dưới một giờ Mức phù hợp với người mới 80/100
learningequality/kolibri#15351 · 2 bình luận ·
-
Độ khó 2/5 1-3 giờ Mức phù hợp với người mới 75/100
-
Name consistency Đang mở
Độ khó 2/5 1-3 giờ Mức phù hợp với người mới 75/100
eellak/triplestore#65 · 1 bình luận ·