Evaluation Data: IM-MA mesh geometry defect breakdown across 101 exports
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 25/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Quiet
- Tech stack
- python
- Domain
- computer-graphics, testing-qa
Research direction
Start with the linked 3dqa-benchmark CLI runner and its aggregate reports to reproduce the IM-MA measurements. The issue names no repository files, tests, or specific requested change; completion would require clarifying which geometry defect to address and how the 101 exports should be evaluated.
Written by the indexing model from the issue text.
Description
Hi IM-3D / Meta GenAI team,
I ran an open, reproducible geometry QA census (3dqa-benchmark) across 2,307 generative exports from 23 models.
IM-MA Metrics (n=101):
- Non-watertight: 84.2%
- Non-manifold edges: 53.5%
- Missing UVs: 100%
- Vertex-colour-only exports: 100%
- Exceeding 30k budget: 0.0%
Full reproducible CLI runner (pip install 3dqa) and aggregate reports are available at:
https://github.com/alza123123/3dqa-benchmark
- Dominant language
- Python
- Stars
- 7.5k
- Forks
- 892
- PR merge metrics
- No merged PRs in 30d
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from facebookresearch/sam-3d-objects
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
V60Open
Difficulty 5/5 Over a week Newbie friendliness 15/100
-
Difficulty 1/5 Under an hour Newbie friendliness 15/100
facebookresearch/sam-3d-objects#202 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 15/100
facebookresearch/sam-3d-objects#199 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 5/100
All issues in facebookresearch/sam-3d-objects
Similar issues
-
Difficulty 1/5 1-3 hours Newbie friendliness 85/100
WLAN-Pi/wlanpi-profiler#341 ·
Maintainers usually reply within 1 day
-
Memory leak: the shared `validation_aborted_error` keeps every traceback it is raised throughPossibly taken @Fire162 claimed this today. Open
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
graphql-python/graphql-core#287 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 67/100
roman-corgi/ctc-dip#160 ·
Maintainers usually reply within 1 day
-
type-bug
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
Maintainers usually reply within 1 day
-
render_findings.py reads and writes in the host's default encoding, so findings.html breaks on a cp1252 Windows hostPossibly taken @Aaqibhafeezkhan claimed this today. Openbug good first issue mentored python size: XS up-for-grabs
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
dheerajjha/mcp-migrate#366 · 1 comment ·
Maintainers usually reply within 1 day