[Enhancement]: [Stanford V02] Integrate distribution-aware filter cases into VectorDBBench
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 4/5
- Tiempo estimado
- 3-5 días
- Aptitud para principiantes
- 45/100
Línea de trabajo
The issue references VectorDBBench and depends on issue #881. Start by examining the existing benchmark adapters and fixtures from V01. Look for where filter configurations are loaded and how recall/latency reporting currently works. The goal is to integrate distribution-aware filter cases, ensuring unsupported backend predicates are skipped explicitly. Run the existing benchmarks to understand the current flow before modifying case configuration and filter mappings.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
Is there an existing issue for this?
- I have searched the existing issues.
No directly matching open issue was identified in the catalog duplicate check. Recheck the target branch and in-flight PRs with a maintainer before claiming this task.
Project
Catalog ID: V02
Difficulty: medium
Estimated incremental effort: 8–12 hours
Run comparable filtered-search benchmarks using the fixtures and ground truth from V01.
Implementation scope
Add case configuration/loading and supported filter mappings; connect recall/latency reporting with distribution and actual-selectivity metadata.
Acceptance criteria
Cases run reproducibly; recall uses filtered ground truth, and unsupported backend predicates are explicitly skipped rather than silently changed.
Dependencies
Boundaries and preparation
Requires V01. Reuse benchmark adapters; do not redesign every backend or mix incomparable filter semantics.
The estimate assumes familiarity with the implementation language, a working build/test environment, and maintainer-approved interfaces and fixtures. It includes implementation, focused validation and first review revisions; it excludes initial environment setup, dependency implementation and CI/review waiting. If those prerequisites are missing, split or re-estimate the task. Performance improvements must be measured against a reproducible baseline, including regressions; no speedup is guaranteed by this issue.
Reference and delivery
- Reference: https://github.com/zilliztech/VectorDBBench
- Deliver a runnable component/feature or example, focused correctness validation, and usage notes. A bounded component is not a claim that all production paths are complete.
- Coordinate with maintainers on the current target branch and related refactors before starting. For Milvus feature work, link the corresponding design in https://github.com/milvus-io/milvus-design-docs from the implementation PR; do not treat a pending design as already approved.
- Lenguaje dominante
- Python
- Estrellas
- 1.2k
- Forks
- 448
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Preparar el entorno
Inicia el contenedor de desarrollo del proyecto en tu navegador, con tu propia cuenta de GitHub.
- Incluye un Dockerfile o un archivo de Docker Compose
- Sin plantilla de pull request
- Sin guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de zilliztech/VectorDBBench
-
ChromaConfig default host cannot be serializedPosiblemente ocupada @IlyaKhalafi la tomó hace 3 días. Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 72/100
zilliztech/VectorDBBench#888 ·
-
Chroma drop_old clears unrelated collectionsPosiblemente ocupada @IlyaKhalafi la tomó hace 3 días. Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 72/100
zilliztech/VectorDBBench#887 ·
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 74/100
zilliztech/VectorDBBench#878 ·
-
Dificultad 1/5 Menos de una hora Aptitud para principiantes 65/100
zilliztech/VectorDBBench#683 ·
-
Hard-coded links in the code cause the server.baseUrlPath to fail in reverse proxy environmentsPosiblemente ocupada @IlyaKhalafi la tomó hace 3 días. Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 62/100
zilliztech/VectorDBBench#679 ·
Todos los issues de zilliztech/VectorDBBench
Issues similares
-
Python Volcengine provider returns failures instead of raising themPosiblemente ocupada @Ricardo-M-L la tomó hoy. Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 79/100
agent-infra/sandbox#248 ·
-
Textractor leaves empty temporary files when remote retrieval failsPosiblemente ocupada @HuaTNA la tomó hoy. Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 82/100
Los mantenedores suelen responder en 1 día
-
test(bm_generation): pin the learning parameters and CPU sync shortcutPosiblemente ocupada @iloveeyjafjalla la tomó hoy. Abierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 78/100
qboson/kaiwu-pytorch-plugin#1341 ·
Los mantenedores suelen responder en 2 días
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 70/100
elder-plinius/V3R1T4S#625 ·
Los mantenedores suelen responder en 1 día
-
Dificultad 2/5 1-3 horas Aptitud para principiantes 62/100
foxglove/mcap#1907 · 1 comentario ·
Los mantenedores suelen responder en 1 día