[feat] Track Exact Fast-LLM Version in Training Outputs and wandb Logs
Nadie ha tomado este issue todavía.
Evaluación
- Dificultad
- 3/5
- Tiempo estimado
- 1-2 días
- Aptitud para principiantes
- 35/100
- Tipo de issue
- Nueva funcionalidad
- Claridad
- Bastante claro
- Estado de actividad
- Estancado
- Stack tecnológico
- git, python
- Área
- devtools, machine-learning
Línea de trabajo
The payload names no source files, so start by finding where training output directories are created and where the wandb run is initialized. Derive the version from git describe --tags --dirty with a commit-hash fallback, then write it to fast_llm_version.txt, add it to the wandb config and a tag, and print it at startup. Done means a run's output directory and wandb run both show the version string. The thread has had no reply for about 646 days, so confirm the approach with maintainers before starting.
Escrito por el modelo de indexación a partir del texto del issue.
Descripción
🧐 Problem Description
The version of Fast-LLM used for training is currently not easily accessible. While training job specs (e.g., Toolkit, Kubeflow) provide the image path/URL, references like ghcr.io/servicenow/fast-llm:latest don't indicate which commit or tagged version was used. This makes it difficult to trace back to the exact codebase version for a training run.
💡 Proposed Solution
Include a version string in the output directory of each training run and log it to wandb for visibility.
Details:
- For tagged release commits, use the semantic version (e.g.,
v1.2.3). - For non-tagged commits, include the commit hash (e.g.,
abcdef1) and mark the build as "dirty" if uncommitted changes exist (e.g.,abcdef1-dirty). - Example formats:
- Tagged release:
v1.2.3 - Non-tagged commit:
abcdef1 - Modified tagged release:
v1.2.3-dirty
- Tagged release:
This version string should:
- Be written to a file in the training output directory (e.g.,
fast_llm_version.txt). - Be logged to wandb:
- As part of the run configuration (
wandb.init(config=...)). - As a standalone field (
wandb.log). - Optionally, as a tag for easier filtering (
wandb.init(tags=...)).
- As part of the run configuration (
- Be shown in stdout logs.
🔄 Alternatives Considered
- Using container image tags in job specs:
- Problem: Tags like
latestare ambiguous. Job descriptions may not persist (e.g., they could be garbage-collected or lost when a Kubernetes instance is decommissioned).
- Problem: Tags like
📈 Potential Benefits
- Reproducibility: Trace models back to the exact version of Fast-LLM used.
- Transparency: Facilitates auditing and debugging of training runs.
- Usability: Avoids manual tracking of version information.
📝 Additional Context
This feature aligns with best practices for software versioning and reproducibility. Common formats like semantic versioning (semver) and commit hashes are widely supported and easy to interpret.
Relevant references:
- Semantic Versioning
- Git documentation on describing tags.
- wandb documentation on logging custom metrics and tags.
- Lenguaje dominante
- Python
- Estrellas
- 337
- Forks
- 52
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Preparar el entorno
- Incluye un Dockerfile o un archivo de Docker Compose
- Tiene una plantilla de pull request
- Leer la guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Más de ServiceNow/Fast-LLM
-
Dificultad 4/5 3-5 días Aptitud para principiantes 25/100
ServiceNow/Fast-LLM#556 ·
-
Dificultad 4/5 3-5 días Aptitud para principiantes 30/100
ServiceNow/Fast-LLM#538 ·
-
enhancement
Dificultad 5/5 Más de una semana Aptitud para principiantes 12/100
ServiceNow/Fast-LLM#533 ·
-
Dificultad 5/5 Más de una semana Aptitud para principiantes 15/100
ServiceNow/Fast-LLM#510 · 1 comentario ·
-
Dificultad 5/5 Más de una semana Aptitud para principiantes 12/100
ServiceNow/Fast-LLM#507 ·
Todos los issues de ServiceNow/Fast-LLM
Issues similares
-
Add `openai_safety_identifier`, the replacement for the `user` field that `openai_user` sendsAbierto
Dificultad 2/5 1-3 horas Aptitud para principiantes 70/100
pydantic/pydantic-ai#12091 ·
Los mantenedores suelen responder en 1 día
-
bug
Dificultad 2/5 1-3 horas Aptitud para principiantes 88/100
Los mantenedores suelen responder en 1 día
-
Enhance blog readabilityAbiertoCSS enhancement good first issue
Dificultad 2/5 1-3 horas Aptitud para principiantes 70/100
pychess/pychess-variants#2448 ·
Los mantenedores suelen responder en 1 día
-
Bump locked PyTensor so Apple clang 21 does not pass -ld64Posiblemente ocupada @drbenvincent la tomó hoy. Abiertobug dev ops
Dificultad 2/5 1-3 horas Aptitud para principiantes 70/100
Los mantenedores suelen responder en 2 días
-
ai_p2 bug comp-datalake
Dificultad 2/5 1-3 horas Aptitud para principiantes 85/100
ClickHouse/ClickHouse#128306 · 1 comentario ·
Los mantenedores suelen responder en 1 día