Hacktoberfest 2026: los issues que los mantenedores marcaron para octubre, abiertos y aptos para principiantes. Explorar issues de Hacktoberfest

context length and trajectory problems

Abierto
  • ¿Algo no está bien?
#233 0 comentarios 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 6 días

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
5/5
Tiempo estimado
Más de una semana
Aptitud para principiantes
30/100
Tipo de issue
Nueva funcionalidad
Claridad
Necesita aclaración
Estado de actividad
Tranquilo
Stack tecnológico
python
Área
ai

Línea de trabajo

Empieza por rastrear cómo se crea y se consume task.md durante el rollout, cómo se ensamblan los prompts durante la reflexión y dónde se genera trace raw.txt. Compara las rutas Claude Code Exec y skillopt sleep para determinar si se conservan el contexto, las muestras fallidas y las trayectorias intermedias de las herramientas; se considerará terminado cuando el contexto y los datos de trayectoria solicitados lleguen a la reflexión sin truncarse.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

Context size issue: For example, when training on the SearchQA dataset using Claude Code Exec as the backend, the context and question are written into a task.md file, which Claude reads to generate answers. This avoids the problem of input text being too long during the rollout phase, making it impossible for Claude to fully process the content. However, during the reflection phase, Skillopt currently does not support full Claude Code Exec as the backend. Instead, relevant information—including the context needed to answer the question—must be included directly in the prompt, then calling claude once. This leads to potential context truncation issues.

Alse skillopt sleep：During the rollout phase, skillopt sleep did not use full Claude execution but instead treated it as a chat endpoint, so context was likely limited. In the reflection phase, reference materials for context probably weren't fed into the reflector either, and each failed sample's question, answer, and failure reason were truncated.

Do you have any plans to optimize the above two context-related scenarios in the future?

The issue regarding the intermediate process trajectory: Taking the training data of the Searchqa dataset as an example, when using the Claude code execution backend, the intermediate execution trajectory of Claude code (such as the intermediate thinking process, tool calls, etc.) was not parsed and saved. Although I noticed that a trace raw.txt file was generated in the code, the content was just a very simple summary. Additionally, the trajectory process was not sent to the reflection stage.

Does the official have any optimization plans for this issue? If this situation can be supported, then the dataset only needs to provide the questions and answers. The agent will provide the intermediate trajectory and the final result, and all of them will be sent to the reflect stage. The reflector can simultaneously analyze the agent's output and the intermediate process, and propose more targeted skill optimization suggestions.

Lenguaje dominante
Python
Estrellas
18k
Forks
1.7k
Merge medio
6 d 18 h
PR fusionados (30 d)
12

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de microsoft/SkillOpt

Todos los issues de microsoft/SkillOpt

Issues similares

Más issues de Python

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.