session: a job's stop waits for the log-retention sweep, and publishing its end first races folder teardown
Mantenedores costumam responder em até 1 dia
Ninguém assumiu esta issue ainda.
Avaliação
- Dificuldade
- 4/5
- Tempo estimado
- 3-5 dias
- Facilidade para iniciantes
- 68/100
- Tipo de issue
- Bug
- Clareza
- Claramente especificada
- Status de atividade
- Ativa
- Stack de tecnologia
- go
- Domínio
- backend, distributed-systems, testing-qa
Direção de pesquisa
Start with job.settle and jobSink.close in internal/session/jobs.go, searching for retention, then read the sweep in internal/session/jobretention.go and the wait logic in internal/session/task_job_park_test.go. Run the two named tests with GOMAXPROCS=2 under load. Done means job stopping no longer waits on retention, observers cannot race folder teardown, retention and shutdown behavior remain tested, and the new folder-removal test passes.
Escrita pelo modelo de indexação a partir do texto da issue.
Descrição
What happened
Since #1603 (log retention, in #1627), a job's ending runs the whole log-folder retention sweep before the job's status leaves running. Under load, a stopped job reads as running for 47–130 ms, against about 2 ms before. TestStopWorkDoesNotWakeAndOnlyFreshSubmissionRestarts fails 5 of 20 runs under load on #1627's head 6cc872c8e, and 0 of 20 on dev 837b2b06a.
The obvious fix, publishing the final status first and then sweeping, was tried on #1627 (8b0edfd6d) and reverted (2e007e33b). Anything that watches running() then removes the job's folder while the sweep is still writing in it. CI:
--- FAIL: TestAParkedWorkerIsHandedBackWithARecordBeforeItsWholeAllowance (1.05s)
testing.go:1464: TempDir RemoveAll cleanup: unlinkat …/003/.codeaf/jobs: directory not empty
waitSettled in internal/session/task_job_park_test.go polls !one.running(). Giving a task's copy back after its jobs end has the same shape in the product.
Replication
Deterministic (no model). On #1627's head, loaded (run beside another package's tests, or with GOMAXPROCS=2):
go test -run '^TestStopWorkDoesNotWakeAndOnlyFreshSubmissionRestarts$' -count=20 ./internal/session
A few runs fail. With 8b0edfd6d applied instead, run
-run '^TestAParkedWorkerIsHandedBackWithARecordBeforeItsWholeAllowance$' -count=50 under the same load. It fails on the TempDir cleanup.
Where
job.settleandjobSink.closeininternal/session/jobs.go(searchretention)- the sweep in
internal/session/jobretention.go
The fix
A job's stop is not slowed by retention, and no observer of a job's end can race the sweep. One way to get both: the sweep stops being part of any single job's ending. It runs as one registry-owned pass, which shutdown and the registry's close join, and which tolerates its directory disappearing. Test helpers that wait for a job's end wait on done, not on running().
Acceptance
- Unit:
TestStopWorkDoesNotWakeAndOnlyFreshSubmissionRestartspasses 50/50 underGOMAXPROCS=2with another package's tests running beside it. - Unit:
TestAParkedWorkerIsHandedBackWithARecordBeforeItsWholeAllowancepasses 50/50 under the same load. - Unit: a new test ends a job and immediately removes its jobs folder, as a copy's give-back does, and nothing is written into it afterwards.
- Unit: a new test proves retention still bounds the folder (the #1599 law) and that shutdown still joins a sweep in progress.
- Linguagem predominante
- Go
- Estrelas
- 115
- Forks
- 14
- Merge médio
- 9h 44min
- PRs com merge (30d)
- 775
Preparar o ambiente
Ainda não verificamos os arquivos de configuração deste projeto. Comece pelo README e veja nosso guia da primeira contribuição para os passos gerais.
Primeiros passos
- Leia a issue inteira e depois o guia de contribuição do projeto.
- Comente na issue dizendo que vai assumir — evita que duas pessoas façam o mesmo trabalho.
- Faça um fork do repositório e trabalhe em uma branch.
- Abra um pull request que referencie o número da issue.
Mais de Agent-Field/CodeAF
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 88/100
Agent-Field/CodeAF#1679 ·
Mantenedores costumam responder em até 1 dia
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 85/100
Agent-Field/CodeAF#1678 ·
Mantenedores costumam responder em até 1 dia
-
area:chat bug sev:papercut
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 86/100
Agent-Field/CodeAF#1592 ·
Mantenedores costumam responder em até 1 dia
-
codeaf do "" runs a paid job with an empty briefTalvez já em andamento @santoshkumarradha assumiu há 3 dias. Abertaarea:headless bug sev:critical
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 88/100
Agent-Field/CodeAF#1566 · 1 responsável ·
Mantenedores costumam responder em até 1 dia
-
area:chat feature
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 88/100
Agent-Field/CodeAF#1510 ·
Mantenedores costumam responder em até 1 dia
Todas as issues de Agent-Field/CodeAF
Issues semelhantes
-
[Docs] - Document minimum Terraform/OpenTofu version (>= 1.11) required by write-only argumentsAberta
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 92/100
MagaluCloud/terraform-provider-mgc#323 ·
Mantenedores costumam responder em até 11 dias
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 76/100
rossoctl/context-guru#366 ·
Mantenedores costumam responder em até 1 dia
-
stage-fail
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 72/100
siyuan-note/bazaar#2293 ·
Mantenedores costumam responder em até 1 dia
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 84/100
piraeusdatastore/piraeus-operator#1070 ·
Mantenedores costumam responder em até 1 dia
-
Dificuldade 2/5 1-3 horas Facilidade para iniciantes 68/100
Mantenedores costumam responder em até 1 dia