GoogleCloudPlatform/kubectl-ai

[Feature]: Add session persistence for llama.cpp

Offen

#463 geöffnet am 08.08.2025

 (0 Kommentare) (1 Reaktion) (0 zugewiesene Personen)Go (708 Forks)auto 404
enhancementhelp wanted

Repository-Metriken

Stars
 (7.532 Sterne)
PR-Merge-Metriken
 (Keine gemergten PRs in 30 T)

Beschreibung

#443 added session persistence for Gemini, but other providers were left unimplemented.

We should add similar implementation of Initialize() to load chat history for llama.cpp. This can happen in gollm/llamacpp.go and will likely follow a similar flow to Gemini, where we convert api messages to the provider-specific messages and add them to the history.

Adding tests is also very welcomed. Basic flows like saving and loading sessions, creating a new session, deleting a session, and listing sessions should be covered. Edge cases like invalid session ID and corrupted save file should also be covered.

Contributor Guide