GoogleCloudPlatform/kubectl-ai

[Feature]: Add session persistence for llama.cpp

Ouverte

#463 ouverte le 8 août 2025

 (0 commentaire) (1 réaction) (0 personne assignée)Go (708 forks)auto 404
enhancementhelp wanted

Métriques du dépôt

Stars
 (7 532 étoiles)
Métriques de merge PR
 (Aucune PR mergée en 30 j)

Description

#443 added session persistence for Gemini, but other providers were left unimplemented.

We should add similar implementation of Initialize() to load chat history for llama.cpp. This can happen in gollm/llamacpp.go and will likely follow a similar flow to Gemini, where we convert api messages to the provider-specific messages and add them to the history.

Adding tests is also very welcomed. Basic flows like saving and loading sessions, creating a new session, deleting a session, and listing sessions should be covered. Edge cases like invalid session ID and corrupted save file should also be covered.

Guide contributeur