containers/ramalama

New OCI artifact type "docker model runner"

Open

#1,076 opened on Mar 31, 2025

View on GitHub
 (8 comments) (0 reactions) (0 assignees)Python (341 forks)github user discovery
good first issuestale-issue

Repository metrics

Stars
 (2,873 stars)
PR merge metrics
 (PR metrics pending)

Description

There's two main model as OCI artefact types outside of RamaLama, Ollama and Docker Model Runner, For Ollama we did the OCI pulling in python3 with one of the container image layers being the .gguf file. Part of this issue is to figure out what dockers format.

For Ollama we implemented the pulling of that format in python.

One of the questions is do we also pull the docker format in python3? Or do we explore pulling these formats via skopeo/podman?

Contributor guide

Research direction
Investigate Docker's OCI artifact format for model runner by reviewing Docker documentation and source code. Compare with existing Ollama implementation in RamaLama. Evaluate whether to use Python libraries (like `oci`) or leverage existing tools like skopeo/podman for pulling. Discuss with maintainers to align on approach.
Tech stack
pythondocker
Domain
backendai
Issue type
Research
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Mostly clear
Prerequisites
GitPython
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
35