Hacktoberfest 2026: the issues maintainers tagged for October, open and beginner-friendly. Browse Hacktoberfest issues

Deeplabcut Live for Multi-Animal

Open
#130 0 comments 0 reactions 1 assignee View on GitHub

@C-Achard is already working on this.

Since Feb 3, 2026.

Assessment

This issue has not been assessed yet.

Description

bug tensorflow

I have used Deeplabcut GUI to train a model for poses of two rats, which includes three multi-animal-bodyparts and two unique-bodyparts. The model was tested in Deeplab GUI through a video and the result shows that all the 8 points could be dotted.
The main purpose of us is for real-time application, so we find Deeplabcut-Live for next step. We import the model through python code:
deeplabcut.export_model(config_path, shuffle=1, make_tar=False)
Then a new folder named exported-models was created, which included a configuration file pose_cfg.yaml and other model files. Finally, I used deeplabcut-live to process a test video in real time, code:

import cv2
from dlclive import DLCLive, Processor
import time

model_path = r"C:\Users\XHB\Desktop\Multi_Rat-HB-2025-07-31\exported-models\DLC_Multi_Rat_resnet_50_iteration-0_shuffle-1"
dlc_proc = Processor()
dlc_live = DLCLive(model_path, processor=dlc_proc)
cap = cv2.VideoCapture("2rat2.avi")
ret, frame = cap.read()
dlc_live.init_inference(frame)

while True:
    if not ret:
        break
    pose = dlc_live.get_pose(frame)
    time_end = time.time()
    for x, y, p in pose:
        if p > 0.5: 
            cv2.circle(frame, (int(x), int(y)), 5, (0, 255, 0), -1)
    cv2.imshow("DLC Live", frame)
    if cv2.waitKey(1) & 0xFF == ord('q'):
        break

cap.release()

The result shows that only 5 points could be dotted, including the 3 multi-animal-bodyparts of the first rat and the 2 unique-bodyparts, while the other 3 multi-animal-bodyparts of the second rat were neglected.
Thus, I wanna ask for help, how could I recognize all the 8 parts of the 2 rats.

result in Deeplabcut GUI:
Image

result in Deeplabcut-Live:
Image

configuration file in Deeplabcut GUI:
config.zip

configuration file in Deeplabcut GUI:
pose_cfg.zip

Dominant language
Python
Stars
240
Forks
57
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from DeepLabCut/DeepLabCut-live

All issues in DeepLabCut/DeepLabCut-live

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.