Hacktoberfest 2026: những issue maintainer đã đánh dấu cho tháng Mười, đang mở và phù hợp người mới. Xem issue Hacktoberfest

[BUG] nvds_batch_meta_copy_func sets NvDsFrameMeta pipeline_width and pipeline_height to 0

Đang mở
  • Có gì không ổn?
#103 0 bình luận 0 reaction 0 người được giao Xem trên GitHub

Maintainer thường phản hồi trong vòng 1 ngày

Chưa có ai nhận issue này.

Đánh giá

Độ khó
4/5
Thời gian dự kiến
3-5 ngày
Mức phù hợp với người mới
45/100
Loại issue
Lỗi
Độ rõ ràng
Đặc tả rõ ràng
Mức độ hoạt động
Sôi nổi
Công nghệ
cpp
Lĩnh vực
backend, computer-vision

Hướng nghiên cứu

Start with the reported nvds_batch_meta_copy_func() behavior in libnvds_meta.so and compare the copied NvDsFrameMeta fields in the provided C reproducer. The issue gives a standalone compile and run command using nvdsmeta.h, libnvds_meta.so, and GStreamer, plus a pipeline reproduction through nvvideoconvert. Done means both copied pipeline dimensions retain the original values; the implementation source or tests are not identified in the issue.

Do mô hình lập chỉ mục viết ra từ nội dung của issue.

Mô tả

Describe the bug

nvds_batch_meta_copy_func() in libnvds_meta.so sets pipeline_width and pipeline_height of every NvDsFrameMeta to 0 in the copy. The other frame meta fields keep their values (frame_num, source_frame_width, source_frame_height, pad_index, source_id, buf_pts, ntp_timestamp, surface_index, bInferDone, misc_frame_info and so on), and so do the frame's user meta and object meta.

nvvideoconvert copies the batch meta into every new output buffer (gst_buffer_copy_into(outbuf, inbuf, GST_BUFFER_COPY_META | ...) in gstnvvideoconvert.c line 317, which runs this copy). So behind nvstreammux ! nvvideoconvert ! capsfilter format=RGB, every frame reports a 0x0 pipeline size. This happens on DeepStream 9.1 and 9.2.

Steps to reproduce

  1. A C program against libnvds_meta.so, with no GPU and no pipeline. Save it as copy.c:
#include <stdio.h>
#include <gst/gst.h>
#include "nvdsmeta.h"

int main(int argc, char **argv) {
  gst_init(&argc, &argv);
  NvDsBatchMeta *batch = nvds_create_batch_meta(1);
  batch->max_frames_in_batch = 1;
  NvDsFrameMeta *frame = nvds_acquire_frame_meta_from_pool(batch);
  nvds_add_frame_meta_to_batch(batch, frame);
  frame->frame_num = 7;
  frame->source_frame_width = 768;
  frame->source_frame_height = 432;
  frame->pipeline_width = 1920;
  frame->pipeline_height = 1080;

  NvDsBatchMeta *copy = nvds_batch_meta_copy_func(batch, NULL);
  NvDsFrameMeta *out = copy->frame_meta_list->data;
  printf("frame_num        %u -> %u\n", frame->frame_num, out->frame_num);
  printf("source_frame     %ux%u -> %ux%u\n", frame->source_frame_width, frame->source_frame_height,
         out->source_frame_width, out->source_frame_height);
  printf("pipeline         %ux%u -> %ux%u\n", frame->pipeline_width, frame->pipeline_height,
         out->pipeline_width, out->pipeline_height);
  return 0;
}

docker run --rm -v $PWD:/w -w /w --entrypoint bash nvcr.io/nvidia/deepstream:9.1-triton-multiarch -c \
  'D=/opt/nvidia/deepstream/deepstream; gcc copy.c -o /tmp/copy -I$D/sources/includes $(pkg-config --cflags --libs gstreamer-1.0) -L$D/lib -lnvds_meta -Wl,-rpath,$D/lib && /tmp/copy'

Output on 9.1 and 9.2:

frame_num        7 -> 7
source_frame     768x432 -> 768x432
pipeline         1920x1080 -> 0x0
  1. The same in a pipeline, with pyservicemaker. Save it as repro.py:
from pyservicemaker import BatchMetadataOperator, Pipeline, Probe


class Sizes(BatchMetadataOperator):
    def __init__(self, where):
        super().__init__()
        self.where = where
        self.seen = set()

    def handle_metadata(self, batch_meta):
        for frame in batch_meta.frame_items:
            self.seen.add((frame.pipeline_width, frame.pipeline_height, frame.source_width, frame.source_height))


before, after = Sizes("mux src"), Sizes("RGB caps src")
pipeline = Pipeline("pipeline-size")
pipeline.add("videotestsrc", "src", {"num-buffers": 30})
pipeline.add("capsfilter", "srccaps", {"caps": "video/x-raw,width=768,height=432"})
pipeline.add("nvvideoconvert", "conv")
pipeline.add("nvstreammux", "mux", {"batch-size": 1, "width": 1920, "height": 1080})
pipeline.add("nvvideoconvert", "torgb")
pipeline.add("capsfilter", "rgb", {"caps": "video/x-raw(memory:NVMM),format=RGB"})
pipeline.add("fakesink", "sink", {"sync": False})
pipeline.link("src", "srccaps", "conv")
pipeline.link(("conv", "mux"), ("", "sink_0"))
pipeline.link("mux", "torgb", "rgb", "sink")
pipeline.attach("mux", Probe("before", before))
pipeline.attach("rgb", Probe("after", after))
pipeline.start().wait()
for probe in (before, after):
    print(f"{probe.where}: (pipeline_width, pipeline_height, source_width, source_height) = {sorted(probe.seen)}")

docker run --rm --gpus all -v $PWD:/w -w /w --entrypoint bash nvcr.io/nvidia/deepstream:9.1-triton-multiarch -c \
  'pip install -q --break-system-packages pyyaml; python3 repro.py'

Output on 9.1 and 9.2:

mux src: (pipeline_width, pipeline_height, source_width, source_height) = [(1920, 1080, 768, 432)]
RGB caps src: (pipeline_width, pipeline_height, source_width, source_height) = [(0, 0, 768, 432)]

Expected behavior

The copy keeps pipeline_width and pipeline_height, as it keeps the other frame meta fields. In the pipeline above, the probe on the RGB caps src reads 1920x1080.

Environment details

  • Environment location: Docker on bare-metal (Ubuntu 26.04.1 LTS host, RTX A4000 Laptop GPU, driver 595.99.02)
  • Method of DeepStream install: Docker, nvcr.io/nvidia/deepstream:9.1-triton-multiarch (digest sha256:fd31f5b44ababdbdee8cd397a375e888191b49e402ac237254a4cdc239130f5b), DeepStream 9.1.0, pyservicemaker 0.0.1, TensorRT 10.16.0.72, CUDA 13.2. The same output on ghcr.io/nvidia/deepstream:9.2-triton-multiarch (digest sha256:94a49674eb475f0416ce49742430cfbd644258b4e6512b09c76ddd90164c6dc7).
  • Docker command: see the steps above
  • scripts/print_env.sh output, run inside the 9.1 container:
Click here to see environment details
 **git***
 Not inside a git repository
 
 ***OS Information***
 DISTRIB_ID=Ubuntu
 DISTRIB_RELEASE=24.04
 DISTRIB_CODENAME=noble
 DISTRIB_DESCRIPTION="Ubuntu 24.04.4 LTS"
 PRETTY_NAME="Ubuntu 24.04.4 LTS"
 NAME="Ubuntu"
 VERSION_ID="24.04"
 VERSION="24.04.4 LTS (Noble Numbat)"
 VERSION_CODENAME=noble
 ID=ubuntu
 ID_LIKE=debian
 HOME_URL="https://www.ubuntu.com/"
 SUPPORT_URL="https://help.ubuntu.com/"
 BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
 PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
 UBUNTU_CODENAME=noble
 LOGO=ubuntu-logo
 Linux b5ade298bb5a 7.0.0-38-generic #38-Ubuntu SMP PREEMPT_DYNAMIC Fri Sep  4 09:10:14 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
 
 ***GPU Information***
 Thu Oct 22 14:52:51 2026
 +-----------------------------------------------------------------------------------------+
 | NVIDIA-SMI 595.99.02              Driver Version: 595.99.02      CUDA Version: 13.2     |
 +-----------------------------------------+------------------------+----------------------+
 | GPU  Name                 Persistence-M | Bus-Id          Disp.A | Volatile Uncorr. ECC |
 | Fan  Temp   Perf          Pwr:Usage/Cap |           Memory-Usage | GPU-Util  Compute M. |
 |                                         |                        |               MIG M. |
 |=========================================+========================+======================|
 |   0  NVIDIA RTX A4000 Laptop GPU    Off |   00000000:01:00.0 Off |                  N/A |
 | N/A   63C    P0             25W /   80W |     161MiB /   8192MiB |      0%      Default |
 |                                         |                        |                  N/A |
 +-----------------------------------------+------------------------+----------------------+
 
 +-----------------------------------------------------------------------------------------+
 | Processes:                                                                              |
 |  GPU   GI   CI              PID   Type   Process name                        GPU Memory |
 |        ID   ID                                                               Usage      |
 |=========================================================================================|
 |  No running processes found                                                             |
 +-----------------------------------------------------------------------------------------+
 
 ***CPU***
 Architecture:                            x86_64
 CPU op-mode(s):                          32-bit, 64-bit
 Address sizes:                           39 bits physical, 48 bits virtual
 Byte Order:                              Little Endian
 CPU(s):                                  16
 On-line CPU(s) list:                     0-15
 Vendor ID:                               GenuineIntel
 Model name:                              11th Gen Intel(R) Core(TM) i9-11950H @ 2.60GHz
 CPU family:                              6
 Model:                                   141
 Thread(s) per core:                      2
 Core(s) per socket:                      8
 Socket(s):                               1
 Stepping:                                1
 CPU(s) scaling MHz:                      42%
 CPU max MHz:                             5000.0000
 CPU min MHz:                             800.0000
 BogoMIPS:                                5222.40
 Flags:                                   fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l2 cdp_l2 ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid rdt_a avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves split_lock_detect user_shstk dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp hwp_pkg_req vnmi avx512vbmi umip pku ospke avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid movdiri movdir64b fsrm avx512_vp2intersect md_clear ibt flush_l1d arch_capabilities
 Virtualization:                          VT-x
 L1d cache:                               384 KiB (8 instances)
 L1i cache:                               256 KiB (8 instances)
 L2 cache:                                10 MiB (8 instances)
 L3 cache:                                24 MiB (1 instance)
 NUMA node(s):                            1
 NUMA node0 CPU(s):                       0-15
 Vulnerability Gather data sampling:      Vulnerable
 Vulnerability Ghostwrite:                Not affected
 Vulnerability Indirect target selection: Mitigation; Aligned branch/return thunks
 Vulnerability Itlb multihit:             Not affected
 Vulnerability L1tf:                      Not affected
 Vulnerability Mds:                       Not affected
 Vulnerability Meltdown:                  Not affected
 Vulnerability Mmio stale data:           Not affected
 Vulnerability Old microcode:             Not affected
 Vulnerability Reg file data sampling:    Not affected
 Vulnerability Retbleed:                  Not affected
 Vulnerability Spec rstack overflow:      Not affected
 Vulnerability Spec store bypass:         Mitigation; Speculative Store Bypass disabled via prctl
 Vulnerability Spectre v1:                Mitigation; usercopy/swapgs barriers and __user pointer sanitization
 Vulnerability Spectre v2:                Mitigation; Enhanced / Automatic IBRS; IBPB conditional; PBRSB-eIBRS SW sequence; BHI SW loop, KVM SW loop
 Vulnerability Srbds:                     Not affected
 Vulnerability Tsa:                       Not affected
 Vulnerability Tsx async abort:           Not affected
 Vulnerability Vmscape:                   Not affected
 
 ***CMake***
 /usr/bin/cmake
 cmake version 3.28.3
 
 CMake suite maintained and supported by Kitware (kitware.com/cmake).
 
 ***g++***
 /usr/bin/g++
 g++ (Ubuntu 13.3.0-6ubuntu2~24.04.1) 13.3.0
 Copyright (C) 2023 Free Software Foundation, Inc.
 This is free software; see the source for copying conditions.  There is NO
 warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
 
 
 ***nvcc***
 /usr/local/cuda/bin/nvcc
 nvcc: NVIDIA (R) Cuda compiler driver
 Copyright (c) 2005-2026 NVIDIA Corporation
 Built on Mon_Mar_02_09:52:23_PM_PST_2026
 Cuda compilation tools, release 13.2, V13.2.51
 Build cuda_13.2.r13.2/compiler.37434383_0
 
 ***Python***
 
 ***Environment Variables***
 PATH                            : /opt/proto/bin:/opt/tritonserver/bin:/usr/local/nvidia/bin:/usr/local/cuda/bin:/usr/local/mpi/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/ucx/bin:/opt/amazon/efa/bin:/.local/bin
 LD_LIBRARY_PATH                 : /opt/tritonserver/lib:/opt/tritonclient/lib:/usr/src/tensorrt/lib:/opt/riva/lib:/usr/local/cuda-13/lib64:/usr/lib/x86_64-linux-gnu:/opt/hpcx/ucc/lib/:/opt/hpcx/ucx/lib/:/usr/local/cuda/compat/lib:/usr/local/nvidia/lib:/usr/local/nvidia/lib64:/.local/lib
 NUMBAPRO_NVVM                   :
 NUMBAPRO_LIBDEVICE              :
 CONDA_PREFIX                    :
 PYTHON_PATH                     :
 
 conda not found
 ***pip packages***
 /usr/bin/pip
 Package             Version
 ------------------- ---------------
 annotated-doc       0.0.4
 annotated-types     0.7.0
 anyio               4.12.1
 apparmor            4.0.1
 certifi             2026.2.25
 cupy-cuda13x        13.6.0
 distlib             0.4.0
 distro              1.9.0
 fastapi             0.138.1
 fastrlock           0.8.3
 filelock            3.25.2
 h11                 0.16.0
 httpcore            1.0.9
 httpx               0.27.2
 idna                3.11
 iniconfig           2.3.0
 jaraco.context      6.1.0
 jiter               0.13.0
 LibAppArmor         4.0.1
 numpy               1.26.4
 openai              1.107.3
 packaging           24.0
 partial-json-parser 0.2.1.1.post7
 pip                 24.0
 platformdirs        4.9.4
 pluggy              1.6.0
 pydantic            2.10.6
 pydantic_core       2.27.2
 Pygments            2.19.2
 pyservicemaker      0.0.1
 pytest              9.0.2
 python-apt          2.7.7+ubuntu5.2
 python-discovery    1.1.3
 scipy               1.16.3
 setuptools          78.1.1
 sniffio             1.3.1
 starlette           0.52.1
 tqdm                4.67.3
 tritonfrontend      2.67.0
 tritonserver        0.0.0
 typing_extensions   4.15.0
 typing-inspection   0.4.2
 virtualenv          21.2.0
 wheel               0.42.0

Additional context

A probe that reads frame pixels with pyservicemaker's Buffer.extract() must sit behind an nvvideoconvert to RGB (#101). There, frame.pipeline_width and frame.pipeline_height read 0, so the probe cannot get the size of the batched frame from the frame meta.

Ngôn ngữ chính
C++
Star
283
Fork
62
Merge trung bình
2 giờ 24 phút
Pull request đã merge (30 ngày)
20

Chuẩn bị môi trường

Dự án này không cung cấp dev container, Dockerfile hay hướng dẫn đóng góp, nên bạn cần tự thiết lập môi trường: hãy bắt đầu từ README và xem hướng dẫn đóng góp lần đầu của chúng tôi để biết các bước chung.

Bắt đầu từ đâu

  1. Đọc hết issue, rồi đọc hướng dẫn đóng góp của dự án.
  2. Bình luận trên issue rằng bạn sẽ nhận — tránh hai người làm cùng một việc.
  3. Fork repository và làm thay đổi trên một nhánh.
  4. Mở pull request có tham chiếu số hiệu của issue.

Issue khác của NVIDIA/DeepStream

Tất cả issue của NVIDIA/DeepStream

Issue tương tự

Thêm issue về C++

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.