protocolbuffers/protobuf

[Python] Potential memory leak

Open

#24,257 创建于 2025年11月3日

在 GitHub 查看
 (3 评论) (0 反应) (0 负责人)C++ (71,223 star) (16,128 fork)batch import
help wantedpython

描述

What version of protobuf and what language are you using? Version: 6.33.0 Language: Python

What operating system (Linux, Windows, ...) and version? OS: Ubuntu Linux 22.0.1 Kernel: 6.8.0-87-generic

What runtime / compiler are you using (e.g., python version or gcc version) Python 3.12

What did you do? I've hacked together a little example repo (kudos to @Atheuz for the original that I've forked from), but essentially it is as follows:

obj = schema_pb2.SomeObj()

for _ in range(10_000_000):
    obj.ParseFromString(b"...")

del obj

What did you expect to see

That there would be no growth in memory usage

What did you see instead?

Until the obj is deleted, the memory grew uncontrollably.

Anything else we should know about your project / environment

This is a continuation of https://github.com/protocolbuffers/protobuf/issues/10088 (I think).

I've started a Google Group Discussion where it was explained to me, that the behaviour is intended and expected.

But it is still kind of counterintuitive to see that Unpack and ParseFromString actually allocate more and more memory. I think it deserves at least a mention in the docs on how to properly use them. And thus I was advised to open an issue here.

Thank you!

贡献者指南

[Python] Potential memory leak · protocolbuffers/protobuf#24257 | Good First Issue