[io] pcl::io::raw_open opens files in text mode on Windows, so raw_read alters binary data
Maintainers usually reply within 3 days
Nobody has claimed this yet.
Assessment
- Difficulty
- 1/5
- Estimated time
- Under an hour
- Newbie friendliness
- 82/100
- Issue type
- Bug
- Clarity
- Clearly specified
- Activity status
- Active
- Tech stack
- cpp
- Domain
- operating-systems
Research direction
Start in pcl/io/low_level_io.h, in the _WIN32 branch where raw_open wraps ::_open; compare those overloads with the POSIX ones. Reproduce with a tiny binary file containing 0D 0A and 1A, as in the issue, and check raw_read byte counts. Then exercise the affected callers PCDReader::read for binary_compressed files and LineRGBD::loadTemplates. Done means Windows raw_read returns the file bytes unchanged and no longer truncates at CRLF or 0x1A.
Written by the indexing model from the issue text.
Description
Describe the bug
On Windows, pcl::io::raw_open (pcl/io/low_level_io.h) calls ::_open without _O_BINARY. The CRT default translation mode is text (_O_TEXT, unless the application changes _fmode). As a result, pcl::io::raw_read on that descriptor:
- collapses every CR LF pair into LF, compacting the buffer in place, and returns fewer bytes;
- stops at a 0x1A byte.
POSIX open has no text mode, so the same code reads different bytes on Linux and Windows.
PCL reads binary data through these wrappers: PCDReader::read for binary_compressed files and LineRGBD::loadTemplates. raw_open/raw_read are also public API for user code.
Expected behavior
raw_read returns the file's bytes unchanged, as it does on POSIX.
Current Behavior
A file holds the bytes 0D 0A 00 01 40 00 00 02, and 4 bytes are read from it:
| open flags | _read returns | buffer
| O_RDONLY (what raw_open does) | 3 | 0A 00 01 01
| O_RDONLY \| _O_BINARY | 4 | 0D 0A 00 01
With the bytes 1A 0A 00 00, text mode returns 0.
Consequences:
LineRGBD::loadTemplatesreads each.sqmmtentry withraw_read (ltm_fd, buffer, fsize)and checks only for-1. After the first0D 0Apair, every following byte is shifted by one and the tail holds stale bytes.sqmmt.deserializethen reads corrupted data.PCDReader::readreads the 4-byte compressed size of abinary_compressedfile withraw_readand checks onlynum_read < 0. On Windows the value is used only for the file-size check, because the whole file is mapped. When translation makes the value larger, a valid file is rejected with "Corrupted PCD file. The file is smaller than expected!". For example, a compressed size of0x01000A0D(16 779 789 bytes) is read as0x0101000A, which is 62 973 bytes too large.
To Reproduce
#include <pcl/io/low_level_io.h>
#include <fcntl.h>
#include <cstdio>
#include <fstream>
int main ()
{
const unsigned char bytes[] = {0x0D, 0x0A, 0x00, 0x01};
std::ofstream ("crlf.bin", std::ios::binary).write (reinterpret_cast<const char*> (bytes), sizeof (bytes));
int fd = pcl::io::raw_open ("crlf.bin", O_RDONLY);
unsigned char buf[4] = {};
const auto n = pcl::io::raw_read (fd, buf,
pcl::io::raw_close (fd);
std::printf ("n=%d %02X %02X %02X %02X\n",, buf[1], buf[2], buf[3]);
// Linux: n=4 0D 0A 00 01
// Windows: n=3 0A 00 01 01
}
Your Environment (please complete the following information):
- OS: Windows 11
- Compiler: MSVC (Visual Studio 2026)
- PCL Version: 1.12.1 and current master
Possible Solution
Open in binary mode inside the Windows wrappers. O_BINARY does not exist on POSIX, so callers cannot pass it portably.
#ifdef _WIN32
# include <fcntl.h> // _O_BINARY
...
inline int raw_open(const char * pathname, int flags, int mode)
{
return ::_open(pathname, flags | _O_BINARY, mode);
}
inline int raw_open(const char * pathname, int flags)
{
return ::_open(pathname, flags | _O_BINARY);
}
- Dominant language
- C++
- Stars
- 11.2k
- Forks
- 4.7k
- Avg merge
- 6d 13h
- Merged PRs (30d)
- 10
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from PointCloudLibrary/pcl
-
Difficulty 2/5 1-3 hours Newbie friendliness 67/100
PointCloudLibrary/pcl#6509 · 1 comment ·
Maintainers usually reply within 3 days
-
kind: bug status: triage
Difficulty 4/5 3-5 days Newbie friendliness 48/100
PointCloudLibrary/pcl#6537 ·
Maintainers usually reply within 3 days
-
[cmake] QHULL/FLANN dll missing when linking single modulePossibly taken @SIDDARTHAREDDY8 claimed this 5 days ago. Openkind: bug module: cmake
Difficulty 3/5 Half a day Newbie friendliness 50/100
PointCloudLibrary/pcl#6522 · 1 comment ·
Maintainers usually reply within 3 days
-
kind: bug status: triage
Difficulty 4/5 3-5 days Newbie friendliness 35/100
PointCloudLibrary/pcl#6395 ·
Maintainers usually reply within 3 days
-
[sample_consensus] Migrated the SSE and AVX implementations of countWithinDistance to RISC-V RVV 1.0Openkind: request status: triage
Difficulty 5/5 Over a week Newbie friendliness 25/100
PointCloudLibrary/pcl#6385 · 1 reaction ·
Maintainers usually reply within 3 days
All issues in PointCloudLibrary/pcl
Similar issues
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
nextcloud/passman-android#214 ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 1-3 hours Newbie friendliness 62/100
Maintainers usually reply within 1 day
-
feature wsl2
Difficulty 2/5 1-3 hours Newbie friendliness 80/100
microsoft/WSL#42306 · 3 comments ·
Maintainers usually reply within 1 day
-
2026.11.0 fails to install on Intel macOS: requirements.txt pins cryptography==50.0.2 for Darwin x86_64May be free again A pull request for this issue was closed without being merged. Open
Difficulty 1/5 Under an hour Newbie friendliness 87/100
esphome/esphome#22892 · 1 comment ·
Maintainers usually reply within 1 day
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 77/100
distante/esphome-components#50 · 1 comment ·
Maintainers usually reply within 1 day