`generated_recursive_nested` integration test failing (Rust producing)
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 32/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- node.js, python, typescript
- Domain
- testing-qa
Research direction
Start by reproducing the generated_recursive_nested.json integration case from dev/archery/archery/integration/runner.py. Read tester_js.py and the /build/js/bin/stream-to-file.ts entry point, focusing on the Node/V8 crash while consuming the producer stream. Done means this case completes binary and stream validation without exit status 133.
Written by the indexing model from the issue text.
Description
Describe the bug, including details regarding any error messages, version, and platform.
https://github.com/apache/arrow-rs/actions/runs/16202231050/job/45743854054?pr=7774#step:14:704
#
# Fatal error in , line 0
# unreachable code
#
#
#
#FailureMessage Object: 0x7f0370d03420
----- Native stack trace -----
1: 0x7f0378769fd7 [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
2: 0x7f03794a491f V8_Fatal(char const*, ...) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
3: 0x7f03791b2fbd int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
4: 0x7f03791b4261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
5: 0x7f03791b45aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
6: 0x7f03791b303d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
7: 0x7f03791b4261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
8: 0x7f03791b45aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
9: 0x7f03791b303d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
10: 0x7f03791b4261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
11: 0x7f03791b45aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
12: 0x7f03791b303d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
13: 0x7f03791b4261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
14: 0x7f03791b45aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
15: 0x7f03791b303d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
16: 0x7f03791b4261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
17: 0x7f03791b45aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
18: 0x7f03791b303d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
19: 0x7f03791b4261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
20: 0x7f03791b45aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
21: 0x7f03791b303d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
22: 0x7f03791b4261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
23: 0x7f03791b45aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
24: 0x7f03791b303d int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHeapObject>(unsigned char, v8::internal::SlotAccessorForHeapObject) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
25: 0x7f03791b4261 v8::internal::Deserializer<v8::internal::Isolate>::ReadData(v8::internal::Handle<v8::internal::HeapObject>, int, int) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
26: 0x7f03791b45aa v8::internal::Deserializer<v8::internal::Isolate>::ReadObject(v8::internal::SnapshotSpace) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
27: 0x7f03791b2545 int v8::internal::Deserializer<v8::internal::Isolate>::ReadSingleBytecodeData<v8::internal::SlotAccessorForHandle<v8::internal::Isolate> >(unsigned char, v8::internal::SlotAccessorForHandle<v8::internal::Isolate>) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
28: 0x7f03791b2d31 v8::internal::Deserializer<v8::internal::Isolate>::ReadObject() [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
29: 0x7f03791b6796 v8::internal::ObjectDeserializer::Deserialize() [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
30: 0x7f03791b69a1 v8::internal::ObjectDeserializer::DeserializeSharedFunctionInfo(v8::internal::Isolate*, v8::internal::SerializedCodeData const*, v8::internal::Handle<v8::internal::String>) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
31: 0x7f03791a93d7 v8::internal::CodeSerializer::Deserialize(v8::internal::Isolate*, v8::internal::AlignedCachedData*, v8::internal::Handle<v8::internal::String>, v8::ScriptOriginOptions, v8::internal::MaybeHandle<v8::internal::Script>) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
32: 0x7f0378c92112 [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
33: 0x7f0378c924bd v8::internal::Compiler::GetSharedFunctionInfoForScriptWithCachedData(v8::internal::Isolate*, v8::internal::Handle<v8::internal::String>, v8::internal::ScriptDetails const&, v8::internal::AlignedCachedData*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason, v8::internal::NativesFlag) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
34: 0x7f0378bf09e6 v8::ScriptCompiler::CompileUnboundInternal(v8::Isolate*, v8::ScriptCompiler::Source*, v8::ScriptCompiler::CompileOptions, v8::ScriptCompiler::NoCacheReason) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
35: 0x7f03786d9b8b node::contextify::ContextifyScript::New(v8::FunctionCallbackInfo<v8::Value> const&) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
36: 0x7f0378c2e23e [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
37: 0x7f0378c2e560 v8::internal::Builtin_HandleApiCall(int, unsigned long*, v8::internal::Isolate*) [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
38: 0x7f03789f61b6 [/opt/conda/envs/arrow/bin/../lib/libnode.so.115]
Trace/breakpoint trap (core dumped)
======================================================================
Testing file /tmp/arrow-integration-l506x_1g/generated_recursive_nested.json
-- Creating binary inputs
-- Validating file
-- Validating stream
Traceback (most recent call last):
File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/runner.py", line 317, in _run_ipc_test_case
run_binaries(producer, consumer, test_case)
File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/runner.py", line 359, in _produce_consume
consumer.stream_to_file(producer_stream_path, consumer_file_path)
File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/tester_js.py", line 68, in stream_to_file
self.run_shell_command(cmd, cwd=ARROW_JS_ROOT)
File "/__w/arrow-rs/arrow-rs/dev/archery/archery/integration/tester.py", line 233, in run_shell_command
subprocess.check_call(cmd, **kwargs)
File "/opt/conda/envs/arrow/lib/python3.11/subprocess.py", line 413, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '/build/js/bin/stream-to-file.ts < /tmp/tmpr5l_fwrb/b829409c_generated_recursive_nested.producer_file_as_stream > /tmp/tmpr5l_fwrb/b829409c_generated_recursive_nested.consumer_stream_as_file' returned non-zero exit status 133.
- Dominant language
- TypeScript
- Stars
- 112
- Forks
- 23
- Avg merge
- 17h 55m
- Merged PRs (30d)
- 10
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from apache/arrow-js
-
Difficulty 3/5 1-2 days Newbie friendliness 68/100
-
Difficulty 3/5 1-2 days Newbie friendliness 55/100
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
Difficulty 3/5 1-2 days Newbie friendliness 50/100
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
mksglu/context-mode#1200 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
jaegertracing/jaeger-ui#4506 ·
-
area:desktop area:ui bug platform:macos
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
anthropics/claude-code#96687 ·
-
good first issue
Difficulty 1/5 Under an hour Newbie friendliness 95/100
AOSSIE-Org/DebateAI#582 · 2 comments ·