Reading CSV file in DBBeaver dropping characters
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 48/100
Research direction
Start by reproducing the read_csv query against the attached test.csv and test_2.csv files using DuckDB 2.0.0, then compare the returned rows with the documented inputs. Trace the CSV reader's handling of quote and delimiter settings; done means configuring non-existent quote and delimiter characters preserves every input character and newline.
Written by the indexing model from the issue text.
Description
I am trying to data cleanse some csv with something like this
Input
22,"hjhjjh
Some text
",966542497
when i try and read this file using the following SQL (I want every newline as a new row)
select column0 A, from read_csv('test.csv', header = false, delim= '|', quote='$')
output
22,"hjhjjh
Some text
,966542497
however, the last line dropped the first char ".
if i change the data and add a space at the front of that row
Input 2
22,"hjhjjh
Some text
",966542497
select column0 A, from read_csv('test_2.csv', header = false, delim= '|', quote='$')
The first space char is removed, but keeps the " char
Output 2
22,"hjhjjh
Some text
",966542497
My expectation was that by defining the delimiter and quote to something non existing in the file, i would get the raw rows.
Duckdb version 2.0.0
- Dominant language
- C++
- Stars
- 127
- Forks
- 80
- Avg merge
- 13h 41m
- Merged PRs (30d)
- 44
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from duckdb/duckdb-java
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
duckdb/duckdb-java#832 · 2 comments ·
-
Native SIGSEGV in DuckDB JDBC when repeatedly executing queries with window functions and LIMIT 0 Open
Difficulty 4/5 3-5 days Newbie friendliness 48/100
duckdb/duckdb-java#871 · 4 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
duckdb/duckdb-java#872 ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
duckdb/duckdb-java#837 ·
-
executeBatch()` on a prepared INSERT runs s are ~1–2 orders of magnitude slower than the Appender Open
Difficulty 5/5 Over a week Newbie friendliness 42/100
duckdb/duckdb-java#815 · 1 comment ·
All issues in duckdb/duckdb-java
Similar issues
-
Difficulty 1/5 Under an hour Newbie friendliness 90/100
AXERA-TECH/ax-llm#77 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 90/100
games-on-whales/wolf#509 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
-
bug-unconfirmed
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
NVIDIA/cuda-samples#453 ·