Repository navigation
[C++][Python] write_dataset with csv file format ignores delimiter #39961
Description
Describe the bug, including details regarding any error messages, version, and platform.
>>> ex = pa.Table.from_pydict({"A": ["A"], "B": ["B"], "C": ["C"]})
>>> csv = pa.dataset.CsvFileFormat(pa.csv.ParseOptions(delimiter=">"))
>>> pa.dataset.write_dataset(ex, path, format=csv, partitioning=pa.dataset.DirectoryPartitioning(pa.schema({"A": pa.string()})))
>>>
Output dataset contains:
"B","C"
"B","C"
But I specified delimiter as ">", but csv file still written with "," delimiter.
Component(s)
C++, Python
Activity
egolearner commentedon Apr 25, 2026
/assign
[-]write_dataset with csv file format ignores delimiter[/-][+][Python] write_dataset with csv file format ignores delimiter[/+][-][Python] write_dataset with csv file format ignores delimiter[/-][+][C++][Python] write_dataset with csv file format ignores delimiter[/+]GH-39961: [C++][Python] Propagate CSV parse delimiter to write options (
kou commentedon Jul 21, 2026
Issue resolved by pull request 49858
#49858