Repository navigation
[R][Python] Expand coverage of and align R/Python to C++ CSV WriteOptions #34577
Description
Describe the enhancement requested
A user reported elsewhere that they couldn't set the delimiter in R's CsvWriteOptions$create in order to write, for example, a tab-delimited text file instead of a CSV. The signature is currently:
CsvWriteOptions$create <- function(include_header = TRUE, batch_size = 1024L, null_string = "") {}These arguments map to options offered in arrow/cpp/arrow/csv/options.h for WriteOptions which includes a delimiter option in addition to others:
bool include_headerint32_t batch_sizechar delimiterstd::string null_stringstd::string eolQuotingStyle quoting_style
I also notice PyArrow has a different set of options in pyarrow.csv.WriteOptions than R does:
- include_header
- batch_size
- delimiter
- quoting_style
Reference: arrow/python/pyarrow/_csv.pyx
I think it would be really helpful if the full set of C++ CSV WriteOptions were available to both R and Python and that the set of options available in R and Python were identical. What do others think about aligning R and Python so all six C++ options are available to each? cc @thisisnic
Component(s)
Python, R
Activity
thisisnic commentedon Mar 30, 2023
Exposing that functionality sounds good to me! The only small comment I have is that given that
CSVWriteOptions$create()in R is an exported function, it'd be good to keep the existing arguments in the order they are now and add the new ones at the end.MartinNowak commentedon Jul 2, 2025
R side apparently done with #36436 (8f347c5).
github-actions commentedon Jul 3, 2026
This issue has been marked as stale because it has had no activity in the past 365 days. Please remove the stale label or comment below, or this issue will be closed in 14 days. If this improvement is still desired but has no current owner, please add the 'Status: needs champion' label.
apacheGH-34577 [Python] Expose eol and null_string csv WriteOptions
GH-34577 [Python] Expose eol and null_string csv WriteOptions (#46976)
AlenkaF commentedon Sep 9, 2026
Issue resolved by pull request 46976
#46976