Skip to content

Commit 70425c8

Browse files
committed
fix: amend arrow file read to use streams
1 parent 5e358a0 commit 70425c8

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/dve/core_engine/backends/implementations/duckdb/reference_data.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -46,4 +46,4 @@ def load_parquet_file(self, uri: str) -> DuckDBPyRelation:
4646
@mark_refdata_file_extension("arrow")
4747
def load_arrow_file(self, uri: str) -> DuckDBPyRelation:
4848
"""Load an arrow ipc file into a duckdb relation"""
49-
return self.connection.from_arrow(ipc.open_file(uri).read_all()) # type:ignore
49+
return self.connection.from_arrow(ipc.open_stream(uri).read_all()) # type:ignore

0 commit comments

Comments
 (0)