Scan a Parquet blob into a Python Polars LazyFrame
Description
Section titled “Description”Scans a Parquet file via a storage handler created by [init_storage_handler()(init_storage_handler/) and returns the resulting Python Polars LazyFrame without collecting it into memory. Optionally returns the Parquet metadata as well. The source is only read when the query plan is executed, e.g. with collect(streaming = TRUE).
scan_parquet_blob_as_lf(handler, blob_name, include_metadata = FALSE, ...)Arguments
Section titled “Arguments”| Argument | Description |
|---|---|
handler |
A Python object of class StorageHandler. |
blob_name |
The path/name of the blob/file. |
include_metadata |
Logical; if TRUE, return both LazyFrame and metadata. |
... |
Additional arguments passed to handler$scan_parquet_blob(). |
A Python Polars LazyFrame, or a list with components lf and metadata if include_metadata = TRUE.