@terascope/data-mate / teal-frame/parquet-columns
teal-frame/parquet-columns
Functions
int64Column()
int64Column(
name,type,declared):string
Defined in: data-mate/src/teal-frame/parquet-columns.ts:43
Returns one column of the Parquet projection, with any 128-bit integer narrowed.
Parquet has no 128-bit integer, and DuckDB silently writes one as a DOUBLE, which changes
every value past 2^53. A stored Long is already a BIGINT; this handles computed values
(n::HUGEINT + 1, a UDF result, ipToInt on IPv6).
The column is cast to the type declared in the config. Editing DuckDB's rendered type string
instead would also rewrite a struct member named HUGEINT. The cast is exact for values that
fit and fails the write with DuckDB's out-of-range error for values that do not. A wide column
the config does not declare is rejected, because there is no correct type to choose.
Parameters
| Parameter | Type |
|---|---|
name | string |
type | DuckDBType |
declared | string | undefined |
Returns
string