@terascope/data-mate / teal-frame/line-stream

teal-frame/line-stream

Functions

distinctLines(lines): AsyncIterableIterator<string>

Yields each distinct line once, in order. Backs rowsWithoutDuplicates, which compares whole rendered rows. Keeps every distinct line in memory.

Parameter	Type
`lines`	`AsyncIterable`<`string`>

AsyncIterableIterator<string>

parseLines(lines): AsyncIterableIterator<Record<string, unknown>>

Parameter	Type
`lines`	`AsyncIterable`<`string`>

AsyncIterableIterator<Record<string, unknown>>

writeLines(path, lines): Promise<void>

Writes lines to a file, each followed by a newline, matching what COPY writes.

Parameter	Type
`path`	`string`
`lines`	`AsyncIterable`<`string`>

Promise<void>