Skip to main content

@terascope/job-components / operations/job-observer / default

Class: default

An Observer for monitoring the Slice Analytics

Extends

Constructors

new default()

new default(context, apiConfig, executionConfig): default

Parameters

ParameterType
contextContext
apiConfigAPIConfig
executionConfigExecutionConfig

Returns

default

Overrides

default.constructor

Source

packages/job-components/src/operations/job-observer.ts:26

Properties

_currentIndex

protected _currentIndex: number

Source

packages/job-components/src/operations/job-observer.ts:18


_currentSliceId

protected _currentSliceId: string

Source

packages/job-components/src/operations/job-observer.ts:16


analyticsData

analyticsData: undefined | SliceAnalyticsData

Source

packages/job-components/src/operations/job-observer.ts:13


apiConfig

readonly apiConfig: Readonly<APIConfig>

Inherited from

default.apiConfig

Source

packages/job-components/src/operations/core/api-core.ts:20


collectAnalytics

collectAnalytics: boolean

Source

packages/job-components/src/operations/job-observer.ts:12


context

readonly context: Readonly<Context>

Inherited from

default.context

Source

packages/job-components/src/operations/core/core.ts:10


deadLetterAction

deadLetterAction: string

Inherited from

default.deadLetterAction

Source

packages/job-components/src/operations/core/api-core.ts:21


events

readonly events: EventEmitter<DefaultEventMap>

Inherited from

default.events

Source

packages/job-components/src/operations/core/core.ts:13


executionConfig

readonly executionConfig: Readonly<ExecutionConfig>

Inherited from

default.executionConfig

Source

packages/job-components/src/operations/core/core.ts:11


logger

readonly logger: Logger

Inherited from

default.logger

Source

packages/job-components/src/operations/core/core.ts:12

Methods

defaultAnalytics()

defaultAnalytics(): SliceAnalyticsData

Returns

SliceAnalyticsData

Source

packages/job-components/src/operations/job-observer.ts:90


getAnalytics()

getAnalytics(): undefined | SliceAnalyticsData

Returns

undefined | SliceAnalyticsData

Source

packages/job-components/src/operations/job-observer.ts:79


initialize()

initialize(): Promise<void>

Called during execution initialization, when this is called perform any async setup.

Returns

Promise<void>

Inherited from

default.initialize

Source

packages/job-components/src/operations/core/api-core.ts:37


onOperationComplete()

onOperationComplete(sliceId, index, processed): void

Parameters

ParameterType
sliceIdstring
indexnumber
processednumber

Returns

void

Source

packages/job-components/src/operations/job-observer.ts:64


onOperationStart()

onOperationStart(sliceId, index): void

Parameters

ParameterType
sliceIdstring
indexnumber

Returns

void

Source

packages/job-components/src/operations/job-observer.ts:52


onSliceInitialized()

onSliceInitialized(sliceId): Promise<void>

Parameters

ParameterType
sliceIdstring

Returns

Promise<void>

Source

packages/job-components/src/operations/job-observer.ts:41


rejectRecord()

rejectRecord(input, err): null

Reject a record using the dead letter action

Based on OpConfig._dead_letter_action the transformation can be handled any of the following ways:

  • "throw": throw the original error
  • "log": log the error and the data
  • "none": skip the error entirely OR a string to specify the api to use as the dead letter queue

Parameters

ParameterType
inputunknown
errError

Returns

null

null

Inherited from

default.rejectRecord

Source

packages/job-components/src/operations/core/api-core.ts:79


shutdown()

shutdown(): Promise<void>

Called during execution shutdown, when this is cleanup any open connections or destroy any in-memory state.

Returns

Promise<void>

Inherited from

default.shutdown

Source

packages/job-components/src/operations/core/api-core.ts:41


tryRecord()

tryRecord<I, R>(fn): (input) => null | R

Try catch a transformation on a record and place any failed records in a dead letter queue

See #rejectRecord for handling

Type parameters

Type parameter
I
R

Parameters

ParameterTypeDescription
fn(input) => Ra function to transform the data with

Returns

Function

a curried a function that will be called with the data and handle the dead letter action

Parameters
ParameterType
inputI
Returns

null | R

Inherited from

default.tryRecord

Source

packages/job-components/src/operations/core/api-core.ts:54