scheduler

superduper.backends.base.scheduler

Source code

cluster_events

cluster_events(events: List[superduper.base.base.Base])

Parameter	Description
events	List of events to be clustered.

Cluster events into table, create and job events.

consume_events

consume_events(events: List[superduper.base.base.Base],
     table: str,
     db: 'Datalayer',
     batch_size: int | None = None)

Parameter	Description
events	List of events to be consumed.
table	Queue Table.
db	Datalayer instance.
batch_size	Batch size for processing events.

Consume events from table queue.

consume_streaming_events

consume_streaming_events(events,
     table,
     db)

Parameter	Description
events	list of events.
table	table on which events were found.
db	Datalayer instance.

Consumer work from streaming events.

Streaming event-types are delete.

BaseScheduler

BaseScheduler(self)

Base class for handling publisher and consumer process.

This class is an implementation of message broker between producers (superduper db client) and consumers i.e listeners.

Future

Future(self,
     job_id: str) -> None

Parameter	Description
job_id	job identifier

Future output.