[3] Queue, scheduler, and worker shell #3

New issue

Closed

opened 2026-06-13 18:59:23 +02:00 by dernbu · 0 comments

dernbu commented

2026-06-13 18:59:23 +02:00

Owner

Objective

Build the durable ingestion execution framework.

Scope

Implement configuration and structured JSON logging.
Implement job insertion, atomic claiming, completion, retry, and dead state.
Implement five-minute leases and expiry recovery.
Schedule daily discovery and four-week artifact refreshes.
Implement bounded discovery continuation.
Add operator CLI commands for queue and refresh operations.

Dependencies

Depends on #2.

Completion criteria

One worker processes one job at a time.
Expired jobs are reclaimed.
Five consecutive failures produce a dead job.
Restarts do not create duplicate jobs or force discovery.

Closure

Complete all child issues, or merge a feature-branch pull request that resolves this issue.

Detailed requirements: docs/plans/high-level-plan.md, Phase 3.

## Objective Build the durable ingestion execution framework. ## Scope - Implement configuration and structured JSON logging. - Implement job insertion, atomic claiming, completion, retry, and dead state. - Implement five-minute leases and expiry recovery. - Schedule daily discovery and four-week artifact refreshes. - Implement bounded discovery continuation. - Add operator CLI commands for queue and refresh operations. ## Dependencies Depends on #2. ## Completion criteria - One worker processes one job at a time. - Expired jobs are reclaimed. - Five consecutive failures produce a dead job. - Restarts do not create duplicate jobs or force discovery. ## Closure Complete all child issues, or merge a feature-branch pull request that resolves this issue. Detailed requirements: `docs/plans/high-level-plan.md`, Phase 3.

dernbu referenced this issue

2026-06-13 18:59:30 +02:00

[4] Citation and catalog persistence #4

dernbu referenced this issue

2026-06-13 18:59:39 +02:00

[5] LawNet ingestion #5

dernbu referenced this issue

2026-06-13 18:59:46 +02:00

[6] eLitigation ingestion #6

dernbu closed this issue

2026-06-14 05:23:00 +02:00