dernbu/lawnet-scraper
1
0
Fork 0
Code Issues 8 Pull requests Projects Releases Packages Wiki Activity Actions

[5] LawNet ingestion #5

New issue
Closed
opened 2026-06-13 18:59:39 +02:00 by dernbu · 0 comments
dernbu commented 2026-06-13 18:59:39 +02:00
Owner
Copy link

Objective

Implement complete, resumable LawNet discovery and artifact ingestion.

Scope

  • Implement the LawNet client and typed response models.
  • Implement stabilized, checkpointed discovery and staged publication.
  • Support both data.document and data.documents response shapes.
  • Preserve every HTML rendition and classify judgment, SLR, and unknown types.
  • Select the primary judgment rendition using documented rules.
  • Validate and store PDFs independently of document fetch success.
  • Add fixture-backed tests for known edge cases.

Dependencies

Depends on #3 and #4.

Completion criteria

  • A mocked multi-pass crawl stabilizes and publishes.
  • Judgment and SLR renditions are stored separately.
  • PDF-only failures do not discard document data.
  • Interrupted discovery and fetch work resumes.

Closure

Complete all child issues, or merge a feature-branch pull request that resolves this issue.

Detailed requirements: docs/plans/high-level-plan.md, Phase 5.

## Objective Implement complete, resumable LawNet discovery and artifact ingestion. ## Scope - Implement the LawNet client and typed response models. - Implement stabilized, checkpointed discovery and staged publication. - Support both `data.document` and `data.documents` response shapes. - Preserve every HTML rendition and classify judgment, SLR, and unknown types. - Select the primary judgment rendition using documented rules. - Validate and store PDFs independently of document fetch success. - Add fixture-backed tests for known edge cases. ## Dependencies Depends on #3 and #4. ## Completion criteria - A mocked multi-pass crawl stabilizes and publishes. - Judgment and SLR renditions are stored separately. - PDF-only failures do not discard document data. - Interrupted discovery and fetch work resumes. ## Closure Complete all child issues, or merge a feature-branch pull request that resolves this issue. Detailed requirements: `docs/plans/high-level-plan.md`, Phase 5.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
temp
feat/53-rename-lawnet-routes
push-xrsnvuvuvsul
feat/37-bff-storage-frontend
l
feat/49-pg-bff-storage
push-zzvxlnkylqsp
feat/quick-and-dirty
No results found.
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
dernbu/lawnet-scraper#5
No description provided.