dernbu/lawnet-scraper
1
0
Fork 0
Code Issues 8 Pull requests Projects Releases Packages Wiki Activity Actions

feat: add PostgreSQL storage provider for LawNet BFF #57

Closed
dernbu wants to merge 0 commits from push-zutnwvyyvypw into main
pull from: push-zutnwvyyvypw
merge into: dernbu:main
Conversation 0 Commits - Files changed - +714 -7
dernbu commented 2026-06-14 12:06:38 +02:00
Owner
Copy link

Summary

Implements the PostgreSQL storage provider for the LawNet BFF, adding an environment-variable-driven storage provider switch (BFF_STORAGE=filesystem|postgres).

This PR has 2 commits:

  1. Schema + store implementation — Flyway V2 migration, LawnetPostgresStore, factory switch, integration tests
  2. Schema rename — lawnet.* → app.* (generic schema, not LawNet-specific)

Changes

  • Flyway V2 migration — 6 tables under app schema (judgments, corams, catchwords, artifacts, artifact_data, citations) with indexes; merged judgment_sources columns directly into judgments
  • LawnetPostgresStore — full implementation of the LawnetStore interface using pg.Pool with parameterized queries
  • Factory switch — getLawnetStore() reads BFF_STORAGE env var; "postgres" creates a Pool from DATABASE_URL, otherwise falls back to LawnetFileSystemStore
  • Config — added BFF_STORAGE to compose.yaml and .env.example
  • Integration tests — 19 tests that self-seed fixture data, gracefully skipped when DATABASE_URL is absent

Verification

  • tsc --noEmit — clean
  • eslint — clean
  • prettier --check — clean
  • Filesystem store tests (17 tests) continue to pass unchanged
  • PostgreSQL store tests (19 tests) pass against a real database
  • Flyway V2 migration applies cleanly and is a no-op on reapply
  • docker compose config passes

Closes #49

## Summary Implements the PostgreSQL storage provider for the LawNet BFF, adding an environment-variable-driven storage provider switch (`BFF_STORAGE=filesystem|postgres`). This PR has 2 commits: 1. **Schema + store implementation** — Flyway V2 migration, LawnetPostgresStore, factory switch, integration tests 2. **Schema rename** — `lawnet.*` → `app.*` (generic schema, not LawNet-specific) ## Changes - **Flyway V2 migration** — 6 tables under `app` schema (judgments, corams, catchwords, artifacts, artifact_data, citations) with indexes; merged `judgment_sources` columns directly into `judgments` - **LawnetPostgresStore** — full implementation of the `LawnetStore` interface using `pg.Pool` with parameterized queries - **Factory switch** — `getLawnetStore()` reads `BFF_STORAGE` env var; `"postgres"` creates a `Pool` from `DATABASE_URL`, otherwise falls back to `LawnetFileSystemStore` - **Config** — added `BFF_STORAGE` to `compose.yaml` and `.env.example` - **Integration tests** — 19 tests that self-seed fixture data, gracefully skipped when `DATABASE_URL` is absent ## Verification - [x] `tsc --noEmit` — clean - [x] `eslint` — clean - [x] `prettier --check` — clean - [x] Filesystem store tests (17 tests) continue to pass unchanged - [x] PostgreSQL store tests (19 tests) pass against a real database - [x] Flyway V2 migration applies cleanly and is a no-op on reapply - [x] `docker compose config` passes Closes #49
- Add V2 Flyway migration with lawnet schema (judgments, corams,
  catchwords, artifacts, artifact_data, citations)
- Merge judgments and judgment_sources into one table with
  lawnet_docid and elitigation_slug columns
- Implement LawnetPostgresStore implementing LawnetStore interface
  using pg.Pool
- Wire BFF_STORAGE env var switch in getLawnetStore() factory
  (filesystem | postgres)
- Add BFF_STORAGE to compose.yaml and .env.example
- Add 19 PostgreSQL-backed integration tests that self-seed fixture
  data and skip when DATABASE_URL is absent

Refs: #49
refactor: rename lawnet schema to app
Some checks failed
CI / merge-check (pull_request) Failing after 52s
Details
522dd3272d 
Move all storage tables from lawnet.* to app.* so the schema
is not LawNet-specific and can hold data from other sources.
dernbu closed this pull request 2026-06-14 12:25:26 +02:00
Some checks failed
CI / merge-check (pull_request) Failing after 52s
Required
Details

Pull request closed

This pull request cannot be reopened because the branch was deleted.
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
dernbu/lawnet-scraper!57
No description provided.