DPARS service
Wall-E
Retention-aware archival and cleanup intelligence
Purpose
Designed as an independent, observable module.
Wall-E is an independent archival service. It builds database-driven worklists, creates reduced-resolution long-term OME-TIFF derivatives and evaluates cleanup eligibility under fail-closed safety rules.
Capabilities
Independent Dagster job and runner
Database-driven archival eligibility
Validated reduced-resolution derivatives
Dry-run-first retention and cleanup logic
This public overview intentionally excludes patient data, internal addresses, credentials and sensitive deployment details.
Service workflow
Inside the pipeline
Execution flow
01
QueryDB-driven retention worklist
02
ArchiveReduced-resolution OME-TIFF
03
ValidateReopen, decode, metadata, checksum
04
ProtectFail-closed eligibility rules
05
AuditLifecycle decision persisted
Platform integration
D
DagsterCoordinates the service as an observable pipeline stage.
P
PostgreSQLPersists lineage, execution state and audit evidence.
↺
Failure-awareExplicit state transitions make retries and investigation traceable.