Orphaned Records Management

Orphaned records are staging records that remain in PENDING, PROCESSED, or VALIDATED status from failed or abandoned ingestion attempts. These can cause issues:

• Failed batches may be reprocessed when new files are uploaded
• Database queries may include old records, affecting performance
• Storage space is consumed by obsolete data

The cleanup process marks these records as FAILED, ensuring they won't interfere with future operations.