Add DR and Failure scenario handling for Pauseless Ingestion#14794

Closed

KKcorps wants to merge 10 commits intoapache:pauseless_ingestion_without_failure_scenariosfrom 9aman:resolve-failures-pauseless-ingestion-draft

+3,128-62

Commits on Jan 3, 2025

WIP: Changes in the expected state while performing recovery during pauseless ingestion in RealtimeSegmentValidationManager
9aman
committed
Adding changes for ensurePartitionsConsuming function that is utilized by RealtimeSegmentValitdationManager to fix commit protocol failures
9aman
committed
Add Server side Reingestion API

Kartik Khare
authored and
9aman
committed
run segment level validation

Kartik Khare
authored and
9aman
committed
Add method to trigger reingestion

Kartik Khare
authored and
9aman
committed
Linting fixes

Kartik Khare
authored and
9aman
committed
Adding integration tests for 3 failure scenarios that can occur during commit protocol
9aman
committed

Commits on Jan 6, 2025

WIP: Reingestion test

Kartik Khare
authored and
Kartik Khare
committed
Fix bug with indexes in reingestion

Kartik Khare
authored and
Kartik Khare
committed

Commits on Jan 8, 2025

Add tests for reingestion

Kartik Khare
authored and
Kartik Khare
committed