Feature request: circuit breakers for automaterialization

[chrishiste]

Summary

Add support for circuit breakers in Dagster’s automaterialization config to prevent excessive retries on failing assets.

Motivation

When an asset repeatedly fails to materialize, it can lead to unnecessary compute usage and potential downstream issues. A circuit breaker mechanism would allow users to define:

• Max failures before stopping retries.
• Reset timeout to allow recovery before reattempting.
• Failure window to track failures within a specific period.

Proposed Solution

Introduce a circuit_breaker_config option within AutoMaterializePolicy, similar to:

circuit_breaker_config=CircuitBreakerConfig(
    max_failures=3,  # Number of consecutive failures before tripping
    reset_timeout=60,  # Time (seconds) before attempting to reset
    failure_window=300,  # Time window (seconds) for tracking failures
)

This would enhance resilience and efficiency by preventing wasteful retriggers and ensuring resources are allocated wisely.

Would love to hear thoughts from the team! 🚀