When executor of Spark3 application has a lifecycle the webhook wil allways deny it

[pvbouwel]

What happened?

• ✋ I have searched the open/closed issues and my issue is not listed.

Our spark applications were not getting executors.

Reproduction Code

I do not have a simple reproduction ready but in my understanding any spark spec with spark3 and a lifecycle on the executor will reproduce this.

Expected behavior

Normal spark executions. Executors coming up like if there were no lifecycle hook defined.

Actual behavior

Only the drivers became available. The spark-operator webhook showed it was denying them:

{"level":"INFO","ts":"2025-03-04T16:03:16.787Z","caller":"webhook/sparkpod_defaulter.go:93","msg":"Denying Spark pod","name":"my-app-bad7229561dd2950-exec-40","namespace":"spark","errorMessage":"Spark container executor not found in pod my-app-bad7229561dd2950-exec-40"}

Environment & Versions

• Kubernetes Version: 1.25.5
• Spark Operator Version: 2.0.2
• Apache Spark Version: 3.5.2

Additional context

I have patched the code and was able to get our environment operating as expected so I will create a PR soon. This will clarify the problem in the code which seems to have been solved for a lot of 'adders' but the lifecycle one seemed to be forgotten.

Impacted by this bug?

Give it a 👍 We prioritize the issues with most 👍