Summary
The user is asking about the functionality of the retries feature in Spark tasks, specifically noting that their tasks face transient failures but do not retry after a "user error." They conducted a test with a Python task that raises an Exception, which also was not retried, and are questioning whether this behavior is intended.
kumare
kumare
Raise recoverable exception
mucahitkantepe
Hey, how does retries work? Our spark tasks sometimes have transient failures but they are not retried after a "user error".
Then I tested with a python task, just raising an Exception, it's not retried either.
Is the intended behaviour?