F

Flyte enables you to build & deploy data & ML pipelines, hassle-free. The infinitely scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks. Explore and Join the Flyte Community!

Cleanup Actions for Aborted Tasks

Summary

The user is asking about cleanup actions for aborted tasks, considering options such as "onerror" for workflows, task-level cleanup with agents, and eager mode. They are also thinking about a signal-catching method for cleanup within containers, although this method is uncertain. The user plans to submit a documentation PR if their approach works, noting that terminating from the UI does not seem to have any effect.

Status
open
Tags
    Source
    #ask-the-community
      j

      josh210

      10/4/2024

      It looks like this doesn't do anything when you terminate from the UI

      j

      josh210

      10/4/2024

      Fair, so the on failure is called for aborts too?

      k

      kumare

      10/3/2024

      that is by catching signals, but it is not guaranteed

      j

      josh210

      10/3/2024

      I think there might actually be another way to do within-container cleanup. I'm trying something out today and I'll open up a documentation PR if it works out

      k

      kumare

      10/3/2024

      Or use eager mode

      k

      kumare

      10/3/2024

      If you want task level cleanup then agents is the only way

      k

      kumare

      10/3/2024

      You can add onerror for workflow

      j

      josh210

      10/2/2024

      Is there any way to have a task do some cleanup when it's being aborted?