F

Flyte enables you to build & deploy data & ML pipelines, hassle-free. The infinitely scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks. Explore and Join the Flyte Community!

Scheduling tasks on the same node

Summary

The user is seeking advice on how to ensure that all tasks in a workflow's pods are scheduled on the same node. They mention that the default execution-id label is applied to each pod, but podAffinity and podAntiAffinity rules cannot determine the execution-id of a pod before it is created, making it challenging to decide on the appropriate node for scheduling. They are looking for potential solutions to this issue.

Status
resolved
Tags
    Source
    #ask-the-community
      k

      kumare

      10/11/2024

      or Lets talk about Union :smile: there are ways

      k

      kumare

      10/11/2024

      just use affinity you can use pod_templates

      p

      peter.klingelhofer

      10/11/2024

      Hello all. Is there a good way to ensure that all of the tasks in a workflow's pods are scheduled on the same node? It seems that by default the execution-id label is placed on each scheduled pod, but because podAffinity / podAntiAffinity rules do not know what execution-id label the pod its trying to schedule has before its created, its hard to tell in which node to place the pod on. Any ideas? Thanks so much