F

Flyte enables you to build & deploy data & ML pipelines, hassle-free. The infinitely scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks. Explore and Join the Flyte Community!

Kueue Batch Scheduler for Flyte

Summary

The user wants to use Kueue as a batch scheduler for Flyte with PyTorch and believes it can work despite documentation focusing on Yunikorn and K8s scheduler plugins. They note that sending a job to Kueue requires a PyTorchJob metadata.label for queue specification, which can be customized through the PyTorch plugin. The user is willing to enhance the PyTorch plugin backend and flytekit to add this capability. They also ask if anyone has experience using Kueue with Flyte and mention that modifying the metadata.labels of the PyTorchJob submitted by the plugin is not straightforward and needs to be addressed.

Status
resolved
Tags
    Source
    #ask-the-community