Summary
The user is discussing their transition to a multi-cluster Flyte setup that uses GPUs and is inquiring about two functionalities: 1) the ability of Flyte to automatically select a cluster for workflow execution based on GPU availability without manual configuration, and 2) the option to set a preferred cluster for resource allocation with a fallback to another cluster if the preferred one is unavailable. They note that manual configuration is required for this, while mentioning that Union has a more advanced routing system.
dpapatheodorou
Thanks Ketan, I'll take a look.
kumare
Sorry was on the phone earlier, but Flyte today has a routing system for workflows
kumare
You will have to manually configure this. Union on the other hand has a special routing system that is smarter. Cc <@UNW4VP36V> <@U049GPARFSQ>
dpapatheodorou
Hi Flyte community, we are moving our installation to a <https://docs.flyte.org/en/latest/deployment/deployment/multicluster.html|Multi cluster setup> and utilising https://docs.flyte.org/en/latest/user_guide/productionizing/configuring_access_to_gpus.html|GPUs. In this case, not all clusters may be built equally for a variety of reasons. How would Flyte work in these instances: