F

Flyte enables you to build & deploy data & ML pipelines, hassle-free. The infinitely scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks. Explore and Join the Flyte Community!

Considering Flyte for Computational Biology Workflows

Summary

The user is in computational biology and previously used Luigi with an AWS batch plugin, which they modified for their work. Now at a new company, they are considering switching to Flyte for running computational biology/bioinformatics workflows that have varying time and resource requirements. They describe specific workflow examples that require different compute resources and mention the need for zero compute when not running pipelines. The user is seeking advice on whether Flyte is suitable for their use case and whether to use Flyte Kubernetes or Flyte AWS batch jobs, expressing uncertainty about the advantages or disadvantages of each option.

Status
resolved
Tags
    Source
    #ask-the-community