F

Flyte enables you to build & deploy data & ML pipelines, hassle-free. The infinitely scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks. Explore and Join the Flyte Community!

Workflow Registration Issue in Flyte

Summary

The user is facing an issue with registering a workflow in Flyte using fast registration, as only files from the src directory are included in the container. They need access to files from the conf and data directories, which change with each workflow iteration, to improve the development cycle. The user notes that the current behavior of pyflyte limits this access due to how it determines the root folder. They propose that Flyte should copy all files from the current working directory and manage the Python path accordingly. As a temporary workaround, they suggest creating symlinks to the conf and data folders within src and using --deref-symlinks in the register command. They also reference a GitHub pull request related to this issue and mention the need to switch to using imagespec.

Status
resolved
Tags
    Source
    #ask-the-community