F

Flyte

Flyte enables you to build & deploy data & ML pipelines, hassle-free. The infinitely scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks. Explore and Join the Flyte Community!

Workflow Development Tutorial Issue

Summary

The user is experiencing an issue while following a workflow development tutorial. After creating a project with flytectl create project, they receive an error when executing pyflyte run, indicating that the workflow could not be created due to the propeller namespace not being found. The user suspects this may be related to a delay in the creation of the Kubernetes namespace and is questioning whether this is expected behavior or a bug. They mention that the error occurs only if pyflyte run is executed immediately after creating the project and suggest that re-running pyflyte run or waiting briefly before running it can resolve the issue.

Status
resolved
Tags
    Source
    #ask-the-community
      p

      paullongtan

      10/1/2024

      I believe the namespace is created at the time of creating the new project. As this only happen if the pyflyte run is ran immediately after flytectl create project . Only in this rare case the error occurs. This can be solved by re-running pyflyte run or waiting for a short time before running pyflyte run .

      d

      david.espejo

      9/30/2024

      <@U07PHAY45UL> so is the namespace created at some point and then executions work correctly? I mean, is it a temporary failure or?

      p

      paullongtan

      9/27/2024

      Hello Community!

      While trying out the “Getting started with workflow development” part of the tutorial, I have encountered an issue that when running pyflyte run immediately after creating a new project through flytectl create project, the web console shows failed to create workflow in propeller namespace “projectName-domain” not found. I believe this is a similiar issue to https://github.com/flyteorg/flyte/issues/1173|issue. It seems that it takes time to create kubernetes namespace after running flytectl create project. If running pyflyte run too soon, the namespace may not be created in time. Is this an expected behavior of flytectl or should it be considered a bug? Thanks for the reply in advance!

      You can reproduce this issue by the script below: (change the project name accordingly to, it must be a new project)

            --id "new-project" \
      --labels "my-label=new-project" \
      --description "My Flyte project" \
      --name "My project"

pyflyte run --remote -p new-project -d development example.py wf --name Ada```