Summary
The user is building a Docker image with Bazel for Flyte workflows and encounters a ModuleNotFoundError for the 'pydantic' package when using the pyflyte command, which also affects the registration of ContainerTasks due to a missing 'kubernetes' package. This issue does not occur with Flytekit. The user resolved the problem by exporting PYTHONPATH. Additionally, the user is currently occupied with other tasks but expects to have availability to contribute in January.
vasani.ashwin
Yes, I can contribute. I'm currently working on other tasks, but I should have some availability to complete it in January.
david.espejo
uh thanks for sharing. Do you think you could contribute bazel rules? It would be very beneficial for the community
vasani.ashwin
exporting PYTHONPATH fixed this issue.
vasani.ashwin
Hi Flyte Community,
I'm building a Docker image using bazel that includes workflows, tasks, and launch plans. I'm registering to Flyte using pyflyte with the following command:
pyflyte register --copy none --image "${FLYTE_WORKFLOW_IMAGE}" --version "${VERSION}" "${FLYTE_WORKFLOW_DIR}"
The workflow in the image imports a package that, in turn, imports other pip packages like Pydantic, k8s. However, when I register with the above command, I encounter the error like below:
ModuleNotFoundError: No module named 'pydantic'
Can someone help me resolve this issue?
Due to this error, I'm also unable to register the ContainerTasks with PodSpec, which requires the kubernetes package. pyflyte register is also unable to find the kubernetes package even though it's present locally and in bazel. Oddly enough, this error doesn't occur when registering with Flytekit which just looks for r<https://github.com/flyteorg/flytekit/blob/750e4fbdc2035c4bf12365473f04292655fdf04b/flytekit/tools/repo.py#L49|egistrable entities>.