F

Flyte enables you to build & deploy data & ML pipelines, hassle-free. The infinitely scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks. Explore and Join the Flyte Community!

Developing Flytekit Plugins with Python

Summary

The user is asking about developing plugins for Flytekit and Propeller using Python for Kubernetes jobs, noting that Flyte currently only supports pods. The response clarifies that backend plugins must be written in Go and compiled into the Flyte backend, while agents can be written in Python but do not interact with the Kubernetes API server. For Kubernetes interactions, backend plugins are preferred as they can create jobs and custom resources. The user also mentions the possibility of using a scheduler for starting pods simultaneously and expresses interest in jobsets, which are a Kubernetes-specific plugin with a simpler API provided by the Go side. They are advised to refer to the documentation linked in the message.

Status
resolved
Tags
    Source
    #ask-the-community