F

Flyte enables you to build & deploy data & ML pipelines, hassle-free. The infinitely scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks. Explore and Join the Flyte Community!

Pipeline Error in Notebook Tasks

Summary

The user is facing an error in a pipeline involving two notebook tasks, where only the second task works correctly. The issue stems from a mismatch in expected input types for the first task, particularly when running on a remote cluster in a dynamic workflow. This problem has persisted since version 1.10.0 of the papermill plugin, and the user is seeking others with similar experiences and methods to reproduce the issue. They noted a fix is available in a GitHub pull request and mentioned that version 1.13.3 of the flytekitplugins-papermill includes a resolution for the problem.

Status
resolved
Tags
    Source
    #ask-the-community