You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
When stopping a pipeline with CTRL+C, the batches from the step input queues are prepended back to the _BatchManager so no information is lost.
The _BatchManagerStep contains a data dictionary with batches from the predecessors steps, but when we're reingesting the batches from the input queue of a certain step, the batch.step_name is now equal to the step (not the predecessor step). This causes a KeyError exception.
Expected behaviour
The batch is added correctly back to the _BatchManagerStep and it can be used in the next pipeline execution if use_cache=True.
The text was updated successfully, but these errors were encountered:
Describe the bug
When stopping a pipeline with CTRL+C, the batches from the step input queues are prepended back to the
_BatchManager
so no information is lost.The
_BatchManagerStep
contains adata
dictionary with batches from the predecessors steps, but when we're reingesting the batches from the input queue of a certain step, thebatch.step_name
is now equal to the step (not the predecessor step). This causes aKeyError
exception.Expected behaviour
The batch is added correctly back to the
_BatchManagerStep
and it can be used in the next pipeline execution ifuse_cache=True
.The text was updated successfully, but these errors were encountered: