Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Handle polars panics during collect #12866

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

ayax79
Copy link
Contributor

@ayax79 ayax79 commented May 14, 2024

When polars panics it will kill the instance of the plugin, causing all internal cached state to be lost. This most often happens when a collect operation is performed. This pull request wraps all collect panics in a panic handler.

related: #12732

Copy link
Member

@sholderbach sholderbach left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can polars join check the preconditions in a sound way to avoid #12732?

crates/nu_plugin_polars/src/lib.rs Show resolved Hide resolved
ayax79 and others added 2 commits May 14, 2024 16:33
Co-authored-by: Stefan Holderbach <sholderbach@users.noreply.github.com>
@ayax79
Copy link
Contributor Author

ayax79 commented May 15, 2024

I noticed my comment to this is a bit buried in the suggestion thread.

Can polars join check the preconditions in a sound way to avoid #12732?
No, now that everything is mostly lazy frame based, polars join is simply adding to the internal logical plan and returning it as a new lazy frame. The operations don't get applied until collect is called.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants