Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ENH] EnbPI and SPCI algorithms #6446

Open
1 of 3 tasks
fkiraly opened this issue May 18, 2024 · 0 comments
Open
1 of 3 tasks

[ENH] EnbPI and SPCI algorithms #6446

fkiraly opened this issue May 18, 2024 · 0 comments
Labels
enhancement Adding new functionality good first issue Good for newcomers implementing algorithms Implementing algorithms, estimators, objects native to sktime interfacing algorithms Interfacing existing algorithms/estimators from third party packages module:forecasting forecasting module: forecasting, incl probabilistic and hierarchical forecasting

Comments

@fkiraly
Copy link
Collaborator

fkiraly commented May 18, 2024

It would be nice to have a clean implementation of the "official" EnbPI algorithms in sktime or skpro. While we do have conformal prediction algorithms, these are not the "originals".

Some of the algorithms add intervals on forecasting methods, some are tabular and then applied to time series by reduction.

List of methods:

  • MultiDimSPCI - multivariate forecasting, sktime
  • SPCI - forecasting, sktime
  • EnbPI - this is an online tabular proba mode adder for tabular regression, with batch update, so should go in skpro

One a side note, EnbPI is indirectly interfaced via the dependency chain sktime -> skpro -> mapie, but in the mapie regressor it is part of a somewhat monolothic, complex estimator.

FYI @hamrel-cxu, are you active on GitHub? I suppose so due to recent contribs to MultiDimSPCI?

sktime follows a distributed algorithm ownership policy, so you could contribute the algorithms yourself, or review a contribution, or commit to maintenance and become an owner. Owners and authors of code are credited in the estimator overview: https://www.sktime.net/en/latest/estimator_overview.html

Another option could be turning the three mentioned repositories - EnbPI, SPCI, MultiDimSPCI - into packages with compatible interfaces, and listing the estimators in sktime. These would have to be maintained separately as packages, and give you more granular control over testing, CI, license, etc.

@fkiraly fkiraly added good first issue Good for newcomers implementing algorithms Implementing algorithms, estimators, objects native to sktime interfacing algorithms Interfacing existing algorithms/estimators from third party packages module:forecasting forecasting module: forecasting, incl probabilistic and hierarchical forecasting enhancement Adding new functionality labels May 18, 2024
@fkiraly fkiraly changed the title [ENH] EnbPI algorithms [ENH] EnbPI and SPCI algorithms May 18, 2024
fkiraly added a commit to sktime/skpro that referenced this issue May 21, 2024
This implements an EnbPI tabular regressor wrapper, see
sktime/sktime#6446.

This is a de-novo implementation based on the paper [Conformal
Prediction Interval for Dynamic
Time-series](http://proceedings.mlr.press/v139/xu21h.html) (Xu et al.
2021a)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Adding new functionality good first issue Good for newcomers implementing algorithms Implementing algorithms, estimators, objects native to sktime interfacing algorithms Interfacing existing algorithms/estimators from third party packages module:forecasting forecasting module: forecasting, incl probabilistic and hierarchical forecasting
Projects
None yet
Development

No branches or pull requests

1 participant