Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Develop #10

Merged
merged 10 commits into from
Oct 15, 2022
Merged

Develop #10

merged 10 commits into from
Oct 15, 2022

Conversation

pat-alt
Copy link
Member

@pat-alt pat-alt commented Oct 15, 2022

  • Wrapping models not machines.
  • Distinction between inductive and transductive.
  • Added Jackknife.

pat-alt and others added 10 commits October 12, 2022 14:15
@pat-alt pat-alt closed this Oct 15, 2022
@pat-alt pat-alt reopened this Oct 15, 2022
@pat-alt pat-alt merged commit 66bd956 into main Oct 15, 2022
This was referenced Oct 15, 2022

# Conformal prediction through dispatch:
"""
MMI.predict(conf_model::ConformalModel, Xnew, coverage::AbstractFloat=0.95)
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Type piracy? MMI.predict(::Model, ...) will always have a fitresult as the second argument here. And your method has an extra parameter coverage, which doesn't really fit into the MLJ API at all, unless you make it a hyperparameter (field of the model).

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @ablaom. Perhaps one way to avoid this altogether is to treat conformal prediction (set-valued or interval) as a separate functionality, while preserving the model's functionality to produce point predictions. See #14

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep. We have already have Interval <: Supervised but maybe can extend that further. Related is helping me out with this list of "target proxies" (predictions types) for the future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants