Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics

Dashboard
Notifications
Mark all as read
Q&A

Disentangling Machine Learning Theory with Cross-Validation

+2
−0

Does anyone see a link between machine learning's repeated epochs of training and the concept of cross-validation in linear modeling theory?

This article demonstrates what I perceive to be confusion about the validity of cross-validation combined with Bayesian optimization:

https://piotrekga.github.io/Pruned-Cross-Validation/

I am starting to believe cross-validation is actually a slower, less effective approximation of Bayesian inference. That opinion is informed by this Biometrika article from earlier this year (although I do not fully agree with the theoretical framework of coherence and prefer a more Jaynesian approach, but unfortunately he has been dead for more than 20 years):

https://academic.oup.com/biomet/article/107/2/489/5715611

Why does this post require moderator attention?
You might want to add some details to your flag.
Why should this post be closed?

2 comments

Trying again on data science sub-stack: https://datascience.stackexchange.com/q/87266/93564 seth.wagenman‭ 3 months ago

0 answers

Sign up to answer this question »

This community is part of the Codidact network. We have other communities too — take a look!

You can also join us in chat!

Want to advertise this community? Use our templates!