Machine Learning Bytes podcast

0:55

K-fold cross validation is the practice by which we separate a large data set into smaller pieces, independently process each data set, and then train our models on some number of the segments, and validate it on the rest. This is generally considered a best practice, or at least good practice, in machine learning, as it helps ensure the correct characterization of your model on the validation set. Machine Learning Mastery has a great post on the topic . --- Send in a voice message: https://podcasters.spotify.com/pod/show/mlbytes/message…

1
Stratified Sampling 0:59

for 6 years siden0:59

0:59

Stratified sampling provides a mechanism by which to split a larger dataset into smaller pieces. While random approaches are commonly used, stratified sampling ensures a relatively consistent distribution. This can result in an unwanted loss of variance, but can also beneficially reduce variance. --- Send in a voice message: https://podcasters.spotify.com/pod/show/mlbytes/message…

1
Boosting 0:51

for 6 years siden0:51

0:51

Boosting is also an ensemble meta-algorithm, like boosting. However, in boosting we teach a large number of weak, but specialized learners, and combine them according to their strengths. For more information on boosting, consider watching the University of Washington's great lecture on the topic . --- Send in a voice message: https://podcasters.spotify.com/pod/show/mlbytes/message…

1
Bagging 0:50

for 6 years siden0:50

0:50

Bagging is an ensemble meta-algorithm. Basically, we take some number of estimators (usually dozens-ish), train them each on some random subset of the training data. Then, we average the predictions of each individual estimator in order to make the resulting prediction. While this reduces the variance of your predictions (indeed, that is the core purpose of bagging), it may come at the trade off of bias. For a more academic basis, see slide #13 of this lecture by Joëlle Pineau at McGill University. --- Send in a voice message: https://podcasters.spotify.com/pod/show/mlbytes/message…

1
Bias, Variance, and the Bias-Variance Tradeoff 1:57

for 6 years siden1:57

1:57

The bias-variance trade-off is a key problem in your model search. While bias represents how well your model can capture the salient details of a problem, and generally correlates with more complex algorithms, it comes at the trade off of variance. Variance is the degree to which on individual predictions your estimators stray from the mean output on those values. High variance means that a model has overfit, and incorrectly or incompletely learned the problem from the training set. Most commonly, high bias = underfitting, high variance = overfitting. Please consider joining the conversation on Twitter . I also blog from time to time. You can find me at erikpartridge.com . For more academic sources, consider reading the slides from this fantastic Carnegie Mellon lecture . --- Send in a voice message: https://podcasters.spotify.com/pod/show/mlbytes/message…

1
Empirical Risk Minimization 0:38

for 6 years siden0:38