LF logo
by learnformula
search
Log in
search
Courses/Engineering/Technology & Science

Hyperparameter Tuning: Master Grid and Random Search

Go beyond default settings with robust tuning, cross-validation, and performance metrics for better performing machine learning models.

Created bySoledad Galli
IntermediateUpdated Oct 2, 2026
Hyperparameter Tuning: Master Grid and Random Search

What You'll Learn

check_circleDistinguish between intrinsic model parameters and external hyperparameters
check_circleSelect appropriate performance metrics for classification and regression tasks
check_circleImplement custom scoring functions using scikit-learn
check_circleApply cross-validation schemes to estimate generalization error
check_circleExecute grid and random search strategies for hyperparameter optimization

About This Course

This course provides a comprehensive framework for optimizing machine learning models through systematic hyperparameter tuning and rigorous validation techniques. It covers the distinction between model parameters and hyperparameters, the implementation of various classification and regression metrics, and the application of cross-validation schemes to ensure reliable generalization. Learners will explore practical search strategies including manual, grid, and random search, while gaining hands-on experience with scikit-learn to build custom scoring functions and evaluate model performance. The content emphasizes balancing computational costs with model accuracy and preventing overfitting through advanced techniques like nested cross-validation.

Topics Covered

  • Model parameters versus hyperparameters
  • Classification and regression performance metrics
  • Custom scoring function implementation
  • Cross-validation schemes and generalization error
  • Manual hyperparameter tuning strategies
  • Grid search and random search optimization
  • Nested cross-validation for unbiased evaluation
  • Low effective dimension in hyperparameter spaces

Your Instructor

Soledad Galli
Soledad Galli

Data Scientist | Python Developer | Author and Instructor

menu_book8 courses

I'm a data scientist, machine learning educator and open-source developer. I've built machine learning models for credit risk, insurance claims and fraud prevention, and I am passionate about helping data scientists build models that hold up in real-world projects. My courses are designed for intermediate and advanced practitioners. They cover feature engineering, feature selection, hyperparameter optimization, imbalanced data and the design of robust machine learning pipelines, with a strong emphasis on techniques you can apply straight away in your own work. In the age of generative AI, when a working model can be coded in minutes, the real skill lies in understanding the methods deeply enough to review that output with rigor and a critical eye, and that's exactly what these courses are built to develop. I'm the creator and maintainer of Feature-engine, an open-source Python library for feature engineering and feature selection used by data scientists worldwide. I'm also the author of three books published by Packt: Python Feature Engineering Cookbook, Feature Selection in Machine Learning, and Imbalanced Data: Myths, Mistakes and Modern Solutions. I speak regularly at conferences and meetups, and I enjoy connecting technical communities with the tools and knowledge they need to succeed. In 2018 I received a Data Science Leaders Award, and in 2019 LinkedIn recognized me as one of its voices in data science and analytics. Before moving into data science, I earned an MSc in Biology and a PhD in Biochemistry, then spent more than eight years as a research scientist at institutions including University College London and the Max Planck Institute. That scientific training still shapes how I teach: rigorous, evidence-based, and focused on understanding why a method works before reaching for it.

Credit Information

Is this course eligible for my CPD requirements as a Canadian CPA?

Provincial regulators of CPAs in Canada do not require that independent providers of CPD be approved to offer courses. Instead, individual CPAs are responsible for assessing whether a CPD activity meets their requirements, and may take activities from any source provided those requirements are met.

Every course offered on LearnFormula is delivered by a qualified subject matter expert or learning organization, and advances learning objectives that are relevant to the responsibilities or professional competencies of Canadian CPAs. All activities on LearnFormula are quantifiable in terms of hours, and are also verifiable, in that users receive documented evidence of their attendance via a certificate of completion after finishing a course (and this certificate is stored by LearnFormula indefinitely). Nearly 100,000 Canadian CPAs successfully satisfy their CPD requirements via LearnFormula on an annual basis.

What Students Are Saying

0.0
Student's Choice
0 reviews

Frequently Asked Questions

We are a registered provider with 327+ associations and regulatory bodies worldwide. We operate across 29 global markets including Canada, the US, Australia, and the UK. Every course page clearly displays its specific accreditations. Upon completion, you receive a professional certificate that can be validated online. Our certificates include all necessary accreditation details, credit hours, and completion dates, and are formatted specifically to meet the submission requirements of most global regulatory bodies.

You May Also Like

Audit & Assurance: Audit and Assurance Update

Assurance Update 2026

star5.0(152)
3 CPD hrs
Accounting & Tax: Personal Tax

How to do a Tax Return 2026

star4.9(73)
2.5 CPD hrs
Accounting & Tax: Technology for Accountants

Claude Fundamentals for Accountants (2026 Update)

star5.0(457)
2.5 CPD hrs