LF logo
by learnformula
search
Log in
search
Courses/Engineering/Technology & Science

Master Hyperparameter Tuning with Bayesian Optimization

Go beyond grid search to tune complex machine learning models with sequential model-based optimization.

Created bySoledad Galli
IntermediateUpdated Oct 2, 2026
Master Hyperparameter Tuning with Bayesian Optimization

What You'll Learn

check_circleApply Bayes' rule to update hyperparameter probability distributions based on model performance evidence.
check_circleAnalyze the trade-off between exploration and exploitation using various acquisition functions.
check_circleEvaluate the suitability of Gaussian processes, random forests, and TPE for different hyperparameter spaces.
check_circleImplement sequential model-based optimization to reduce computational costs in model tuning.
check_circleCompare the performance and parallelization capabilities of basic search methods versus Bayesian optimization.

About This Course

This course provides a comprehensive guide to hyperparameter optimization for computationally expensive machine learning models. It covers the transition from basic search strategies like grid and random search to advanced sequential model-based optimization (SMBO) techniques. Learners will explore the mathematical foundations of Bayesian inference, including conditional probability and Bayes' rule, and see how these concepts enable efficient hyperparameter tuning. The curriculum details the use of surrogate models such as Gaussian processes, random forests, and tree-structured Parzen estimators to approximate objective functions and guide the search for optimal hyperparameters.

Topics Covered

  • Sequential model-based optimization strategies
  • Bayesian inference and Bayes' rule
  • Multivariate Gaussian distributions
  • Gaussian process regression
  • Acquisition function mechanics
  • Sequential model-based algorithm configuration
  • Tree-structured Parzen estimators
  • Hyperparameter search strategy comparison

Your Instructor

Soledad Galli
Soledad Galli

Data Scientist | Python Developer | Author and Instructor

menu_book8 courses

I'm a data scientist, machine learning educator and open-source developer. I've built machine learning models for credit risk, insurance claims and fraud prevention, and I am passionate about helping data scientists build models that hold up in real-world projects. My courses are designed for intermediate and advanced practitioners. They cover feature engineering, feature selection, hyperparameter optimization, imbalanced data and the design of robust machine learning pipelines, with a strong emphasis on techniques you can apply straight away in your own work. In the age of generative AI, when a working model can be coded in minutes, the real skill lies in understanding the methods deeply enough to review that output with rigor and a critical eye, and that's exactly what these courses are built to develop. I'm the creator and maintainer of Feature-engine, an open-source Python library for feature engineering and feature selection used by data scientists worldwide. I'm also the author of three books published by Packt: Python Feature Engineering Cookbook, Feature Selection in Machine Learning, and Imbalanced Data: Myths, Mistakes and Modern Solutions. I speak regularly at conferences and meetups, and I enjoy connecting technical communities with the tools and knowledge they need to succeed. In 2018 I received a Data Science Leaders Award, and in 2019 LinkedIn recognized me as one of its voices in data science and analytics. Before moving into data science, I earned an MSc in Biology and a PhD in Biochemistry, then spent more than eight years as a research scientist at institutions including University College London and the Max Planck Institute. That scientific training still shapes how I teach: rigorous, evidence-based, and focused on understanding why a method works before reaching for it.

Credit Information

Is this course eligible for my CPD requirements as a Canadian CPA?

Provincial regulators of CPAs in Canada do not require that independent providers of CPD be approved to offer courses. Instead, individual CPAs are responsible for assessing whether a CPD activity meets their requirements, and may take activities from any source provided those requirements are met.

Every course offered on LearnFormula is delivered by a qualified subject matter expert or learning organization, and advances learning objectives that are relevant to the responsibilities or professional competencies of Canadian CPAs. All activities on LearnFormula are quantifiable in terms of hours, and are also verifiable, in that users receive documented evidence of their attendance via a certificate of completion after finishing a course (and this certificate is stored by LearnFormula indefinitely). Nearly 100,000 Canadian CPAs successfully satisfy their CPD requirements via LearnFormula on an annual basis.

What Students Are Saying

0.0
Student's Choice
0 reviews

Frequently Asked Questions

We are a registered provider with 327+ associations and regulatory bodies worldwide. We operate across 29 global markets including Canada, the US, Australia, and the UK. Every course page clearly displays its specific accreditations. Upon completion, you receive a professional certificate that can be validated online. Our certificates include all necessary accreditation details, credit hours, and completion dates, and are formatted specifically to meet the submission requirements of most global regulatory bodies.

You May Also Like

Audit & Assurance: Audit and Assurance Update

Assurance Update 2026

star5.0(152)
3 CPD hrs
Accounting & Tax: Personal Tax

How to do a Tax Return 2026

star4.9(73)
2.5 CPD hrs
Accounting & Tax: Technology for Accountants

Claude Fundamentals for Accountants (2026 Update)

star5.0(457)
2.5 CPD hrs