Build dynamic, efficient, and framework-agnostic machine learning pipelines using the Define-by-Run API.
This course provides a comprehensive guide to using Optuna for hyperparameter optimization in machine learning workflows. It covers the library's core architecture, including the Define-by-Run API, which allows for flexible and dynamic search space definitions. Participants will learn how to implement various sampling algorithms, such as TPE, Gaussian Processes, and Grid Search, while leveraging pruning strategies like successive halving to optimize computational resources. The material also demonstrates how to integrate Optuna with diverse frameworks like LightGBM and use built-in visualization tools to interpret optimization history and parameter importance.
Topics Covered:
1 activity • 9 videos • duration: 57m
Data Scientist | Python Developer | Author and Instructor
I'm a data scientist, machine learning educator and open-source developer. I've built machine learning models for credit risk, insurance claims and fraud prevention, and I am passionate about helping data scientists build models that hold up in real-world projects. My courses are designed for intermediate and advanced practitioners. They cover feature engineering, feature selection, hyperparameter optimization, imbalanced data and the design of robust machine learning pipelines, with a strong emphasis on techniques you can apply straight away in your own work. In the age of generative AI, when a working model can be coded in minutes, the real skill lies in understanding the methods deeply enough to review that output with rigor and a critical eye, and that's exactly what these courses are built to develop. I'm the creator and maintainer of Feature-engine, an open-source Python library for feature engineering and feature selection used by data scientists worldwide. I'm also the author of three books published by Packt: Python Feature Engineering Cookbook, Feature Selection in Machine Learning, and Imbalanced Data: Myths, Mistakes and Modern Solutions. I speak regularly at conferences and meetups, and I enjoy connecting technical communities with the tools and knowledge they need to succeed. In 2018 I received a Data Science Leaders Award, and in 2019 LinkedIn recognized me as one of its voices in data science and analytics. Before moving into data science, I earned an MSc in Biology and a PhD in Biochemistry, then spent more than eight years as a research scientist at institutions including University College London and the Max Planck Institute. That scientific training still shapes how I teach: rigorous, evidence-based, and focused on understanding why a method works before reaching for it.
Provincial regulators of CPAs in Canada do not require that independent providers of CPD be approved to offer courses. Instead, individual CPAs are responsible for assessing whether a CPD activity meets their requirements, and may take activities from any source provided those requirements are met.
Every course offered on LearnFormula is delivered by a qualified subject matter expert or learning organization, and advances learning objectives that are relevant to the responsibilities or professional competencies of Canadian CPAs. All activities on LearnFormula are quantifiable in terms of hours, and are also verifiable, in that users receive documented evidence of their attendance via a certificate of completion after finishing a course (and this certificate is stored by LearnFormula indefinitely). Nearly 100,000 Canadian CPAs successfully satisfy their CPD requirements via LearnFormula on an annual basis.
