- This is the stage that requires the most ML knowledge and is most often covered in ML courses
- Code (algorithm/model) + hyperparameters + data
- In lot of research teams, data is usually fixed and vary the code + hyperparams. But in lots of product teams, the usually let the code fixed and vary the data + hyperparams
