Complete this project to learn more about optimizers and changing learning rates during training.
Use a few different learning rates in the code from lesson 5. How high it too high, before training doesn't work anymore? Can you start high, and then reduce the learning rate later to get faster training?
Use the PyTorch docs about optimizers, and find the different options for learning rate schedulers. Choose a learning rate scheduler to use, and integrate that into the code from lesson 5. Does it help with training?