1. Performance Optimization 2. Basic Optimization Algorithm p k- Search Direction k- Learning Rate or 3. Steepest Descent Choose the next step so that the function decreases:…