A novel method based on the generalized gradient and nonsmooth optimization techniques called bundle methods is introduced to optimize the performance of a class of dynamic systems whose governing equations change depending on the parameters, controls and the current state of the system. The mathematical background is introduced. The theoretical aspects of the method is summarized. The method is described and an illustrative example is given. Further directions of research are discussed.