Dynamics of non-stationary processes that minimize the Kullback–Leibler divergence (follow the minimum of the relative entropy principle) are considered. A set of equations describing the system dynamics under the mass conservation and energy conservation constraints is derived. The existence and uniqueness of solution are established, asymptotic stability of the equilibrium is proved. Equations are derived based on the Speed- Gradient (SG) principle originated in the control theory.