In this paper we describe basic concepts which are took as a base of an expert system for an investigation of nonlinear behavior of particle beams. Modelling process for beam line design is based on the matrix formalism for Lie algebraic tools and computer algebra methods. This allows to use an object-oriented approach for describing both physical and mathematical objects.