In this paper we derive Dyson-Schwinger hierarchy of the equations for the correlators of reggeized gluon fields in the framework of Lipatov's high energy QCD effective action formalism.1-10 The explicit perturbative expressions for the correlators till correlator of four Reggeon fields inclusively are obtained and different perturbative schemes for the solutions of the equation for the two-field correlator are discussed. A correspondence between the correlators of reggeized gluon fields and Wilson line operators of longitudinal gluon field is established with the help of the results of Ref. 10. The connection between the JIMWLK-Balitsky formalism and Lipatov's effective action approach and applications of the obtained results are also discussed.