It is known that linear birefringence of the medium essentially hinders measuring the Faraday effect. For this reason, optically anisotropic materials have never been considered as objects of the Faraday-rotation-based spin noise spectroscopy. We show, both theoretically and experimentally, that strong optical anisotropy that may badly suppress the regular Faraday rotation of the medium, practically does not affect the measurement of the spatially uncorrelated spin fluctuations. We also show that the birefringent media provide additional opportunity to measure spatial spin correlations. Results of the experimental measurements of the spin-noise spectra performed on Nd3+ ions in the uniaxial crystal matrices well agree with the theory.