We show that the anisotropy of the recoil velocity distribution of x-ray-ionized atoms or molecules leads to observable splittings in subsequent optical fluorescence or absorption when the polarization vector of the x rays is parallel to the momentum of the fluorescent photons. The order of the magnitude of the recoil-induced splitting is about 10 μeV, which can be observed using Fourier or laser-absorption spectroscopic techniques.