A series of novel aromatic primary sulfonamides decorated with diversely substituted 1,2,4-oxadiazole periphery groups has been prepared using a parallel chemistry approach. The compounds displayed a potent inhibition of cytosolic hCA II and membrane-bound hCA IX isoforms. Due to a different cellular localization of the two target enzymes, the compounds can be viewed as selective inhibition tools for either isoform, depending on the cellular permeability profile. The SAR findings revealed in this study has been well rationalized by docking simulation of the key compounds against the crystal structures of the relevant hCA isoforms.