We examine the effects of disorder on dimerized quantum antiferromagnets in a magnetic field, using the mapping to a lattice gas of hard-core bosons with finite-range interactions. Combining a strong-coupling expansion, the replica method, and a one-loop renormalization-group analysis, we investigate the nature of the glass phases formed. We find that away from the tips of the Mott lobes, the transition is from a Mott insulator to a compressible Bose glass, however the compressibility at the tips is strongly suppressed. We identify this finding with the presence of a rare Mott glass phase and demonstrate that the inclusion of replica symmetry breaking is vital to correctly describe the glassy phases. This result suggests that the formation of Bose and Mott glass phases is not simply a weak localization phenomenon but is indicative of much richer physics. We discuss our results in the context of both ultracold atomic gases and spin-dimer materials.