In 1985 S. Saeki and K. Stromberg published the following question: Does every infinite compact group have a subgroup which is not Haar measurable? An affirmative answer is given for all compact groups with the exception of some metric profinite groups which are almost perfect and strongly complete. In this spirit it is also shown that every compact group contains a non-Borel subgroup.