The EU and its Member States share responsibility for improving the living conditions and integration of the Roma into society. When developing systemic solutions to address the challenges of the Roma population, the first thing to do is to provide them with a suitable living environment. A suitable living environment for vulnerable social groups includes social housing adapted to their needs and preferences as part of the social infrastructure. In the first, theoretical part, this paper explores the existing international, EU, and Slovenian legal framework for addressing the housing needs of the Roma community. In the second, empirical part, the preferences of the members of the Roma Community regarding the type and architecture of housing, and their financial capacity regarding the type and location of accommodation are examined through a survey that was conducted in the Roma settlement “Kerinov Grm”. The research paper gives answers to the following research questions: (1) what are the preferences of the inhabitants of Roma settlements regarding the type of housing and architecture? (2) how to provide adequate housing for members of the Roma community? and (3) do the Roma take advantage of the available free non-profit housing, and if not, why? The survey shows a very low level of satisfaction with living in Roma settlements, which, in combination with the growing population, limited possibilities for settlement expansion, and specific housing preferences, poses a unique challenge to the state and local communities.