Purpose: The purpose of this paper is to examine the reasons behind low penetration of Islamic banking in Pakistan. Specifically, the study investigates the differentiation of Islamic banks (IBs) from conventional banks, the role of religion in choosing Islamic banking and the perception of IBs amongst the consumers. Design/methodology/approach: The study uses a mixed-method approach, qualitative research along with a survey of users of conventional and Islamic banking. Factor analysis identified underlying dimensions and cluster analysis ascertained the differences between users and non-users of Islamic banking. Inferential statistics were used to test purported hypotheses. Findings: The study finds that the users and non-users both perceive that Islamic banking is not completely interest-free. Furthermore, consumers presume that IBs are more of eyewash and are not truly practicing Islamic banking. Moreover, religion is not a major factor that attracts new users but there are also other important factors in marketing Islamic banking, such as service quality, convenience, branch network, etc. Originality/value: This is one of the sparse studies in the field of Islamic banking consumer behaviour, which uses focus groups of users and non-users, and in-depth interviews of experts, to identify the issues and factors considered relevant and important by the users rather than relying only on literature review. Furthermore, it also provides a profile of users versus non-users of Islamic banking which is very useful for segmentation and targeting of customers.