The growth in the number of non-developer open source software (OSS) application users has drawn attention to usability in the OSS community. OSS communities do not generally know how to apply usability techniques and are unclear about which techniques to use in each activity of the development process. The aim of our research is to determine the feasibility of applying the focus groups technique in the OSS ERMaster project. To do this, we participated as project volunteers. We used the case study research method to investigate technique application and OSS community participation. As a result, we identified adverse conditions that were an obstacle to the application of the original technique. We then adapted the technique to make it applicable in an OSS project. We can conclude that was not easy to recruit OSS users and developers to participate in technique application.

Open-source software has experienced steady growth, driving increased research. However, open-source communities still need standardized processes to ensure software quality, and their characteristics make it challenging to adopt many usability techniques from human–computer interaction directly. Our study aims to adapt and evaluate the feasibility of three usability evaluation techniques—cognitive walkthrough, formal usability testing, and thinking aloud—across three open-source projects (Code::Blocks, Freeplane, and Scribus) from the development team’s perspective. We participated as volunteers in these projects, employing a multiple case study method. We found that usability techniques were not systematically adopted, and procedures specific to open-source projects were lacking. We also identified adverse conditions, such as limited user participation, that hindered adoption. We proposed adaptations to each technique and formalized procedures to address these challenges and apply them in open-source contexts. Additionally, we developed a framework for integrating usability evaluation into OSS projects. To address this, we detailed our framework’s phases, tasks, and artifacts to ensure reusability and adaptability across OSS contexts, providing practical steps for implementation and future validations. In conclusion, usability techniques must be adapted for open-source software, considering the projects’ unique characteristics and philosophy. Although obstacles exist, such as user participation, applying adapted usability techniques in open-source projects is feasible.

JAIT is a scientific open access journal which focuses on empirical research results and critical analysis of technology development, use, management and impacts in information technology.