Nienke Beerlage-de Jong

Dr. Nienke Beerlage-de Jong

orcid

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 January 2022 in Journal of Medical Internet Research
Verified
Journal Article
Open access
HKHanneke Kip
Hanneke Kip
JKJulia Keizer
Julia Keizer
MSMarcia C da Silva
Marcia C da Silva
NJNienke Beerlage-de Jong
Nienke Beerlage-de Jong
NKNadine Köhle
Nadine Köhle
SKSaskia Kelders
Saskia Kelders
Background: Thorough holistic development of eHealth can contribute to a good fit among the technology, its users, and the context. However, despite the availability of frameworks, not much is known about specific research activities for different aims, phases, and settings. This results in researchers having to reinvent the wheel. Consequently, there is a need to synthesize existing knowledge on research activities for participatory eHealth development processes. Objective: The 3 main goals of this review are to create an overview of the development strategies used in studies based on the CeHRes (Center for eHealth Research) Roadmap, create an overview of the goals for which these methods can be used, and provide insight into the lessons learned about these methods. Methods: We included eHealth development studies that were based on the phases and/or principles of the CeHRes Roadmap. This framework was selected because of its focus on participatory, iterative eHealth design in context and to limit the scope of this review. Data were extracted about the type of strategy used, rationale for using the strategy, research questions, and reported information on lessons learned. The most frequently mentioned lessons learned were summarized using a narrative, inductive approach. Results: In the included 160 papers, a distinction was made between overarching development methods (n=10) and products (n=7). Methods are used to gather new data, whereas products can be used to synthesize previously collected data and support the collection of new data. The identified methods were focus groups, interviews, questionnaires, usability tests, literature studies, desk research, log data analyses, card sorting, Delphi studies, and experience sampling. The identified products were prototypes, requirements, stakeholder maps, values, behavior change strategies, personas, and business models. Examples of how these methods and products were applied in the development process and information about lessons learned were provided. Conclusions: This study shows that there is a plethora of methods and products that can be used at different points in the development process and in different settings. To do justice to the complexity of eHealth development, it seems that multiple strategies should be combined. In addition, we found no evidence for an optimal single step-by-step approach to develop eHealth. Rather, researchers need to select the most suitable research methods for their research objectives, the context in which data are collected, and the characteristics of the participants. This study serves as a first step toward creating a toolkit to support researchers in applying the CeHRes Roadmap to practice. In this way, they can shape the most suitable and efficient eHealth development process.

13 January 2025 in Journal of Medical Internet Research
Verified
Journal Article
Open access
HKHanneke Kip
Hanneke Kip
NJNienke Beerlage-de Jong
Nienke Beerlage-de Jong
JGJEWC van Gemert-Pijnen
JEWC van Gemert-Pijnen
SKSaskia Kelders
Saskia Kelders
To ensure that an eHealth technology fits with its intended users, other stakeholders, and the context within which it will be used, thorough development, implementation, and evaluation processes are necessary. The CeHRes (Centre for eHealth and Wellbeing Research) Roadmap is a framework that can help shape these processes. While it has been successfully used in research and practice, new developments and insights have arisen since the Roadmap’s first publication in 2011, not only within the domain of eHealth but also within the different disciplines in which the Roadmap is grounded. Because of these new developments and insights, a revision of the Roadmap was imperative. This paper aims to present the updated pillars and phases of the CeHRes Roadmap 2.0. The Roadmap was updated based on four types of sources: (1) experiences with its application in research; (2) literature reviews on eHealth development, implementation, and evaluation; (3) discussions with eHealth researchers; and (4) new insights and updates from relevant frameworks and theories. The updated pillars state that eHealth development, implementation, and evaluation (1) are ongoing and intertwined processes; (2) have a holistic approach in which context, people, and technology are intertwined; (3) consist of continuous evaluation cycles; (4) require active stakeholder involvement from the start; and (5) are based on interdisciplinary collaboration. The CeHRes Roadmap 2.0 consists of 5 interrelated phases, of which the first is the contextual inquiry, in which an overview of the involved stakeholders, the current situation, and points of improvement is created. The findings from the contextual inquiry are specified in the value specification, in which the foundation for the to-be-developed eHealth technology is created by formulating values and requirements, preliminarily selecting behavior change techniques and persuasive features, and initiating a business model. In the Design phase, the requirements are translated into several lo-fi and hi-fi prototypes that are iteratively tested with end users and other stakeholders. A version of the technology is rolled out in the Operationalization phase, using the business model and an implementation plan. In the Summative Evaluation phase, the impact, uptake, and working mechanisms are evaluated using a multimethod approach. All phases are interrelated by continuous formative evaluation cycles that ensure coherence between outcomes of phases and alignment with stakeholder needs. While the CeHRes Roadmap 2.0 consists of the same phases as the first version, the objectives and pillars have been updated and adapted, reflecting the increased emphasis on behavior change, implementation, and evaluation as a process. There is a need for more empirical studies that apply and reflect on the CeHRes Roadmap 2.0 to provide points of improvement because just as with any eHealth technology, the Roadmap has to be constantly improved based on the input of its users.

30 March 2017 in Infectious Disease Reports
Verified
Journal Article
Open access
PDF file
NJNienke Beerlage-de Jong
Nienke Beerlage-de Jong
JGJEWC van Gemert-Pijnen
JEWC van Gemert-Pijnen
JWJobke Wentzel
Jobke Wentzel
RHRon Hendrix
Ron Hendrix
LSLiseth Siemons
Liseth Siemons
The rise of antimicrobial resistance (AMR) is a severe global health problem. Tackling this problem requires the prudent prescribing of antimicrobials. This is promoted through Antimicrobial Stewardship Programs (ASPs). In this position paper we describe i) how a socio-technical multidisciplinary approach (based on the CeHRes Roadmap) can be applied in the development and implementation of Antimicrobial Stewardship technologies and ii) how this approach can be of value to support Antimicrobial Stewardship in practice. The CeHRes Roadmap entails five different phases to explore and test how an eHealth technology can be tailored to the target group and successfully implemented in practice: i) contextual inquiry, ii) value specification, iii) design, iv) operationalization, v) evaluation. In this position paper we describe the lessons learned from research and practice to guide future developments of technology based ASP interventions. Since AMR is a huge wicked problem on a global level, it requires innovative methods and models to empower general public and professionals to be proactive rather than reactive in a digitalized world. We highlight how to combat the dangerous rise of antimicrobial resistance in the future.

22 July 2019 in Antimicrobial Resistance & Infection Control
Verified
Journal Article
Open access
PDF file
JKJ. Keizer
J. Keizer
LBLouise M.A. Braakman-Jansen
Louise M.A. Braakman-Jansen
SKStefanie Kampmeier
Stefanie Kampmeier
RKRobin Köck
Robin Köck
NNN. Al Naiemi
N. Al Naiemi
JGJEWC van Gemert-Pijnen
JEWC van Gemert-Pijnen
Cross-border healthcare may promote the spread of multidrug-resistant microorganisms (MDRO) and is challenging due to heterogeneous antimicrobial resistance (AMR) prevention measures (APM). The aim of this article is to compare healthcare workers (HCW) from Germany (DE) and The Netherlands (NL) on how they perceive and experience AMR and APM, which is important for safe patient exchange and effective cross-border APM cooperation. A survey was conducted amongst HCW (n = 574) in hospitals in DE (n = 305) and NL (n = 269), using an online self-administered survey between June 2017 and July 2018. Mann-Whitney U tests were used to analyse differences between answers of German and Dutch physicians (n = 177) and German and Dutch nurses (n = 397) on 5-point Likert Items and Scales. Similarities between DE and NL were a high awareness about the AMR problem and the perception that the possibility to cope with AMR is limited (30% respondents perceive their contribution to limit AMR as insufficient). Especially Dutch nurses scored significantly lower than German nurses on their contribution to limit AMR (means 2.6 vs. 3.1, p ≤ 0.001). German HCW were more optimistic about their potential role in coping with AMR (p ≤ 0.001), and scored higher on feeling sufficiently equipped to perform APM (p ≤ 0.003), although the mean scores did not differ much between German and Dutch respondents. Although both German and Dutch HCW are aware of the AMR problem, they should be more empowered to contribute to limiting AMR through APM (i.e. screening diagnostics, infection diagnosis, treatment and infection control) in their daily working routines. The observed differences reflect differences in local, national and cross-border structures, and differences in needs of HCW, that need to be considered for safe patient exchange and effective cross-border APM.

1 February 2016 in International Journal of Medical Informatics
Verified
Journal Article
Closed access
PDF file
JWJ. Wentzel
J. Wentzel
FMF. Müller
F. Müller
NJNienke Beerlage-de Jong
Nienke Beerlage-de Jong
JGJEWC van Gemert-Pijnen
JEWC van Gemert-Pijnen

23 October 2020 in Journal of Medical Internet Research
Verified
Journal Article
Open access
NJNienke Beerlage-de Jong
Nienke Beerlage-de Jong
HKHanneke Kip
Hanneke Kip
SKSaskia Kelders
Saskia Kelders
Background: eHealth technologies aim to change users’ health-related behavior. Persuasive design and system features can make an eHealth technology more motivating, engaging, or supportive to its users. The Persuasive Systems Design (PSD) model incorporates software features that have the possibility to increase the persuasiveness of technologies. However, the effects of specific PSD software features on the effectiveness of an intervention are still largely unknown. The Perceived Persuasiveness Questionnaire (PPQ) was developed to gain insight into the working mechanisms of persuasive technologies. Although the PPQ seems to be a suitable method for measuring subjective persuasiveness, it needs to be further evaluated to determine how suitable it is for measuring perceived persuasiveness among the public. Objective: This study aims to evaluate the face and construct validity of the PPQ, identify points of improvement, and provide suggestions for further development of the PPQ. Methods: A web-based closed-ended card-sort study was performed wherein participants grouped existing PPQ items under existing PPQ constructs. Participants were invited via a Massive Open Online Course on eHealth. A total of 398 people (average age 44.15 years, SD 15.17; 251/398, 63.1% women) completed the card sort. Face validity was evaluated by determining the item-level agreement of the original PPQ constructs. Construct validity was evaluated by determining the construct in which each item was placed most often, regardless of the original placement and how often 2 items were (regardless of the constructs) paired together and what interitem correlations were according to a cluster analysis. Results: Four PPQ constructs obtained relatively high face validity scores: perceived social support, use continuance, perceived credibility, and perceived effort. Item-level agreement on the other constructs was relatively low. Item-level agreement for almost all constructs, except perceived effort and perceived effectiveness, would increase if items would be grouped differently. Finally, a cluster analysis of the PPQ indicated that the strengths of the newly identified 9 clusters varied strongly. Unchanged strong clusters were only found for perceived credibility support, perceived social support, and use continuance. The placement of the other items was much more spread out over the other constructs, suggesting an overlap between them. Conclusions: The findings of this study provide a solid starting point toward a redesigned PPQ that is a true asset to the field of persuasiveness research. To achieve this, we advocate that the redesigned PPQ should adhere more closely to what persuasiveness is according to the PSD model and to the mental models of potential end users of technology. The revised PPQ should, for example, enquire if the user thinks anything is done to provide task support but not how this is done exactly.