25 January 2019 in JMIR mHealth and uHealth
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Using mobile phone apps to promote behaviour change is becoming increasingly common. However, there is no clear way to rate apps against their behaviour change potential. Objective: The objective of this study was to develop a reliable, theory-based scale that can be used to assess the behaviour change potential of smartphone apps. Methods: A systematic review of all studies purporting to investigate app behaviour change potential was conducted. All scales and measures from the identified studies were collected to create an item pool. From this item pool, three health promotion exerts created the App Behaviour Change Scale (ABACUS). To test the scale, 70 physical activity apps were rated to provide information on reliability. Results: The systematic review returned 593 articles, the abstracts and titles of all were reviewed, with the full text of 77 articles reviewed, and 45 articles met the inclusion criteria. From these 45 articles, 1333 questions were identified, removing duplicates and unnecessary questions left 130 individual questions, which were then refined into the 21 item scale. The ABACUS demonstrates high percentage agreement among reviewers (over 80%), with three questions scoring a Krippendorff alpha which would indicate agreement and a further seven came close with alphas >.5. The scale overall reported high interrater reliability (2-way mixed ICC = .915, 95% CI 0.807-0.965), and high internal consistency (Cronbach alpha = .930). Conclusions: The ABACUS is a reliable tool that can be used to determine the behaviour change potential of apps. This instrument fills a gap by allowing the evaluation of a large number of apps to be standardized across a range of health categories.
24 May 2018 in JMIR Preprints
BACKGROUND Using mobile phone apps to promote behavior change is becoming increasingly common. However, there is no clear way to rate apps against their behavior change potential. OBJECTIVE This study aimed to develop a reliable, theory-based scale that can be used to assess the behavior change potential of smartphone apps. METHODS A systematic review of all studies purporting to investigate app’s behavior change potential was conducted. All scales and measures from the identified studies were collected to create an item pool. From this item pool, 3 health promotion exerts created the App Behavior Change Scale (ABACUS). To test the scale, 70 physical activity apps were rated to provide information on reliability. RESULTS The systematic review returned 593 papers, the abstracts and titles of all were reviewed, with the full text of 77 papers reviewed; 50 papers met the inclusion criteria. From these 50 papers, 1333 questions were identified. Removing duplicates and unnecessary questions left 130 individual questions, which were then refined into the 21-item scale. The ABACUS demonstrates high percentage agreement among reviewers (over 80%), with 3 questions scoring a Krippendorff alpha that would indicate agreement and a further 7 came close with alphas >.5. The scale overall reported high interrater reliability (2-way mixed interclass coefficient=.92, 95% CI 0.81-0.97) and high internal consistency (Cronbach alpha=.93). CONCLUSIONS The ABACUS is a reliable tool that can be used to determine the behavior change potential of apps. This instrument fills a gap by allowing the evaluation of a large number of apps to be standardized across a range of health categories.