Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Wrist-worn smart watches and fitness monitors (i.e., wearables) have become widely adopted by consumers and are gaining increased attention from researchers for their potential contribution to naturalistic digital measurement of health in a scalable, mobile, and unobtrusive way. Various studies have examined the accuracy of these devices in controlled laboratory settings (e.g., treadmill, stationary bike), yet no studies to date have investigated the heart rate accuracy of wearables during a continuous and ecologically valid 24-hour period of actual consumer device use conditions. Objective: The goal of the present study was to determine the heart rate accuracy of two popular wearable devices, the Apple Watch 3 and Fitbit Charge 2, as compared to the gold-standard reference method, an ambulatory electrocardiogram (ECG), during realistic consumer device use conditions within an individual. Data was collected across five daily conditions, including sitting, walking, running, daily activities (e.g., cleaning, chores, work transitions), and sleeping. Methods: One participant, (1st author; 29-year-old Caucasian male) completed a 24-hour ecologically valid protocol by wearing two of the most popular wrist wearable devices (Apple Watch 3 and Fitbit Charge 2). In addition, an ambulatory ECG (Vrije Universiteit Ambulatory Monitoring System) was used as the gold-standard reference method, which resulted in the collection of 102,740 individual heart beats. A single subject design was used to keep all variables constant except for wearable devices, while providing a rapid response design to providing initial assessment of wearable accuracy in order to allow the research cycle to keep pace with technological advancements. Accuracy of these devices compared to the gold-standard ECG was assessed using mean error, mean absolute error, mean absolute percent error. These data were supplemented with Bland-Altman analyses and concordance class correlation to assess agreement between devices. Results: The Apple Watch 3 and Fitbit Charge 2 were generally highly accurate across the 24-hour condition. Specifically, the Apple Watch 3 had a mean difference of -1.80 bpm, a mean absolute error percent of 5.86%, and a mean agreement of 95% when compared to the ECG across 24 hours. The Fitbit Charge 2 had a mean difference of -3.47 bpm, a mean absolute error of 5.96%, and a mean agreement of 91% when compared to the ECG across 24 hours. These findings varied by condition. Conclusions: The Apple Watch 3 and the Fitbit Charge 2 provided acceptable heart rate accuracy (< 10%) across the 24 hour and during each activity, except for the Apple Watch 3 during the daily activities condition. Overall, these finding provide preliminary support that these devices appear to be useful for implementing ambulatory measurement of cardiac activity in research studies, especially those where the specific advantages of these methods (e.g., scalability, low participant burden) are particularly suited to the population or research question.