Background: Atrial fibrillation (AF) is the most common tachyarrhythmia and associated with a risk of stroke. The detection and diagnosis of AF represent a major clinical challenge due to AF’s asymptomatic and intermittent nature. Novel consumer-grade mobile health (mHealth) products with automatic arrhythmia detection could be an option for long-term electrocardiogram (ECG)-based rhythm monitoring and AF detection. Objective: We evaluated the feasibility and accuracy of a wearable automated mHealth arrhythmia monitoring system, including a consumer-grade, single-lead heart rate belt ECG device (heart belt), a mobile phone application, and a cloud service with an artificial intelligence (AI) arrhythmia detection algorithm for AF detection. The specific aim of this proof-of-concept study was to test the feasibility of the entire sequence of operations from ECG recording to AI arrhythmia analysis and ultimately to final AF detection. Methods: Patients (n=159) with an AF (n=73) or sinus rhythm (n=86) were recruited from the emergency department. A single-lead heart belt ECG was recorded for 24 hours. Simultaneously registered 3-lead ECGs (Holter) served as the gold standard for the final rhythm diagnostics and as a reference device in a user experience survey with patients over 65 years of age (high-risk group). Results: The heart belt provided a high-quality ECG recording for visual interpretation resulting in 100% accuracy, sensitivity, and specificity of AF detection. The accuracy of AF detection with the automatic AI arrhythmia detection from the heart belt ECG recording was also high (97.5%), and the sensitivity and specificity were 100% and 95.4%, respectively. The correlation between the automatic estimated AF burden and the true AF burden from Holter recording was >0.99 with a mean burden error of 0.05 (SD 0.26) hours. The heart belt demonstrated good user experience and did not significantly interfere with the patient’s daily activities. The patients preferred the heart belt over Holter ECG for rhythm monitoring (85/110, 77% heart belt vs 77/109, 71% Holter, P=.049). Conclusions: A consumer-grade, single-lead ECG heart belt provided good-quality ECG for rhythm diagnosis. The mHealth arrhythmia monitoring system, consisting of heart-belt ECG, a mobile phone application, and an automated AF detection achieved AF detection with high accuracy, sensitivity, and specificity. In addition, the mHealth arrhythmia monitoring system showed good user experience. Trial Registration: ClinicalTrials.gov NCT03507335; https://clinicaltrials.gov/ct2/show/NCT03507335
Background: Computerized clinical decision support systems (CDSSs) are increasingly adopted in health care to optimize resources and streamline patient flow. However, they often lack scientific validation against standard medical care. Objective: The purpose of this study was to assess the performance, safety, and usability of a CDSS in a university hospital emergency department setting in Kuopio, Finland. Methods: Patients entering the emergency department were asked to voluntarily participate in this study. Patients aged 17 years or younger, patients with cognitive impairments, and patients who entered the unit in an ambulance or with the need for immediate care were excluded. Patients completed the CDSS web-based form and usability questionnaire when waiting for the triage nurse’s evaluation. The CDSS data were anonymized and did not affect the patients’ usual evaluation or treatment. Retrospectively, 2 medical doctors evaluated the urgency of each patient’s condition by using the triage nurse’s information, and urgent and nonurgent groups were created. The International Statistical Classification of Diseases, Tenth Revision diagnoses were collected from the electronic health records. Usability was assessed by using a positive version of the System Usability Scale questionnaire. Results: In total, our analyses included 248 patients. Regarding urgency, the mean sensitivities were 85% and 19%, respectively, for urgent and nonurgent cases when assessing the performance of CDSS evaluations in comparison to that of physicians. The mean sensitivities were 85% and 35%, respectively, when comparing the evaluations between the two physicians. Our CDSS did not miss any cases that were evaluated to be emergencies by physicians; thus, all emergency cases evaluated by physicians were evaluated as either urgent cases or emergency cases by the CDSS. In differential diagnosis, the CDSS had an exact match accuracy of 45.5% (97/213). The usability was good, with a mean System Usability Scale score of 78.2 (SD 16.8). Conclusions: In a university hospital emergency department setting with a large real-world population, our CDSS was found to be equally as sensitive in urgent patient cases as physicians and was found to have an acceptable differential diagnosis accuracy, with good usability. These results suggest that this CDSS can be safely assessed further in a real-world setting. A CDSS could accelerate triage by providing patient-provided data in advance of patients’ initial consultations and categorize patient cases as urgent and nonurgent cases upon patients' arrival to the emergency department.
8 December 2021 in Informatics for Health and Social Care
Human-centered design methods should be implemented throughout the client information system (CIS) development process to understand social welfare professionals’ needs, tasks, and contexts of use. The aim of this study was to examine Finnish social welfare professionals’ experiences of participating in CIS development. A national cross-sectional web-based survey on the CIS experiences of social welfare professionals (1145 respondents) was conducted in Finland in spring 2019. This study focused on statements concerning the experiences of end users with CIS development and participation. The results are reported by professional and age groups. Half (50%) of the 1145 respondents had participated in CIS development. Half (56%) knew to whom and how to send feedback to software developers, but most (87%) indicated that changes and corrections were not made according to suggestions and quickly enough. The most preferred methods of participation were telling a person in charge of information systems development about usage problems (53%) and showing developers on site how professionals work (34%); 19% were not interested in participating. Social welfare professionals are willing to participate in CIS development, but vendors and social welfare provider organizations are underutilizing this resource. Social welfare informaticists are needed to interpret the needs of end users to software developers.
13 October 2020 in Finnish Journal of eHealth and eWelfare
Tietojärjestelmien kehittämistyön lähtökohtana tulee olla vahva ymmärrys käyttäjien tarpeista, tehtävistä sekä toimintaympäristöstä. Lisäksi suunnitteluratkaisuja tulee arvioida käyttäjien kanssa kehittämisprosessin aikana ja käyttöönoton jälkeen. Vaikka kansallisesti kohdennetaan runsaasti resursseja tietojärjestelmäpalveluiden kehittämiseen, sosiaalialalta tutkimusta aiheesta löytyy niukasti. Sosiaalialan ammattilaisten kokemuksia asiakastietojärjestelmien kehittämistyöstä kartoitettiin osana keväällä 2019 toteutettua valtakunnallisesta käyttäjäkokemuskyselyä. Kysymyksissä käsiteltiin kokemuksia yhteistyöstä tietojärjestelmätoimittajan kanssa, osallistumisesta kehittämistyöhön ja osallistumistavoista tietojärjestelmien kehitykseen. Tuloksia tarkasteltiin asiakastietojärjestelmän tuotemerkeittäin. Puolet vastaajista ei ollut osallistunut lainkaan kehittämistyöhön, mutta vain 19% ei ollut halukkaita osallistumaan ollenkaan. Suosituimmat osallistumistavat olivat ongelmien raportointi järjestelmien kehittämisen vastuuhenkilölle ja oman työn esittely kehittäjille; sen sijaan tietojärjestelmätoimittajien yleisimmin käyttämät tavat eli palautteen kirjaaminen verkkosivustolle tai sähköpostiin eivät olleet käyttäjien mieleen. Suurin osa tiesi, miten ongelmatilanteista ja kehitysehdotuksista raportoidaan. Sosiaalialan ammattilaiset ovat kiinnostuneita osallistumaan kehittämistyöhön, mutta he eivät ole tyytyväisiä mahdollisuuksiin ja tapoihin osallistua käyttämiensä järjestelmien kehittämiseen. Järjestelmätoimittajien ja käyttäjien väliltä puuttuvat sopivat toimintatavat. Tulokset ovat samansuuntaisia kuin vastaavissa lääkäreille ja sairaanhoitajille tehdyissä tutkimuksissa. On myös mahdollista, että organisaatiot eivät hyödynnä innokasta kehittäjäpotentiaalia. Kehittäjien tulee jalkautua kentälle ja organisaatioiden palkata tietojärjestelmäkehityksestä vastaavia ammattilaisia tulkeiksi järjestelmätoimittajan ja käyttäjien välille. Sosiaalialan ammattilaisten näkökulma on huomioitava vahvemmin järjestelmäkehityksessä, jotta tietojärjestelmät saadaan onnistuneesti tukemaan sote-yhteistyötä tulevaisuudessa.
Background: The integration of health care and social welfare services together with the consolidation of health care information systems (HISs) and client information systems (CISs) has become a timely topic. Despite this development, there is a scarcity of systematic research on physicians’, registered nurses’ (RNs) and social welfare professionals’ (SWPs) experiences of participating in the development of HISs and CISs. Objective: This study aimed to examine how physicians, RNs and SWPs experience collaboration with vendors, and what kinds of end users have participated in development. Methods: National cross-sectional usability surveys were conducted in Finland among RNs and SWPs in 2020 and physicians in 2021. Questions concerning participation experiences were analyzed by professional group, working sector, managerial position, and age. Results: In total, 4683 physicians, 3610 RNs, and 990 SWPs responded to the surveys. In all 3 professional groups, those working in nonmanagerial positions and the youngest respondents participated least in HIS or CIS development, and 76% (n=3528) of physicians, 78% (n=2814) of RNs and 67% (n=664) of SWPs had not participated at all. When comparing the groups, physicians were least aware of feedback processes and least satisfied with vendors’ interest in end-user feedback and the manner and speed of HIS development. Those who had dedicated working time for development were less critical of vendors’ interest and responsiveness to development ideas than those who had not participated at all. In all 3 professional groups, the youngest were most dissatisfied with vendor collaboration. Conclusions: Experiences of participation in HIS and CIS development were relatively negative across all 3 professional groups, with physicians being the most critical. Dialogue and collaboration between developers and end users—also the youngest ones and frontline workers—need improvement; simply increasing allotted working time is unlikely to produce more positive participation experiences.