Alan Chamberlain

Alan Chamberlain

Auto-generated profile, based on publicly available information

Alan Chamberlain

University of Nottingham, Nottingham, United Kingdom

Research Focus & Metrics

Academic Career Length

23Years (2004-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 July 2021 in Personal and Ubiquitous Computing
Verified
Journal Article
Open access
PDF file
SBSimone Borsci
Simone Borsci
AMAlessio Malizia
Alessio Malizia
MSMartin Schmettow
Martin Schmettow
FVFrank van der Velde
Frank van der Velde
GTGunay Tariverdiyeva
Gunay Tariverdiyeva
ACAlan Chamberlain
Alan Chamberlain
Standardised tools to assess a user’s satisfaction with the experience of using chatbots and conversational agents are currently unavailable. This work describes four studies, including a systematic literature review, with an overall sample of 141 participants in the survey (experts and novices), focus group sessions and testing of chatbots to (i) define attributes to assess the quality of interaction with chatbots and (ii) the designing and piloting a new scale to measure satisfaction after the experience with chatbots. Two instruments were developed: (i) A diagnostic tool in the form of a checklist (BOT-Check). This tool is a development of previous works which can be used reliably to check the quality of a chatbots experience in line with commonplace principles. (ii) A 15-item questionnaire (BOT Usability Scale, BUS-15) with estimated reliability between .76 and .87 distributed in five factors. BUS-15 strongly correlates with UMUX-LITE by enabling designers to consider a broader range of aspects usually not considered in satisfaction tools for non-conversational agents, e.g. conversational efficiency and accessibility, quality of the chatbot’s functionality and so on. Despite the convincing psychometric properties, BUS-15 requires further testing and validation. Designers can use it as a tool to assess products, thus building independent databases for future evaluation of its reliability, validity and sensitivity.

11 June 2012
Verified
Conference Paper
Open access
PDF file
ACAlan Chamberlain
Alan Chamberlain
ACAndy Crabtree
Andy Crabtree
TRTom Rodden
Tom Rodden
MJMatt Jones
Matt Jones
YRYvonne Rogers
Yvonne Rogers

25 April 2015 in Personal and Ubiquitous Computing
Verified
Journal Article
Open access
PDF file
EKEiman Kanjo
Eiman Kanjo
LALuluah Alhusain
Luluah Alhusain
ACAlan Chamberlain
Alan Chamberlain
Pervasive sensing has opened up new opportunities for measuring our feelings and understanding our behavior by monitoring our affective states while mobile. This review paper surveys pervasive affect sensing by examining and considering three major elements of affective pervasive systems, namely “sensing,” “analysis,” and “application.” Sensing investigates the different sensing modalities that are used in existing real-time affective applications, analysis explores different approaches to emotion recognition and visualization based on different types of collected data, and application investigates different leading areas of affective applications. For each of the three aspects, the paper includes an extensive survey of the literature and finally outlines some of challenges and future research opportunities of affective sensing in the context of pervasive computing.

8 August 2007 in Personal and Ubiquitous Computing
Verified
Journal Article
Closed access
PDF file
EKEiman Kanjo
Eiman Kanjo
SBSteve Benford
Steve Benford
MPMark Paxton
Mark Paxton
ACAlan Chamberlain
Alan Chamberlain
DFDanaë Stanton Fraser
Danaë Stanton Fraser
AWAdrain Woolard
Adrain Woolard

4 August 2022 in Personal and Ubiquitous Computing
Verified
Journal Article
Open access
PDF file
SBSimone Borsci
Simone Borsci
MSMartin Schmettow
Martin Schmettow
AMAlessio Malizia
Alessio Malizia
ACAlan Chamberlain
Alan Chamberlain
FVFrank van der Velde
Frank van der Velde
The Bot Usability Scale (BUS) is a standardised tool to assess and compare the satisfaction of users after interacting with chatbots to support the development of usable conversational systems. The English version of the 15-item BUS scale (BUS-15) was the result of an exploratory factorial analysis; a confirmatory factorial analysis tests the replicability of the initial model and further explores the properties of the scale aiming to optimise this tool seeking for the stability of the original model, the potential reduction of items, and testing multiple language versions of the scale. BUS-15 and the usability metrics for user experience (UMUX-LITE), used here for convergent validity purposes, were translated from English to Spanish, German, and Dutch. A total of 1292 questionnaires were completed in multiple languages; these were collected from 209 participants interacting with an overall pool of 26 chatbots. BUS-15 was acceptably reliable; however, a shorter and more reliable solution with 11 items (BUS-11) emerged from the data. The satisfaction ratings obtained with the translated version of BUS-11 were not significantly different from the original version in English, suggesting that the BUS-11 could be used in multiple languages. The results also suggested that the age of participants seems to affect the evaluation when using the scale, with older participants significantly rating the chatbots as less satisfactory, when compared to younger participants. In line with the expectations, based on reliability, BUS-11 positively correlates with UMUX-LITE scale. The new version of the scale (BUS-11) aims to facilitate the evaluation with chatbots, and its diffusion could help practitioners to compare the performances and benchmark chatbots during the product assessment stage. This tool could be a way to harmonise and enable comparability in the field of human and conversational agent interaction.