Stephen B. Gilbert

Stephen B. Gilbert

Auto-generated profile, based on publicly available information

Stephen B. Gilbert

Iowa State University, Ames, USA

Research Focus & Metrics

Academic Career Length

28Years (1999-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 June 2019 in Systematic Reviews
Verified
Journal Article
Open access
PDF file
AOAnnette O’Connor
Annette O’Connor
GTGuy Tsafnat
Guy Tsafnat
JTJames Thomas
James Thomas
PGPaul Glasziou
Paul Glasziou
SGStephen B. Gilbert
Stephen B. Gilbert
BHBrian Hutton
Brian Hutton
Although many aspects of systematic reviews use computational tools, systematic reviewers have been reluctant to adopt machine learning tools. We discuss that the potential reason for the slow adoption of machine learning tools into systematic reviews is multifactorial. We focus on the current absence of trust in automation and set-up challenges as major barriers to adoption. It is important that reviews produced using automation tools are considered non-inferior or superior to current practice. However, this standard will likely not be sufficient to lead to widespread adoption. As with many technologies, it is important that reviewers see “others” in the review community using automation tools. Adoption will also be slow if the automation tools are not compatible with workflows and tasks currently used to produce reviews. Many automation tools being developed for systematic reviews mimic classification problems. Therefore, the evidence that these automation tools are non-inferior or superior can be presented using methods similar to diagnostic test evaluations, i.e., precision and recall compared to a human reviewer. However, the assessment of automation tools does present unique challenges for investigators and systematic reviewers, including the need to clarify which metrics are of interest to the systematic review community and the unique documentation challenges for reproducible software experiments. We discuss adoption barriers with the goal of providing tool developers with guidance as to how to design and report such evaluations and for end users to assess their validity. Further, we discuss approaches to formatting and announcing publicly available datasets suitable for assessment of automation technologies and tools. Making these resources available will increase trust that tools are non-inferior or superior to current practice. Finally, we identify that, even with evidence that automation tools are non-inferior or superior to current practice, substantial set-up challenges remain for main stream integration of automation into the systematic review process.

19 January 2015 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
PCPatrick Carlson
Patrick Carlson
APAnicia Peters
Anicia Peters
SGStephen B. Gilbert
Stephen B. Gilbert
JVJudy M. Vance
Judy M. Vance
ALAndy Luse
Andy Luse
In training assembly workers in a factory, there are often barriers such as cost and lost productivity due to shutdown. The use of virtual reality (VR) training has the potential to reduce these costs. This research compares virtual bimanual haptic training versus traditional physical training and the effectiveness for learning transfer. In a mixed experimental design, participants were assigned to either virtual or physical training and trained by assembling a wooden burr puzzle as many times as possible during a twenty minute time period. After training, participants were tested using the physical puzzle and were retested again after two weeks. All participants were trained using brightly colored puzzle pieces. To examine the effect of color, testing involved the assembly of colored physical parts and natural wood colored physical pieces. Spatial ability as measured using a mental rotation test, was shown to correlate with the number of assemblies they were able to complete in the training. While physical training outperformed virtual training, after two weeks the virtually trained participants actually improved their test assembly times. The results suggest that the color of the puzzle pieces helped the virtually trained participants in remembering the assembly process.

1 September 2020 in Journal of Experimental Psychology: Applied
Verified
Journal Article
Closed access
LCLucia A. Cherep
Lucia A. Cherep
ALAlex F. Lim
Alex F. Lim
JKJonathan W. Kelly
Jonathan W. Kelly
DADevi Acharya
Devi Acharya
AVAlfredo Velasco
Alfredo Velasco
SGStephen B. Gilbert
Stephen B. Gilbert
Teleporting is a popular interface to allow virtual reality users to explore environments that are larger than the available walking space. When teleporting, the user positions a marker in the virtual environment and is instantly transported without any self-motion cues. Five experiments were designed to evaluate the spatial cognitive consequences of teleporting and to identify environmental cues that could mitigate those costs. Participants performed a triangle completion task by traversing 2 outbound path legs before pointing to the unmarked path origin. Locomotion was accomplished via walking or 2 common implementations of the teleporting interface distinguished by the concordance between movement of the body and movement through the virtual environment. In the partially concordant teleporting interface, participants teleported to translate (change position) but turned the body to rotate. In the discordant teleporting interface, participants teleported to translate and rotate. Across all 5 experiments, discordant teleporting produced larger errors than partially concordant teleporting which produced larger errors than walking, reflecting the importance of translational and rotational self-motion cues. Furthermore, geometric boundaries (room walls or a fence) were necessary to mitigate the spatial cognitive costs associated with teleporting, and landmarks were helpful only in the context of a geometric boundary. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

8 June 2017 in International Journal of Artificial Intelligence in Education
Verified
Journal Article
Open access
PDF file
RSRobert A. Sottilare
Robert A. Sottilare
CBC. Shawn Burke
C. Shawn Burke
ESEduardo Salas
Eduardo Salas
ASAnne M. Sinatra
Anne M. Sinatra
JJJoan H. Johnston
Joan H. Johnston
SGStephen B. Gilbert
Stephen B. Gilbert
The goal of this research was the development of a practical architecture for the computer-based tutoring of teams. This article examines the relationship of team behaviors as antecedents to successful team performance and learning during adaptive instruction guided by Intelligent Tutoring Systems (ITSs). Adaptive instruction is a training or educational experience tailored by artificially-intelligent, computer-based tutors with the goal of optimizing learner outcomes (e.g., knowledge and skill acquisition, performance, enhanced retention, accelerated learning, or transfer of skills from instructional environments to work environments). The core contribution of this research was the identification of behavioral markers associated with the antecedents of team performance and learning thus enabling the development and refinement of teamwork models in ITS architectures. Teamwork focuses on the coordination, cooperation, and communication among individuals to achieve a shared goal. For ITSs to optimally tailor team instruction, tutors must have key insights about both the team and the learners on that team. To aid the modeling of teams, we examined the literature to evaluate the relationship of teamwork behaviors (e.g., communication, cooperation, coordination, cognition, leadership/coaching, and conflict) with team outcomes (learning, performance, satisfaction, and viability) as part of a large-scale meta-analysis of the ITS, team training, and team performance literature. While ITSs have been used infrequently to instruct teams, the goal of this meta-analysis make team tutoring more ubiquitous by: identifying significant relationships between team behaviors and effective performance and learning outcomes; developing instructional guidelines for team tutoring based on these relationships; and applying these team tutoring guidelines to the Generalized Intelligent Framework for Tutoring (GIFT), an open source architecture for authoring, delivering, managing, and evaluating adaptive instructional tools and methods. In doing this, we have designed a domain-independent framework for the adaptive instruction of teams.

22 December 2016 in PRESENCE: Virtual and Augmented Reality
Verified
Journal Article
Open access
SGStephen B. Gilbert
Stephen B. Gilbert

19 August 2022 in Frontiers in Virtual Reality
Verified
Journal Article
Open access
NSNathan C. Sepich
Nathan C. Sepich
AJAngelica Jasper
Angelica Jasper
SFStephen Fieffer
Stephen Fieffer
SGStephen B. Gilbert
Stephen B. Gilbert
MDMichael C. Dorneich
Michael C. Dorneich
JKJonathan W. Kelly
Jonathan W. Kelly
This study explored the impact of task workload on virtual reality (VR) cybersickness. Cybersickness is a negative side effect of using VR to which many users are susceptible. Previous research on the impact on task workload on cybersickness has yielded no consistent relationships, but given that task workload requires attentional resources, it is worth further investigation of how a demand on attention might increase or decrease cybersickness. In this study, mental workload of participants (N = 151) was modified in three different task groups within the same virtual environment (VE). The Cybersickness Corn Maze VR testbed contained cybersickness-inducing stimuli and tasks with varying workload. The 0-Back group used a controller to select an object as a visual attention task. The 2-Back group performed the 2-Back memory detection task, using a controller to collect objects that matched the object presented two objects ago. The No-Task group passively moved through the environment and was not given a controller. Workload, cybersickness, dropout rate, presence, and task accuracy were compared across groups. Workload was found to be statistically significantly different in each group: highest in the 2-Back group, medium in the 0-Back group, and lowest in the No-Task group, validating the task design. Cybersickness in the 2-Back group was significantly higher than in the No-Task (140% higher) and 0-Back (54% higher) groups measured by the change in simulator sickness questionnaire (SSQ) total severity (Post SSQ - Pre SSQ). The rate of participants’ dropout due to cybersickness was significantly higher in 2-back (33%) as compared with 0-Back (10%), but 0-Back and No-Task dropout rates were not significantly different. These results indicate that 1) task workload affects cybersickness and 2) its effect could be based on a threshold of workload. Presence increased with the addition of a task but plateaued between the 0-Back and 2-Back groups, suggesting that presence can be affected by task workload but only to a certain extent. Task accuracy was shown to negatively correlate with cybersickness within the task groups. A relationship between workload and cybersickness was found and warrants further research into these concepts. This work highlights the need for task workload and attention to be studied as components of the mechanisms underlying cybersickness.