Objective: The present studies investigated the nature of replication research within the human factors literature. Background: Many claim that researchers in certain fields do not replicate prior research. This is troubling because replications allow science to self-correct. A successful replication corroborates the original finding, whereas an unsuccessful replication falsifies it. To date, no one has assessed whether this issue affects the field of human factors. Method: In the first study, eight articles (parent articles) were selected from the 1991 issues of the journal Human Factors. Each article that had referenced one of the eight parent articles between 1991 and September 2006 (child articles) were also retrieved. Two investigators coded and compared each child article against its 1991 parent article to determine whether the child article replicated its parent article. The second study replicated these procedures. Results: Half or more of the parent articles in Study 1 and Study 2 (75% and 50%, respectively) were replicated at least once. Furthermore, human factors researchers conducted replications of their own work as well as the work of others. However, many researchers did not state that they replicated previous research. Conclusion: Replications seem to be common in the human factors literature. However, readers may not realize that a study replicated prior research. Thus, they may incorrectly assess the evidence concerning a given finding. Application: Human factors professionals should be taught how to identify replications and to be cautious of research that has not been replicated.
This study examined users' schemata of hypermedia. It is frequently assumed that users' schemata contain spatial information about how the pages of a website are interconnected. However, it is not clear how these schemata could contain such information when none is presented to the user while he/she is exploring the website. Unfortunately, there has been little research addressing this assumption. Toward that end, the reported study examined the mental representations (i.e. schemata) acquired when using hypermedia by systematically varying the interconnections within a website while holding the information that the website contained constant. Analyses of 40 participants' drawings of the website's organization indicate that drawings largely reflected conceptual (i.e. semantic) relationships, and not the true nature of the website's interconnections. In light of this research, it is suggested that we reevaluate the conjecture that hypermedia is mentally represented in ways similar to the physical world.
1 March 2011 in Journal of Cognitive Engineering and Decision Making
Urban search and rescue (USAR) robots get stuck. Furthermore, USAR workers complained that it is difficult to judge whether a teleoperated robot can go through certain apertures. Two experiments tested teleoperators’ abilities to (a) judge whether a robot could fit through apertures (passability), (b) judge whether they could drive a robot through apertures (driveability), and (c) drive the robot through apertures. Experiment 1 examined teleoperators’ passability judgments and whether those same operators hit apertures that were wider than the robot. Experiment 2 replicated Experiment 1 and examined driveability judgments. Experiment 1 indicated that teleoperators made accurate passability judgments and routinely hit apertures that were wider than the robot. Experiment 2 successfully replicated Experiment 1 and demonstrated that teleoperators did not make accurate driveability judgments. Experiment 1 indicated that teleoperating a robot through an aperture is constrained by the robots’ physical dimensions plus a safety margin associated with how well the operators drive the robot. Thus, teleoperators should base decisions to enter an aperture on their ability to drive the robot. However, Experiment 2 indicated that teleoperators do not make accurate driveability judgments. These results have implications for teleoperator training and the design of robots for specific applications.
2 May 2021 in Human Factors: The Journal of the Human Factors and Ergonomics Society
Objective: To understand how aspects of vishing calls (phishing phone calls) influence perceived visher honesty. Background: Little is understood about how targeted individuals behave during vishing attacks. According to truth-default theory, people assume others are being honest until something triggers their suspicion. We investigated whether that was true during vishing attacks. Methods: Twenty-four participants read written descriptions of eight real-world vishing calls. Half included highly sensitive requests; the remainder included seemingly innocuous requests. Participants rated visher honesty at multiple points during conversations. Results: Participants initially perceived vishers to be honest. Honesty ratings decreased before requests occurred. Honesty ratings decreased further in response to highly sensitive requests, but not seemingly innocuous requests. Honesty ratings recovered somewhat, but only after highly sensitive requests. Conclusions: The present results revealed five important insights: (1) people begin vishing conversations in the truth-default state, (2) certain aspects of vishing conversations serve as triggers, (3) other aspects of vishing conversations do not serve as triggers, (4) in certain situations, people’s perceptions of visher honesty improve, and, more generally, (5) truth-default theory may be a useful tool for understanding how targeted individuals behave during vishing attacks. Application: Those developing systems that help users deal with suspected vishing attacks or penetration testing plans should consider (1) targeted individuals’ truth-bias, (2) the influence of visher demeanor on the likelihood of deception detection, (3) the influence of fabricated situations surrounding vishing requests on the likelihood of deception detection, and (4) targeted individuals’ lack of concern about seemingly innocuous requests.
19 September 2019 in International Journal of Human–Computer Interaction
Remote pointing is an input method that involves in-air gesticulation. Target selection via Leap Motion-based remote pointing and mouse-based pointing were compared while addressing methodological limitations that were present in previous studies. Participants completed the ISO 9241-9 multidirectional tapping test for pointing device evaluation with a wide range of target size-distance combinations and a standardized arm posture. Dependent variables included movement time, errors, throughput, perceived comfort, perceived fatigue, user preference, and perceived usability. Leap Motion-based input led to (a) worse user productivity, (b) more finger, wrist, shoulder, and neck fatigue, (c) lower preference ratings, and (d) lower usability ratings than mouse-based input. The experiment (i) confirmed findings about remote pointing-related productivity and fatigue, and did so while controlling methodological limitations present in prior studies, (ii) revealed significant discomfort and fatigue despite the presence of an arm rest, and (iii) revealed new findings about preference and usability.
It is important to comprehend the attacker’s behavior and capacity in order to build a stronger fortress and thus be able to protect valuable assets more effectively. Prior to launching technical and physical attacks, an attacker may enter the reconnaissance stage and gather sensitive information. To collect such valuable data, one of the most effective approaches is through conducting social engineering attacks, borrowing techniques from deception theory. As a result, it is of utmost importance to understand when an attacker behaves truthfully and when the attacker opts to be deceitful. This paper models attacker’s states using Markov Decision Process (MDP) and studies the attacker’s decision for launching deception attacks in terms of cooperation and deception costs. The study is performed through Markov Decision Process (MDP) modeling, where the states of attackers are modeled along with the permissible actions that can be taken. We found that the optimal policy regarding being deceitful or truthful depends on the cost associated with deception and how much the attacker can afford to take the risk of launching deception attacks. More specifically, we observed that when the cost of cooperation is low (e.g., 10%), by taking MDP optimal policy, the attacker cooperates with the victim as much as possible in order to gain their trust; whereas, when the cost of cooperation is high (e.g., 50%), the attacker takes deceptive action earlier in order to minimize the cost of interactions while maximizing the impact of the attack. We report four case studies and simulations through which we demonstrate the trade-off between cooperative and deceptive actions in accordance with their costs to attackers.