Markel Vigo

Markel Vigo

Auto-generated profile, based on publicly available information

Markel Vigo

Department of Computer Science, The University of Manchester, Manchester, United Kingdom

Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 May 2013
Verified
Conference Paper
Open access
PDF file
MVMarkel Vigo
Markel Vigo
JBJustin Brown
Justin Brown
VCVivienne Conway
Vivienne Conway
The use of web accessibility evaluation tools is a widespread practice. Evaluation tools are heavily employed as they help in reducing the burden of identifying accessibility barriers. However, an over-reliance on automated tests often leads to setting aside further testing that entails expert evaluation and user tests. In this paper we empirically show the capabilities of current automated evaluation tools. To do so, we investigate the effectiveness of 6 state-of-the-art tools by analysing their coverage, completeness and correctness with regard to WCAG 2.0 conformance. We corroborate that relying on automated tests alone has negative effects and can have undesirable consequences. Coverage is very narrow as, at most, 50% of the success criteria are covered. Similarly, completeness ranges between 14% and 38%; however, some of the tools that exhibit higher completeness scores produce lower correctness scores (66-71%) due to the fact that catching as many violations as possible can lead to an increase in false positives. Therefore, relying on just automated tests entails that 1 of 2 success criteria will not even be analysed and among those analysed, only 4 out of 10 will be caught at the further risk of generating false positives. Copyright 2013 ACM

1 July 2016 in International Journal of Human-Computer Studies
Verified
Journal Article
Closed access
AAAmaia Aizpurua
Amaia Aizpurua
SHSimon Harper
Simon Harper
MVMarkel Vigo
Markel Vigo

1 March 2011 in Interacting with Computers
Verified
Journal Article
Closed access
MVMarkel Vigo
Markel Vigo
GBGiorgio Brajnik
Giorgio Brajnik
The fact that several web accessibility metrics exist may be evidence of a lack of a comparison framework that highlights how well they work and for what purposes they are appropriate. In this paper we aim at formulating such a framework, demonstrating that it is feasible, and showing the findings we obtained when we applied it to seven existing automatic accessibility metrics. The framework encompasses validity, reliability, sensitivity, adequacy and complexity of metrics in the context of four scenarios where the metrics can be used. The experimental demonstration of the viability of the framework is based on applying seven published metrics to more than 1500 web pages and then operationalizing the notions of validity-as-conformance, adequacy and complexity. Our findings lead us to conclude that the Web Accessibility Quantitative Metric, Page Measure and Web Accessibility Barrier are the metrics that achieve the highest levels of quality (out of the seven that we examined). Finally, since we did not analyse reliability, sensitivity and validity-in-use, this paper provides guidance to address them in what are new research avenues.

3 December 2013 in Behaviour & Information Technology
Verified
Journal Article
Closed access
YYYeliz Yesilada
Yeliz Yesilada
GBGiorgio Brajnik
Giorgio Brajnik
MVMarkel Vigo
Markel Vigo
SHSimon Harper
Simon Harper
The equality of access – accessibility – is difficult to quantify, define, or agree upon. Our previous work analysed the responses of web accessibility specialists in regard to a number of pre-defined definitions of accessibility. While uncovering much, this analysis did not allow us to quantify the communities’ understanding of the relationship accessibility has with other domains and assess how the community scopes accessibility. In this case, we asked over 300 people, with an interest in accessibility, to answer 33 questions surrounding the relationship between accessibility, user experience (UX), and usability; inclusion and exclusion; and evaluation, in an attempt to harmonise our understanding of web accessibility. We found that respondents think that accessibility and usability are highly related and also think that accessibility is applicable to everyone and not just people with disabilities. Respondents strongly agree that accessibility must be grounded on user-centred practices and that accessibility evaluation is more than just inspecting source code; however, they are divided as to whether training in ‘Web Content Accessibility Guidelines’ is necessary or not to assess accessibility. These perceptions are important for usability and UX professionals, developers of automated evaluation tools, and those practitioners running website evaluations.

1 January 2007
Verified
Conference Paper
Open access
PDF file
MVMarkel Vigo
Markel Vigo
MAMyriam Arrue
Myriam Arrue
GBGiorgio Brajnik
Giorgio Brajnik
RLRaffaella Lomuscio
Raffaella Lomuscio
JAJulio Abascal
Julio Abascal
This paper raises the need for quantitative accessibility measurement and proposes three different application scenarios where quantitative accessibility metrics are useful: Quality Assurance within Web Engineering, Information Retrieval and accessibility monitoring. We propose a quantitative metric which is automatically calculated from reports of automatic evaluation tools. In order to prove the reliability of the metric, 15 websites (1363 web pages) are measured based on results yielded by 2 evaluation tools: EvalAccess and LIFT. Statistical analysis of results shows that the metric is dependent on the evaluation tool. However, Spearman's test produces high correlation between results of different tools. Therefore, we conclude that the metric is reliable for ranking purposes in Information Retrieval and accessibility monitoring scenarios and can also be partially applied in a Web Engineering scenario

1 November 2013 in International Journal of Human-Computer Studies
Verified
Journal Article
Closed access
MVMarkel Vigo
Markel Vigo
SHSimon Harper
Simon Harper