Anne Wilhelmina Saskia Rutjes

Anne Wilhelmina Saskia Rutjes

Auto-generated profile, based on publicly available information

Anne Wilhelmina Saskia Rutjes

Departmental Faculty of Medicine, UniCamillus - Saint Camillus International University of Health and Medical Science, Rome, Lazio, Italy

Research Focus & Metrics

Academic Career Length

25Years (2002-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 October 2011 in Annals of Internal Medicine
Verified
Journal Article
Open access
PDF file
PWPenny Whiting
Penny Whiting
ARAnne W.S. Rutjes
Anne W.S. Rutjes
MWMarie E. Westwood
Marie E. Westwood
SMSusan Mallett
Susan Mallett
JDJonathan J. Deeks
Jonathan J. Deeks
PBPatrick M.M. Bossuyt
Patrick M.M. Bossuyt
In 2003, the QUADAS tool for systematic reviews of diagnostic accuracy studies was developed. Experience, anecdotal reports, and feedback suggested areas for improvement; therefore, QUADAS-2 was developed. This tool comprises 4 domains: patient selection, index test, reference standard, and flow and timing. Each domain is assessed in terms of risk of bias, and the first 3 domains are also assessed in terms of concerns regarding applicability. Signalling questions are included to help judge risk of bias. The QUADAS-2 tool is applied in 4 phases: summarize the review question, tailor the tool and produce review-specific guidance, construct a flow diagram for the primary study, and judge bias and applicability. This tool will allow for more transparent rating of bias and applicability of primary diagnostic accuracy studies.

1 October 2005 in Journal of Clinical Epidemiology
Verified
Journal Article
Closed access
JRJohannes B. Reitsma
Johannes B. Reitsma
AGAfina S. Glas
Afina S. Glas
ARAnne W.S. Rutjes
Anne W.S. Rutjes
RSRob J.P.M. Scholten
Rob J.P.M. Scholten
PBPatrick M. Bossuyt
Patrick M. Bossuyt
AZAeilko H. Zwinderman
Aeilko H. Zwinderman

23 January 2018 in JAMA
Verified
Journal Article
Closed access
PDF file
MMMatthew D. F. McInnes
Matthew D. F. McInnes
DMDavid Moher
David Moher
BTBrett D. Thombs
Brett D. Thombs
TMTrevor A. McGrath
Trevor A. McGrath
PBPatrick M. Bossuyt
Patrick M. Bossuyt
BWBrian H. Willis
Brian H. Willis
Importance Systematic reviews of diagnostic test accuracy synthesize data from primary diagnostic studies that have evaluated the accuracy of 1 or more index tests against a reference standard, provide estimates of test performance, allow comparisons of the accuracy of different tests, and facilitate the identification of sources of variability in test accuracy. Objective To develop the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagnostic test accuracy guideline as a stand-alone extension of the PRISMA statement. Modifications to the PRISMA statement reflect the specific requirements for reporting of systematic reviews and meta-analyses of diagnostic test accuracy studies and the abstracts for these reviews. Design Established standards from the Enhancing the Quality and Transparency of Health Research (EQUATOR) Network were followed for the development of the guideline. The original PRISMA statement was used as a framework on which to modify and add items. A group of 24 multidisciplinary experts used a systematic review of articles on existing reporting guidelines and methods, a 3-round Delphi process, a consensus meeting, pilot testing, and iterative refinement to develop the PRISMA diagnostic test accuracy guideline. The final version of the PRISMA diagnostic test accuracy guideline checklist was approved by the group. Findings The systematic review (produced 64 items) and the Delphi process (provided feedback on 7 proposed items; 1 item was later split into 2 items) identified 71 potentially relevant items for consideration. The Delphi process reduced these to 60 items that were discussed at the consensus meeting. Following the meeting, pilot testing and iterative feedback were used to generate the 27-item PRISMA diagnostic test accuracy checklist. To reflect specific or optimal contemporary systematic review methods for diagnostic test accuracy, 8 of the 27 original PRISMA items were left unchanged, 17 were modified, 2 were added, and 2 were omitted. Conclusions and Relevance The 27-item PRISMA diagnostic test accuracy checklist provides specific guidance for reporting of systematic reviews. The PRISMA diagnostic test accuracy guideline can facilitate the transparent reporting of reviews, and may assist in the evaluation of validity and applicability, enhance replicability of reviews, and make the results from systematic reviews of diagnostic test accuracy studies more useful.

10 November 2003 in BMC Medical Research Methodology
Verified
Journal Article
Open access
PDF file
PWPenny Whiting
Penny Whiting
ARAnne Ws Rutjes
Anne Ws Rutjes
JRJohannes B Reitsma
Johannes B Reitsma
PBPatrick Mm Bossuyt
Patrick Mm Bossuyt
JKJos Kleijnen
Jos Kleijnen
In the era of evidence based medicine, with systematic reviews as its cornerstone, adequate quality assessment tools should be available. There is currently a lack of a systematically developed and evaluated tool for the assessment of diagnostic accuracy studies. The aim of this project was to combine empirical evidence and expert opinion in a formal consensus method to develop a tool to be used in systematic reviews to assess the quality of primary studies of diagnostic accuracy. We conducted a Delphi procedure to develop the quality assessment tool by refining an initial list of items. Members of the Delphi panel were experts in the area of diagnostic research. The results of three previously conducted reviews of the diagnostic literature were used to generate a list of potential items for inclusion in the tool and to provide an evidence base upon which to develop the tool. A total of nine experts in the field of diagnostics took part in the Delphi procedure. The Delphi procedure consisted of four rounds, after which agreement was reached on the items to be included in the tool which we have called QUADAS. The initial list of 28 items was reduced to fourteen items in the final tool. Items included covered patient spectrum, reference standard, disease progression bias, verification bias, review bias, clinical review bias, incorporation bias, test execution, study withdrawals, and indeterminate results. The QUADAS tool is presented together with guidelines for scoring each of the items included in the tool. This project has produced an evidence based quality assessment tool to be used in systematic reviews of diagnostic accuracy studies. Further work to determine the usability and validity of the tool continues.

3 February 2004 in Annals of Internal Medicine
Verified
Journal Article
Closed access
PDF file
PWPenny Whiting
Penny Whiting
ARAnne W.S. Rutjes
Anne W.S. Rutjes
JRJohannes B. Reitsma
Johannes B. Reitsma
AGAfina S. Glas
Afina S. Glas
PBPatrick M.M. Bossuyt
Patrick M.M. Bossuyt
JKJos Kleijnen
Jos Kleijnen
Studies of diagnostic accuracy are subject to different sources of bias and variation than studies that evaluate the effectiveness of an intervention. Little is known about the effects of these sources of bias and variation. To summarize the evidence on factors that can lead to bias or variation in the results of diagnostic accuracy studies. MEDLINE, EMBASE, and BIOSIS, and the methodologic databases of the Centre for Reviews and Dissemination and the Cochrane Collaboration. Methodologic experts in diagnostic tests were contacted. Studies that investigated the effects of bias and variation on measures of test performance were eligible for inclusion, which was assessed by one reviewer and checked by a second reviewer. Discrepancies were resolved through discussion. Data extraction was conducted by one reviewer and checked by a second reviewer. The best-documented effects of bias and variation were found for demographic features, disease prevalence and severity, partial verification bias, clinical review bias, and observer and instrument variation. For other sources, such as distorted selection of participants, absent or inappropriate reference standard, differential verification bias, and review bias, the amount of evidence was limited. Evidence was lacking for other features, including incorporation bias, treatment paradox, arbitrary choice of threshold value, and dropouts. Many issues in the design and conduct of diagnostic accuracy studies can lead to bias or variation; however, the empirical evidence about the size and effect of these issues is limited.

6 March 2006 in BMC Medical Research Methodology
Verified
Journal Article
Open access
PWPenny Whiting
Penny Whiting
MWMarie E Weswood
Marie E Weswood
ARAnne Ws Rutjes
Anne Ws Rutjes
JRJohannes B Reitsma
Johannes B Reitsma
PBPatrick Nm Bossuyt
Patrick Nm Bossuyt
JKJos Kleijnen
Jos Kleijnen
Background: A quality assessment tool for diagnostic accuracy studies, named QUADAS, has recently been developed. Although QUADAS has been used in several systematic reviews, it has not been formally validated. The objective was to evaluate the validity and usefulness of QUADAS. Methods: Three reviewers independently rated the quality of 30 studies using QUADAS. We assessed the proportion of agreements between each reviewer and the final consensus rating. This was done for all QUADAS items combined and for each individual item. Twenty reviewers who had used QUADAS in their reviews completed a short structured questionnaire on their experience of QUADAS. Results: Over all items, the agreements between each reviewer and the final consensus rating were 91%, 90% and 85%. The results for individual QUADAS items varied between 50% and 100% with a median value of 90%. Items related to uninterpretable test results and withdrawals led to the most disagreements. The feedback on the content of the tool was generally positive with only small numbers of reviewers reporting problems with coverage, ease of use, clarity of instructions and validity. Conclusion: Major modifications to the content of QUADAS itself are not necessary. The evaluation highlighted particular difficulties in scoring the items on uninterpretable results and withdrawals. Revised guidelines for scoring these items are proposed. It is essential that reviewers tailor guidelines for scoring items to their review, and ensure that all reviewers are clear on how to score studies. Reviewers should consider whether all QUADAS items are relevant to their review, and whether additional quality items should be assessed as part of their review.