Stefan Heindorf

Dr. Stefan Heindorf

orcid

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 October 2016
Verified
Conference Paper
Open access
SHStefan Heindorf
Stefan Heindorf
MPMartin Potthast
Martin Potthast
BSBenno Stein
Benno Stein
GEGregor Engels
Gregor Engels
Wikidata is the new, large-scale knowledge base of the Wikimedia Foundation. Its knowledge is increasingly used within Wikipedia itself and various other kinds of information systems, imposing high demands on its integrity. Wikidata can be edited by anyone and, unfortunately, it frequently gets vandalized, exposing all information systems using it to the risk of spreading vandalized and falsified information. In this paper, we present a new machine learning-based approach to detect vandalism in Wikidata. We propose a set of 47 features that exploit both content and context information, and we report on 4 classifiers of increasing effectiveness tailored to this learning task. Our approach is evaluated on the recently published Wikidata Vandalism Corpus WDVC-2015 and it achieves an area under curve value of the receiver operating characteristic, ROC-AUC, of 0.991. It significantly outperforms the state of the art represented by the rule-based Wikidata Abuse Filter (0.865 ROC-AUC) and a prototypical vandalism detector recently introduced by Wikimedia within the Objective Revision Evaluation Service (0.859 ROC-AUC).

9 August 2015
Verified
Conference Paper
Open access
SHStefan Heindorf
Stefan Heindorf
MPMartin Potthast
Martin Potthast
BSBenno Stein
Benno Stein
GEGregor Engels
Gregor Engels
We report on the construction of the Wikidata Vandalism Corpus WDVC-2015, the first corpus for vandalism in knowledge bases. Our corpus is based on the entire revision history of Wikidata, the knowledge base underlying Wikipedia. Among Wikidata's 24 million manual revisions, we have identified more than 100,000 cases of vandalism. An in-depth corpus analysis lays the groundwork for research and development on automatic vandalism detection in public knowledge bases. Our analysis shows that 58% of the vandalism revisions can be found in the textual portions of Wikidata, and the remainder in structural content, e.g., subject-predicate-object triples. Moreover, we find that some vandals also target Wikidata content whose manipulation may impact content displayed on Wikipedia, revealing potential vulnerabilities. Given today's importance of knowledge bases for information systems, this shows that public knowledge bases must be used with caution.

8 July 2022 in Scientific Data
Verified
Journal Article
Open access
PDF file
SPSvetlana Pestryakova
Svetlana Pestryakova
DVDaniel Vollmers
Daniel Vollmers
MSMohamed Ahmed Sherif
Mohamed Ahmed Sherif
SHStefan Heindorf
Stefan Heindorf
MSMuhammad Saleem
Muhammad Saleem
ANAxel-Cyrille Ngonga Ngomo
Axel-Cyrille Ngonga Ngomo
The rapid generation of large amounts of information about the coronavirus SARS-CoV-2 and the disease COVID-19 makes it increasingly difficult to gain a comprehensive overview of current insights related to the disease. With this work, we aim to support the rapid access to a comprehensive data source on COVID-19 targeted especially at researchers. Our knowledge graph, CovidPubGraph, an RDF knowledge graph of scientific publications, abides by the Linked Data and FAIR principles. The base dataset for the extraction is CORD-19, a dataset of COVID-19-related publications, which is updated regularly. Consequently, CovidPubGraph is updated biweekly. Our generation pipeline applies named entity recognition, entity linking and link discovery approaches to the original data. The current version of CovidPubGraph contains 268,108,670 triples and is linked to 9 other datasets by over 1 million links. In our use case studies, we demonstrate the usefulness of our knowledge graph for different applications. CovidPubGraph is publicly available under the Creative Commons Attribution 4.0 International license.

13 May 2019
Verified
Conference Paper
Open access
PDF file
SHStefan Heindorf
Stefan Heindorf
YSYan Scholten
Yan Scholten
GEGregor Engels
Gregor Engels
MPMartin Potthast
Martin Potthast

31 May 2022
Verified
Book Chapter
Closed access
PDF file
NKN’dah Jean Kouagou
N’dah Jean Kouagou
SHStefan Heindorf
Stefan Heindorf
CDCaglar Demir
Caglar Demir
ANAxel-Cyrille Ngonga Ngomo
Axel-Cyrille Ngonga Ngomo

2 February 2017
Verified
Conference Paper
Open access
PDF file
SHStefan Heindorf
Stefan Heindorf
MPMartin Potthast
Martin Potthast
HBHannah Bast
Hannah Bast
BBBjörn Buchhold
Björn Buchhold
EHElmar Haussmann
Elmar Haussmann
The WSDM Cup 2017 was a data mining challenge held in conjunction with the 10th International Conference on Web Search and Data Mining (WSDM). It addressed key challenges of knowledge bases today: quality assurance and entity search. For quality assurance, we tackle the task of vandalism detection, based on a dataset of more than 82 million user-contributed revisions of the Wikidata knowledge base, all of which annotated with regard to whether or not they are vandalism. For entity search, we tackle the task of triple scoring, using a dataset that comprises relevance scores for triples from type-like relations including occupation and country of citizenship, based on about 10,000 human relevance judgments. For reproducibility sake, participants were asked to submit their software on TIRA, a cloud-based evaluation platform, and they were incentivized to share their approaches open source.