Johannes Knittel

Mr. Johannes Knittel


Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 April 2024 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
CCChangjian Chen
Changjian Chen
JCJiashu Chen
Jiashu Chen
WYWeikai Yang
Weikai Yang
HWHaoze Wang
Haoze Wang
JKJohannes Knittel
Johannes Knittel
SLShixia Liu
Shixia Liu
Temporal action localization aims to identify the boundaries and categories of actions in videos, such as scoring a goal in a football match. Single-frame supervision has emerged as a labor-efficient way to train action localizers as it requires only one annotated frame per action. However, it often suffers from poor performance due to the lack of precise boundary annotations. To address this issue, we propose a visual analysis method that aligns similar actions and then propagates a few user-provided annotations (e.g., boundaries, category labels) to similar actions via the generated alignments. Our method models the alignment between actions as a heaviest path problem and the annotation propagation as a quadratic optimization problem. As the automatically generated alignments may not accurately match the associated actions and could produce inaccurate localization results, we develop a storyline visualization to explain the localization results of actions and their alignments. This visualization facilitates users in correcting wrong localization results and misalignments. The corrections are then used to improve the localization results of other actions. The effectiveness of our method in improving localization performance is demonstrated through quantitative evaluation and a case study.

17 July 2020 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
JKJohannes Knittel
Johannes Knittel
SKSteffen Koch
Steffen Koch
TEThomas Ertl
Thomas Ertl
It is difficult to explore large text collections if no or little information is available on the contained documents. Hence, starting analytic tasks on such corpora is challenging for many stakeholders from various domains. As a remedy, recent visualization research suggests to use visual spatializations of representative text documents or tags to explore text collections. With PyramidTags, we introduce a novel approach for summarizing large text collections visually. In contrast to previous work, PyramidTags in particular aims at creating an improved representation that incorporates both temporal evolution and semantic relationship of visualized tags within the summarized document collection. As a result, it equips analysts with a visual starting point for interactive exploration to not only get an overview of the main terms and phrases of the corpus, but also to grasp important ideas and stories. Analysts can hover and select multiple tags to explore relationships and retrieve the most relevant documents. In this work, we apply PyramidTags to hundreds of thousands of web-crawled news reports. Our benchmarks suggest that PyramidTags creates time- and context-aware layouts, while preserving the inherent word order of important pairs.

9 December 2023
Verified
Book Chapter
Open access
PDF file
JKJohannes Knittel
Johannes Knittel
FHFranziska Huth
Franziska Huth
SKSteffen Koch
Steffen Koch
TEThomas Ertl
Thomas Ertl
The number of social media posts and news articles that are being published every day is high. This makes them an attractive source of human-generated information for different domain experts such as journalists and business analysts but also emergency responders, particularly if posts contain references to geolocations. Visual analytics approaches can help to gain insights into such datasets and inform decision-makers. However, the high volume and the veracity of the data, as well as the velocity in the case of streaming data, pose challenges when supporting explorative analysis with interactive visualization. Based on four exemplary approaches, we outline recently proposed strategies to tackle these challenges. We describe how geo-aware filtering and anomaly detection methods can help to inform stakeholders based on geolocated tweets. We show that data-aware tag maps can provide analysts with an overview-first, details-on-demand visual summary of large amounts of text content over time. With space-filling curves, we can visualize the temporal evolution of geolocations in a two-dimensional plot without relying on animations that would impede comparative analyses. Additionally, we discuss the use of an efficient dynamic clustering algorithm for enabling large-scale visual analyses of streaming posts.

5 December 2025 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
JKJohannes Knittel
Johannes Knittel
SWSimon Warchol
Simon Warchol
JTJakob Troidl
Jakob Troidl
CBCamelia D. Brumar
Camelia D. Brumar
HYHelen Yu Yang
Helen Yu Yang
HPHanspeter Pfister
Hanspeter Pfister
In-vitro fertilization (IVF) has become standard practice to address infertility, which affects more than one in ten couples in the US. However, current protocols yield relatively low success rates of about 20% per treatment cycle. A critical but complex and time-consuming step is the grading and selection of embryos for implantation. Although incubators with time-lapse microscopy have enabled computational analysis of embryo development, existing automated approaches either require extensive manual annotations or use opaque deep learning models that are hard for clinicians to validate and trust. We present EmbryoProfiler, a visual analytics system collaboratively developed with embryologists, biologists, and machine learning researchers to support clinicians in visually assessing embryo viability from time-lapse microscopy imagery. Our system incorporates a deep learning pipeline that automatically annotates microscopy images and extracts clinically interpretable features relevant for embryo grading. Our contributions include: (1) a semi-automatic, visualization-based workflow that guides clinicians through fertilization assessment, developmental timing evaluation, morphological inspection, and comparative analysis of embryos; (2) innovative interactive visualizations, such as cell-shape plots, designed to facilitate efficient analysis of morphological and developmental characteristics; and (3) an integrated, explainable machine learning classifier offering transparent, clinically-informed embryo viability scoring to predict live birth outcomes. Quantitative evaluation of our classifier and qualitative case studies conducted with practitioners demonstrate that EmbryoProfiler enables clinicians to make better-informed embryo selection decisions, potentially leading to improved clinical outcomes in IVF treatments.

22 July 2025 in bioRxiv
Verified
Preprint
Open access
SWSimon Warchol
Simon Warchol
GGGrace Guo
Grace Guo
JKJohannes Knittel
Johannes Knittel
DFDan Freeman
Dan Freeman
UBUsha Bhalla
Usha Bhalla
HPHanspeter Pfister
Hanspeter Pfister
Dimensionality reduction techniques help analysts make sense of complex, high-dimensional spatial datasets, such as multiplexed tissue imaging, satellite imagery, and astronomical observations, by projecting data attributes into a two-dimensional space. However, these techniques typically abstract away crucial spatial, positional, and morphological contexts, complicating interpretation and limiting insights. To address these limitations, we present SEAL , an interactive visual analytics system designed to bridge the gap between abstract 2D embeddings and their rich spatial imaging context. SEAL introduces a novel hybrid-embedding visualization that preserves image and morphological information while integrating critical high-dimensional feature data. By adapting set visualization methods, SEAL allows analysts to identify, visualize, and compare selections—defined manually or algorithmically—in both the embedding and original spatial views, facilitating a deeper understanding of the spatial arrangement and morphological characteristics of entities of interest. To elucidate differences between selected sets of items, SEAL employs a scalable surrogate model to calculate feature importance scores, identifying the most influential features governing the position of objects within embeddings. These importance scores are visually summarized across selections, with mathematical set operations enabling detailed comparative analyses. We demonstrate SEAL ’s effectiveness and versatility through three case studies: colorectal cancer tissue analysis with a pharmacologist, melanoma investigation with a cell biologist, and exploration of sky survey data with an astronomer. These studies underscore the importance of integrating image context into embedding spaces when interpreting complex imaging datasets. Implemented as a standalone tool while also integrating seamlessly with computational notebooks, SEAL provides an interactive platform for spatially informed exploration of high-dimensional datasets, significantly enhancing interpretability and insight generation.