Joseph Peter Robinson

Joseph Peter Robinson

Auto-generated profile, based on publicly available information

Joseph Peter Robinson

Department of Electrical and Computer Engineering, Northeastern University, Boston, MA, USA

Research Focus & Metrics

Academic Career Length

16Years (2011-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 April 2018 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
JRJoseph P. Robinson
Joseph P. Robinson
MSMing Shao
Ming Shao
YWYue Wu
Yue Wu
HLHongfu Liu
Hongfu Liu
TGTimothy Gillis
Timothy Gillis
YFYun Fu
Yun Fu
We present the largest database for visual kinship recognition, Families In the Wild (FIW), with over 13,000 family photos of 1,000 family trees with 4-to-38 members. It took only a small team to build FIW with efficient labeling tools and work-flow. To extend FIW, we further improved upon this process with a novel semi-automatic labeling scheme that used annotated faces and unlabeled text metadata to discover labels, which were then used, along with existing FIW data, for the proposed clustering algorithm that generated label proposals for all newly added data-both processes are shared and compared in depth, showing great savings in time and human input required. Essentially, the clustering algorithm proposed is semi-supervised and uses labeled data to produce more accurate clusters. We statistically compare FIW to related datasets, which unarguably shows enormous gains in overall size and amount of information encapsulated in the labels. We benchmark two tasks, kinship verification and family classification, at scales incomparably larger than ever before. Pre-trained CNN models fine-tuned on FIW outscores other conventional methods and achieved state-of-the art on the renowned KinWild datasets. We also measure human performance on kinship recognition and compare to a fine-tuned CNN.

19 July 2023 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
JRJoseph P. Robinson
Joseph P. Robinson
CQCan Qin
Can Qin
YHYann Henon
Yann Henon
STSamson Timoner
Samson Timoner
YFYun Fu
Yun Fu
Demographic biases exist in current models used for facial recognition (FR). Our Balanced Faces in the Wild (BFW) dataset is a proxy to measure bias across ethnicity and gender subgroups, allowing one to characterize FR performances per subgroup. We show that results are non-optimal when a single score threshold determines whether sample pairs are genuine or imposters . Furthermore, within subgroups, performance often varies significantly from the global average. Thus, specific error rates only hold for populations matching the validation data. We mitigate the imbalanced performances using a novel domain adaptation learning scheme on the facial features extracted from state-of-the-art neural networks, boosting the average performance. The proposed method also preserves identity information while removing demographic knowledge. The removal of demographic knowledge prevents potential biases from being injected into decision-making and protects privacy since demographic information is no longer available. We explore the proposed method and show that subgroup classifiers can no longer learn from the features projected using our domain adaptation scheme. For source code and data, see https://github.com/visionjo/facerec-bias-bfw.

2 March 2021 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
JRJoseph Peter Robinson
Joseph Peter Robinson
MSMing Shao
Ming Shao
YFYun Fu
Yun Fu
Kinship recognition is a challenging problem with many practical applications. With much progress and milestones having been reached after ten years - we are now able to survey the research and create new milestones. We review the public resources and data challenges that enabled and inspired many to hone-in on the views of automatic kinship recognition in the visual domain. The different tasks are described in technical terms and syntax consistent across the problem domain and the practical value of each discussed and measured. State-of-the-art methods for visual kinship recognition problems, whether to discriminate between or generate from, are examined. As part of such, we review systems proposed as part of a recent data challenge held in conjunction with the 2020 IEEE Conference on Automatic Face and Gesture Recognition. We establish a stronghold for the state of progress for the different problems in a consistent manner. This survey will serve as the central resource for the work of the next decade to build upon. For the tenth anniversary, the demo code is provided for the various kin-based tasks. Detecting relatives with visual recognition and classifying the relationship is an area with high potential for impact in research and practice.

10 August 2021 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
JRJoseph Peter Robinson
Joseph Peter Robinson
ZKZaid Khan
Zaid Khan
YYYu Yin
Yu Yin
MSMing Shao
Ming Shao
YFYun Fu
Yun Fu
Kinship is a soft biometric detectable in media with an abundance of practical applications. Despite the difficulty of detecting kinship, annual data challenges using still-images have consistently improved performances and attracted new researchers. Now, systems reach performance levels unforeseeable a decade ago, closing in on performances acceptable to deploy in practice. Similar to other biometric tasks, we expect systems can benefit from additional modalities. We hypothesize that adding modalities to FIW, which contains only still-images, will improve performance. Thus, to narrow the gap between research and reality and enhance the power of kinship recognition systems, we extend FIW with multimedia (MM) data (i.e., video, audio, and text captions). Specifically, we introduce the first publicly available multi-task MM kinship dataset. To build FIW MM, we developed machinery to automatically collect, annotate, and prepare the data, requiring minimal human input and no financial cost. The proposed MM corpus allows the problem statements to be more realistic template-based protocols. We show significant improvements in all benchmarks with the added modalities. The results highlight edge cases to inspire future research with different areas of improvement. FIW MM provides the data required to increase the potential of automated systems to detect kinship in MM. It also allows experts from diverse fields to collaborate in novel ways.

10 February 2011
Verified
Conference Paper
Closed access
PDF file
TSTristan B Swedish
Tristan B Swedish
JRJoseph P Robinson
Joseph P Robinson
MSMaricris R Silva
Maricris R Silva
AGAndrew Gouldstone
Andrew Gouldstone
David KaeliDavid Kaeli
David Kaeli
CDCharles A Dimarzio
Charles A Dimarzio
Little is understood about the detailed micromechanical properties of lung in vivo. Attempts to improve imaging are hampered by heterogeneity of the tissue. One common ex vivo technique is optical coherence tomography (OCT). Simulated OCT with a Finite-Difference Time-Domain (FDTD) computer model elucidates the relationship between captured images and the physical geometry of the lung. Parallel computation and improved processing power make accurate coherent imaging models feasible. A previous FDTD model of pulsed laser wave propagation in the lung produced images that displayed many of the properties of experimental images. The model was improved with the addition of elastin and increased computational volume. Elastin plays an important role in the simulation because the combination of its fibrous structure and high index of refraction acts as an excellent scatterer of light. This strong scattering increases the signal reported by the simulated OCT scan in areas where elastin is most abundant, improving visualization of the structure as more light is reflected back from the heterogeneous elastin network. However, scattering by elastin decreases the depth of penetration and leads to images that are more difficult to interpret. Gaining a better understanding of how lung structures affect light propagation will lead to improved signal processing, instrumentation, and the development of new probing techniques. This image modeling technique can also be applied to other imaging modalities such as confocal and other laser scanning methods.

17 February 2020 in arXiv
Verified
Preprint
Open access
PDF file
YYYu Yin
Yu Yin
SJSongyao Jiang
Songyao Jiang
JRJoseph P. Robinson
Joseph P. Robinson
YFYun Fu
Yun Fu
Face frontalization provides an effective and efficient way for face data augmentation and further improves the face recognition performance in extreme pose scenario. Despite recent advances in deep learning-based face synthesis approaches, this problem is still challenging due to significant pose and illumination discrepancy. In this paper, we present a novel Dual-Attention Generative Adversarial Network (DA-GAN) for photo-realistic face frontalization by capturing both contextual dependencies and local consistency during GAN training. Specifically, a self-attention-based generator is introduced to integrate local features with their long-range dependencies yielding better feature representations, and hence generate faces that preserve identities better, especially for larger pose angles. Moreover, a novel face-attention-based discriminator is applied to emphasize local features of face regions, and hence reinforce the realism of synthetic frontal faces. Guided by semantic segmentation, four independent discriminators are used to distinguish between different aspects of a face (\ie skin, keypoints, hairline, and frontalized face). By introducing these two complementary attention mechanisms in generator and discriminator separately, we can learn a richer feature representation and generate identity preserving inference of frontal views with much finer details (i.e., more accurate facial appearance and textures) comparing to the state-of-the-art. Quantitative and qualitative experimental results demonstrate the effectiveness and efficiency of our DA-GAN approach.