Sandipan Banerjee

Sandipan Banerjee

Auto-generated profile, based on publicly available information

Sandipan Banerjee

Department of Computer Science & Engineering University of Notre Dame USA

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 February 2016
Verified
Book Chapter
Closed access
PDF file
SBSandipan Banerjee
Sandipan Banerjee
DMDomingo Mery
Domingo Mery

25 April 2017 in arXiv
Verified
Preprint
Open access
PDF file
SBSandipan Banerjee
Sandipan Banerjee
JBJohn S. Bernhard
John S. Bernhard
WSWalter J. Scheirer
Walter J. Scheirer
KBKevin W. Bowyer
Kevin W. Bowyer
PFPatrick J. Flynn
Patrick J. Flynn
In this paper, we propose a novel face synthesis approach that can generate an arbitrarily large number of synthetic images of both real and synthetic identities. Thus a face image dataset can be expanded in terms of the number of identities represented and the number of images per identity using this approach, without the identity-labeling and privacy complications that come from downloading images from the web. To measure the visual fidelity and uniqueness of the synthetic face images and identities, we conducted face matching experiments with both human participants and a CNN pre-trained on a dataset of 2.6M real face images. To evaluate the stability of these synthetic faces, we trained a CNN model with an augmented dataset containing close to 200,000 synthetic faces. We used a snapshot of this trained CNN to recognize extremely challenging frontal (real) face images. Experiments showed training with the augmented faces boosted the face recognition performance of the CNN.

19 November 2018 in arXiv
Verified
Preprint
Open access
PDF file
SBSandipan Banerjee
Sandipan Banerjee
WSWalter J. Scheirer
Walter J. Scheirer
KBKevin W. Bowyer
Kevin W. Bowyer
PFPatrick J. Flynn
Patrick J. Flynn
We propose an algorithm to generate realistic face images of both real and synthetic identities (people who do not exist) with different facial yaw, shape and resolution.The synthesized images can be used to augment datasets to train CNNs or as massive distractor sets for biometric verification experiments without any privacy concerns. Additionally, law enforcement can make use of this technique to train forensic experts to recognize faces. Our method samples face components from a pool of multiple face images of real identities to generate the synthetic texture. Then, a real 3D head model compatible to the generated texture is used to render it under different facial yaw transformations. We perform multiple quantitative experiments to assess the effectiveness of our synthesis procedure in CNN training and its potential use to generate distractor face images. Additionally, we compare our method with popular GAN models in terms of visual quality and execution time.

27 March 2018 in arXiv
Verified
Preprint
Open access
PDF file
SBSandipan Banerjee
Sandipan Banerjee
JBJoel Brogan
Joel Brogan
Janez KrižajJanez Križaj
Janez Križaj
ABAparna Bharati
Aparna Bharati
BRBrandon RichardWebster
Brandon RichardWebster
WSWalter Scheirer
Walter Scheirer
Face recognition performance has improved remarkably in the last decade. Much of this success can be attributed to the development of deep learning techniques such as convolutional neural networks (CNNs). While CNNs have pushed the state-of-the-art forward, their training process requires a large amount of clean and correctly labelled training data. If a CNN is intended to tolerate facial pose, then we face an important question: should this training data be diverse in its pose distribution, or should face images be normalized to a single pose in a pre-processing step? To address this question, we evaluate a number of popular facial landmarking and pose correction algorithms to understand their effect on facial recognition performance. Additionally, we introduce a new, automatic, single-image frontalization scheme that exceeds the performance of current algorithms. CNNs trained using sets of different pre-processing methods are used to extract features from the Point and Shoot Challenge (PaSC) and CMU Multi-PIE datasets. We assert that the subsequent verification and recognition performance serves to quantify the effectiveness of each pose correction scheme.

13 April 2017 in arXiv
Verified
Preprint
Open access
PDF file
SBSandipan Banerjee
Sandipan Banerjee
JSJames Sweet
James Sweet
CSChristopher Sweet
Christopher Sweet
MLMarya Lieberman
Marya Lieberman
Falsification of medicines is a big problem in many developing countries, where technological infrastructure is inadequate to detect these harmful products. We have developed a set of inexpensive paper cards, called Paper Analytical Devices (PADs), which can efficiently classify drugs based on their chemical composition, as a potential solution to the problem. These cards have different reagents embedded in them which produce a set of distinctive color descriptors upon reacting with the chemical compounds that constitute pharmaceutical dosage forms. If a falsified version of the medicine lacks the active ingredient or includes substitute fillers, the difference in color is perceivable by humans. However, reading the cards with accuracy takes training and practice, which may hamper their scaling and implementation in low resource settings. To deal with this, we have developed an automatic visual recognition system to read the results from the PAD images. At first, the optimal set of reagents was found by running singular value decomposition on the intensity values of the color tones in the card images. A dataset of cards embedded with these reagents is produced to generate the most distinctive results for a set of 26 different active pharmaceutical ingredients (APIs) and excipients. Then, we train two popular convolutional neural network (CNN) models, with the card images. We also extract some "hand-crafted" features from the images and train a nearest neighbor classifier and a non-linear support vector machine with them. On testing, higher-level features performed much better in accurately classifying the PAD images, with the CNN models reaching the highest average accuracy of over 94\%.