Benyamin Ghojogh

Dr. Benyamin Ghojogh

orcid

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2023
Verified
Book
Closed access
BGBenyamin Ghojogh
Benyamin Ghojogh
MCMark Crowley
Mark Crowley
FKFakhri Karray
Fakhri Karray
AGAli Ghodsi
Ali Ghodsi

17 December 2020 in OSF Preprints
Verified
Preprint
Open access
BGBenyamin Ghojogh
Benyamin Ghojogh
AGAli Ghodsi
Ali Ghodsi
This is a tutorial and survey paper on the attention mechanism, transformers, BERT, and GPT. We first explain attention mechanism, sequence-to-sequence model without and with attention, self-attention, and attention in different areas such as natural language processing and computer vision. Then, we explain transformers which do not use any recurrence. We explain all the parts of encoder and decoder in the transformer, including positional encoding, multihead self-attention and cross-attention, and masked multihead attention. Thereafter, we introduce the Bidirectional Encoder Representations from Transformers (BERT) and Generative Pre-trained Transformer (GPT) as the stacks of encoders and decoders of transformer, respectively. We explain their characteristics and how they work.

18 December 2017 in IEEE Sensors Journal
Verified
Journal Article
Closed access
BGBenyamin Ghojogh
Benyamin Ghojogh
HMHoda Mohammadzade
Hoda Mohammadzade
MMMozhgan Mokari
Mozhgan Mokari
This article proposes a new method for viewinvariant action recognition that utilizes the temporal position of skeletal joints obtained by Kinect sensor. In this method, the actions are represented as sequences of several pre-defined poses. After pre-processing, which includes skeleton alignment and scaling, the appropriate feature vectors are obtained for recognizing and discriminating the pose of every frame by the proposed Fisherposes method. The proposed regularized Mahalanobis distance metric is used in order to recognize both the involuntary and highly made-up actions at the same time. Hidden Markov Model (HMM) is then used to classify the action related to an input sequence of poses. For taking into account the motion in the actions which are not separable by solely their temporal poses, histograms of trajectories are also proposed. The proposed action recognition method is capable of recognizing both the voluntary and involuntary actions, as well as posebased and trajectory-based ones with a high accuracy rate. The effectiveness of the proposed method is experimented on three publicly available datasets, TST fall detection, UTKinect, and UCFKinect datasets.

3 February 2023
Verified
Book Chapter
Closed access
PDF file
BGBenyamin Ghojogh
Benyamin Ghojogh
MCMark Crowley
Mark Crowley
FKFakhri Karray
Fakhri Karray
AGAli Ghodsi
Ali Ghodsi

8 August 2022
Verified
Book Chapter
Closed access
PDF file
BGBenyamin Ghojogh
Benyamin Ghojogh
MCMark Crowley
Mark Crowley
FKFakhri Karray
Fakhri Karray
AGAli Ghodsi
Ali Ghodsi

7 December 2020
Verified
Book Chapter
Closed access
PDF file
MSMilad Sikaroudi
Milad Sikaroudi
BGBenyamin Ghojogh
Benyamin Ghojogh
ASAmir Safarpoor
Amir Safarpoor
FKFakhri Karray
Fakhri Karray
MCMark Crowley
Mark Crowley
HTHamid Tizhoosh
Hamid Tizhoosh