Ismet Zeki Yalniz

Ismet Zeki Yalniz

Auto-generated profile, based on publicly available information

Ismet Zeki Yalniz

Meta, Menlo Park, CA, USA

Research Focus & Metrics

Academic Career Length

17Years (2010-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 December 2017 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
IYIsmet Zeki Yalniz
Ismet Zeki Yalniz
RMR. Manmatha
R. Manmatha
The main goal of existing word spotting approaches for searching document images has been the identification of visually similar word images in the absence of high quality text recognition output. Searching for a piece of arbitrary text is not possible unless the user identifies a sample word image from the document collection or generates the query word image synthetically. To address this problem, a Markov Random Field (MRF) framework is proposed for searching document images and shown to be effective for searching arbitrary text in real time for books printed in English (Latin script), Telugu and Ottoman scripts. The English experiments demonstrate that the dependencies between the visual terms and letter bigrams can be automatically learned using noisy OCR output. It is also shown that OCR text search accuracy can be significantly improved if it is combined with the proposed approach. No commercial OCR engine is available for Telugu or Ottoman script. In these cases the dependencies are trained using manually annotated document images. It is demonstrated that the trained model can be directly used to resolve arbitrary text queries across books despite font type and size differences. The proposed approach outperforms a state-of-the-art BLSTM baseline in these contexts.

1 October 2010 in Pattern Recognition
Verified
Journal Article
Closed access
IYIsmet Zeki Yalniz
Ismet Zeki Yalniz
SASelim Aksoy
Selim Aksoy

10 July 2024
Verified
Conference Paper
Open access
XZXinliang Zhu
Xinliang Zhu
ADArnab Dhua
Arnab Dhua
DGDouglas Gray
Douglas Gray
IYI. Zeki Yalniz
I. Zeki Yalniz
TYTan Yu
Tan Yu
BPBryan Plummer
Bryan Plummer
Multimodal data is available in many applications like e-commerce production listings, social media posts and short videos. However, existing algorithms dealing with those types of data still focus on uni-modal representation learning by vision-language alignment and cross-modal retrieval. In this workshop, we target to bring a new retrieval problem where both queries and documents are multimodal. With the popularity of vision language modeling, large language models (LLMs), retrieval augmented generation (RAG), and multimodal LLM, we see a lot of new opportunities for multimodal representation and retrieval tasks. This event will be a comprehensive half-day workshop focusing on the subject of multimodal representation and retrieval. The agenda includes keynote speeches, oral presentations, and an interactive panel discussion.