Yuki Koyama

Yuki Koyama

Auto-generated profile, based on publicly available information

Yuki Koyama

The University of Tokyo, Tokyo, Japan

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 April 2024 in Computer Graphics Forum
Verified
Journal Article
Open access
YTYuki Tatsukawa
Yuki Tatsukawa
ISI‐Chao Shen
I‐Chao Shen
AQAnran Qi
Anran Qi
YKYuki Koyama
Yuki Koyama
TITakeo Igarashi
Takeo Igarashi
ASAriel Shamir
Ariel Shamir
Acquiring the desired font for various design tasks can be challenging and requires professional typographic knowledge. While previous font retrieval or generation works have alleviated some of these difficulties, they often lack support for multiple languages and semantic attributes beyond the training data domains. To solve this problem, we present FontCLIP – a model that connects the semantic understanding of a large vision‐language model with typographical knowledge. We integrate typography‐specific knowledge into the comprehensive vision‐language knowledge of a pretrained CLIP model through a novel finetuning approach. We propose to use a compound descriptive prompt that encapsulates adaptively sampled attributes from a font attribute dataset focusing on Roman alphabet characters. FontCLIP's semantic typographic latent space demonstrates two unprecedented generalization abilities. First, FontCLIP generalizes to different languages including Chinese, Japanese, and Korean (CJK), capturing the typographical features of fonts across different languages, even though it was only finetuned using fonts of Roman characters. Second, FontCLIP can recognize the semantic attributes that are not presented in the training data. FontCLIP's dual‐modality and generalization abilities enable multilingual and cross‐lingual font retrieval and letter shape optimization, reducing the burden of obtaining desired fonts.

25 April 2025
Verified
Conference Paper
Open access
YTYuki Tatsukawa
Yuki Tatsukawa
ISI-Chao Shen
I-Chao Shen
MDMustafa Doga Dogan
Mustafa Doga Dogan
AQAnran Qi
Anran Qi
YKYuki Koyama
Yuki Koyama
TITakeo Igarashi
Takeo Igarashi

31 July 2020 in The Visual Computer
Verified
Journal Article
Open access
PDF file
RSRyo Shimamura
Ryo Shimamura
QFQi Feng
Qi Feng
YKYuki Koyama
Yuki Koyama
TNTakayuki Nakatsuka
Takayuki Nakatsuka
SFSatoru Fukayama
Satoru Fukayama
SMShigeo Morishima
Shigeo Morishima
We present a novel conceptaudio–visual object removalin 360-degree videos, in which a target object in a 360-degree video is removed in both the visual and auditory domains synchronously. Previous methods have solely focused on the visual aspect of object removal using video inpainting techniques, resulting in videos with unreasonable remaining sounds corresponding to the removed objects. We propose a solution which incorporates direction acquired during the video inpainting process into the audio removal process. More specifically, our method identifies the sound corresponding to the visually tracked target object and then synthesizes a three-dimensional sound field by subtracting the identified sound from the input 360-degree video. We conducted a user study showing that our multi-modal object removal supporting both visual and auditory domains could significantly improve the virtual reality experience, and our method could generate sufficiently synchronous, natural and satisfactory 360-degree videos.

9 August 2024 in IEEE Access
Verified
Journal Article
Open access
SYShigeo Yoshida
Shigeo Yoshida
YKYuki Koyama
Yuki Koyama
YUYoshitaka Ushiku
Yoshitaka Ushiku
Telecommunications technology has evolved rapidly, creating opportunities to diversify the communication culture through AI mediation. We anticipate that people will interchangeably use both user-controlled (controlled by transferring user movements) and AI-controlled avatars (controlled autonomously) in everyday communication. For example, users may temporarily use the AI-controlled mode during distractions. This paper argues the importance of investigating the auto-switching between user- and AI-controlled modes to improve the user experience in upcoming AI-mediated telecommunications. As a first step, we conducted a crowdsourced user experiment in a video chat context, focusing on the visual impressions of the displayed avatars. The result shows that impression improved when an appropriate switch setting is used, underscoring the value of this research direction. To identify the appropriate switch setting for our experiment, we developed a general-purpose adaptive experimental design tool based on Bayesian optimization, which will be publicly available.

9 May 2019 in The Visual Computer
Verified
Journal Article
Open access
PDF file
YKYuki Koyama
Yuki Koyama
MGMasataka Goto
Masataka Goto
Characters in interactive 3D applications are often animated by creating transitions from one motion clip to another in response to user input. It is not trivial, however, to achieve quick, natural-looking transitions between two arbitrary motion clips, especially when the two motions are dissimilar. To tackle this problem, we present a simple framework called optimal one-hop motion transition, which creates quick, natural-looking transitions on the fly without requiring careful manual specifications. The key ideas are (1) to insert a short intermediate motion clip, called a hop, between the source and destination motion clips, and (2) to select such a hop motion clip and its temporal alignment in an optimal way by solving a search problem. In the search problem, our framework tries to balance the naturalness of the resulting transitions and the responsiveness to user input. This search can be precomputed and the results can be stored in a lookup table, making the runtime cost to play an optimal transition negligible. We demonstrate that our framework is easily integrated into a widely used game engine, and that it greatly improves the quality of transitions in practical scenarios.

27 September 2025
Verified
Conference Paper
Open access
RNRyogo Niwa
Ryogo Niwa
SYShigeo Yoshida
Shigeo Yoshida
YKYuki Koyama
Yuki Koyama
YUYoshitaka Ushiku
Yoshitaka Ushiku