Vishnu Sarukkai

Vishnu Sarukkai

Auto-generated profile, based on publicly available information

Vishnu Sarukkai

Stanford University

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 October 2024
Verified
Conference Paper
Open access
VSVishnu Sarukkai
Vishnu Sarukkai
LYLu Yuan
Lu Yuan
MTMia Tang
Mia Tang
MAManeesh Agrawala
Maneesh Agrawala
KFKayvon Fatahalian
Kayvon Fatahalian
We introduce a novel sketch-to-image tool that aligns with the iterative refinement process of artists. Our tool lets users sketch blocking strokes to coarsely represent the placement and form of objects and detail strokes to refine their shape and silhouettes. We develop a two-pass algorithm for generating high-fidelity images from such sketches at any point in the iterative process. In the first pass we use a ControlNet to generate an image that strictly follows all the strokes (blocking and detail) and in the second pass we add variation by renoising regions surrounding blocking strokes. We also present a dataset generation scheme that, when used to train a ControlNet architecture, allows regions that do not contain strokes to be interpreted as not-yet-specified regions rather than empty space. We show that this partial-sketch-aware ControlNet can generate coherent elements from partial sketches that only contain a small number of strokes. The high-fidelity images produced by our approach serve as scaffolds that can help the user adjust the shape and proportions of objects or add additional elements to the composition. We demonstrate the effectiveness of our approach with a variety of examples and evaluative comparisons. Quantitatively, evaluative user feedback indicates that novice viewers prefer the quality of images from our algorithm over a baseline Scribble ControlNet for 84% of the pairs and found our images had less distortion in 81% of the pairs.

9 October 2024 in Computer Graphics Forum
Verified
Journal Article
Closed access
DDD. Durst
D. Durst
FXF. Xie
F. Xie
VSV. Sarukkai
V. Sarukkai
BSB. Shacklett
B. Shacklett
IFI. Frosio
I. Frosio
KFK. Fatahalian
K. Fatahalian

4 December 2025 in ACM Transactions on Graphics
Verified
Journal Article
Open access
PXPei Xu
Pei Xu
ZWZhen Wu
Zhen Wu
RWRuocheng Wang
Ruocheng Wang
VSVishnu Sarukkai
Vishnu Sarukkai
KFKayvon Fatahalian
Kayvon Fatahalian
CLC. Karen Liu
C. Karen Liu
Learning a control policy for a multi-phase, long-horizon task, such as basketball maneuvers, remains challenging for reinforcement learning approaches due to the need for seamless policy composition and transitions between skills. A long-horizon task typically consists of distinct subtasks with well-defined goals, separated by transitional subtasks with unclear goals but critical to the success of the entire task. Existing methods like the mixture of experts and skill chaining struggle with tasks where individual policies do not share significant commonly explored states or lack well-defined initial and terminal states between different phases. In this paper, we introduce a novel policy integration framework to enable the composition of drastically different motor skills in multi-phase long-horizon tasks with ill-defined intermediate states. Based on that, we further introduce a high-level soft router to enable seamless and robust transitions between the subtasks. We evaluate our framework on a set of fundamental basketball skills and challenging transitions. Policies trained by our approach can effectively control the simulated character to interact with the ball and accomplish the long-horizon task specified by real-time user commands, without relying on ball trajectory references.

25 August 2024 in arXiv
Verified
Preprint
Open access
PDF file
DDDavid Durst
David Durst
FXFeng Xie
Feng Xie
VSVishnu Sarukkai
Vishnu Sarukkai
BSBrennan Shacklett
Brennan Shacklett
IFIuri Frosio
Iuri Frosio
KFKayvon Fatahalian
Kayvon Fatahalian
In multiplayer, first-person shooter games like Counter-Strike: Global Offensive (CS:GO), coordinated movement is a critical component of high-level strategic play. However, the complexity of team coordination and the variety of conditions present in popular game maps make it impractical to author hand-crafted movement policies for every scenario. We show that it is possible to take a data-driven approach to creating human-like movement controllers for CS:GO. We curate a team movement dataset comprising 123 hours of professional game play traces, and use this dataset to train a transformer-based movement model that generates human-like team movement for all players in a "Retakes" round of the game. Importantly, the movement prediction model is efficient. Performing inference for all players takes less than 0.5 ms per game step (amortized cost) on a single CPU core, making it plausible for use in commercial games today. Human evaluators assess that our model behaves more like humans than both commercially-available bots and procedural movement controllers scripted by experts (16% to 59% higher by TrueSkill rating of "human-like"). Using experiments involving in-game bot vs. bot self-play, we demonstrate that our model performs simple forms of teamwork, makes fewer common movement mistakes, and yields movement distributions, player lifetimes, and kill locations similar to those observed in professional CS:GO match play.