12 November 2021 in Applied AI Letters
Attention maps, a popular heatmap‐based explanation method for Visual Question Answering, are supposed to help users understand the model by highlighting portions of the image/question used by the model to infer answers. However, we see that users are often misled by current attention map visualizations that point to relevant regions despite the model producing an incorrect answer. Hence, we propose Error Maps that clarify the error by highlighting image regions where the model is prone to err. Error maps can indicate when a correctly attended region may be processed incorrectly leading to an incorrect answer, and hence, improve users' understanding of those cases. To evaluate our new explanations, we further introduce a metric that simulates users' interpretation of explanations to evaluate their potential helpfulness to understand model correctness. We finally conduct user studies to see that our new explanations help users understand model correctness better than baselines by an expected 30% and that our proxy helpfulness metrics correlate strongly () with how well users can predict model correctness.
30 November 2023 in arXiv
Professional artists, photographers, and other visual content creators use object relighting to establish their photo's desired effect. Unfortunately, manual tools that allow relighting have a steep learning curve and are difficult to master. Although generative editing methods now enable some forms of image editing, relighting is still beyond today's capabilities; existing methods struggle to keep other aspects of the image -- colors, shapes, and textures -- consistent after the edit. We propose Lasagna, a method that enables intuitive text-guided relighting control. Lasagna learns a lighting prior by using score distillation sampling to distill the prior of a diffusion model, which has been finetuned on synthetic relighting data. To train Lasagna, we curate a new synthetic dataset ReLiT, which contains 3D object assets re-lit from multiple light source locations. Despite training on synthetic images, quantitative results show that Lasagna relights real-world images while preserving other aspects of the input image, outperforming state-of-the-art text-guided image editing methods. Lasagna enables realistic and controlled results on natural images and digital art pieces and is preferred by humans over other methods in over 91% of cases. Finally, we demonstrate the versatility of our learning objective by extending it to allow colorization, another form of image editing.
18 June 2015 in Applied Artificial Intelligence
KGKishan Prudhvi Guddanti
This article discusses an intelligent driving system (IDS) that uses a Polynomial Regression Network (PRN) and a Gaussian Anomaly Detection System (GADS). The PRN models the relation between the motor input and vehicle movement, thus, inherently taking nonlinear and noisy environmental factors into consideration. The anomaly detection system detects probable system output or sensor failure using a Gaussian pattern-match algorithm for taking proper corrective action. The time of computation for training the PRN is shown to be as low as 0.3 seconds and thus, the system can be used for instantaneous training in any environment at high speeds. Such intelligent driving systems will be useful for electric race-car designs, electric consumer vehicles, and robotic vehicles for stability on adverse road or track conditions.