26 October 2020 in IEEE Access
We present a neural network learning approach for estimating a set of cloth simulation parameters from a static drape of a given fabric. We use a variant of Cusick’s drape, which is used in the fashion textile industry to classify fabric according to mechanical properties. In order to produce a large enough set of reliable training data, we first randomly sample simulation parameters using a Gaussian mixture model that is fitted with 400 sets of primary simulation parameters derived from real fabrics. Then, we simulate our modified Cusick’s drape for each sample parameter set. To learn the training data, we propose a two-stream fully connected neural network model. We prove the suitability of our neural network model through comparisons of the learning errors and accuracy with other similar neural network and linear regression models. Additionally, to demonstrate the practicality of our method, we reproduce the drape shapes of real fabrics using the simulation parameters estimated from the trained neural networks.
30 April 2024 in Computer Graphics Forum
24 August 2020 in IEEE Access
Popular virtual reality systems today allow us to experience highly immersive applications in which virtual objects are realistically perceived via stereoscopic displays and can be directly manipulated based on hand-eye coordination in a very similar way as in the real world. However, the insufficiency of sensory feedback as well as the limited degrees-of-freedom of input motion still hinders precise and elaborate manipulation in virtual reality. Aiming at more precise 3D manipulation, we present a new method of extending the user’s spatial perception ability with the ‘virtual mirrors’, which expose the hidden spatial information of given virtual scenes to the user. The movement of a virtual mirror is automatically controlled by solving an optimization problem iteratively, in which the objective function prefers the placement of the mirror that can highlight the spatial relationship between the manipulated object and the object nearest to it. The optimization process is handled efficiently for each time step based on our method for finding the closest gap between any two objects based on the OBB (oriented bounding box) trees and our sampling-based approximate approach to the optimization problem. The usefulness of our method is demonstrated by several pilot applications under various usage scenarios, such as assembling construction toys and solving 3D dissection puzzles. The quantitative results of our user study show that the virtual mirror is very helpful in increasing the precision in 3D manipulation tasks in virtual reality.
13 June 2022 in Computer Animation and Virtual Worlds
1 May 2024 in Computer Animation and Virtual Worlds
We present a cloth simulation parameter estimation method that integrates the flexibility of global optimization with the speed of neural networks. While global optimization allows for varied designs in objective functions and specifying the range of optimization variables, it requires thousands of objective function evaluations. Each evaluation, which involves a cloth simulation, is computationally demanding and impractical time‐wise. On the other hand, neural network learning methods offer quick estimation results but face challenges such as the need for data collection, re‐training when input data formats change, and difficulties in setting constraints on variable ranges. Our proposed method addresses these issues by replacing the simulation process, typically necessary for objective function evaluations in global optimization, with a neural network for inference. We demonstrate that, once an estimation model is trained, optimization for various objective functions becomes straightforward. Moreover, we illustrate that it is possible to achieve optimization results that reflect the intentions of expert users through visualization of a wide optimization space and the use of range constraints.
1 December 2020 in Journal of the Korea Computer Graphics Society