Hand motion tracking plays an important role in virtual reality systems for immersion and interaction purposes. This paper discusses the problem of finger tracking and proposes the application of the extension of the Madgwick filter and a simple switching (motion recognition) algorithm as a comparison. The proposed algorithms utilize the three-link finger model and provide complete information about the position and orientation of the metacarpus. The numerical experiment shows that this approach is feasible and overcomes some of the major limitations of inertial motion tracking. The paper’s proposed solution was created in order to track a user’s pointing and grasping movements during the interaction with the virtual reconstruction of the cultural heritage of historical cities.

The article sets a problem focusing on how to optimize the order of 3D user interface for virtual reconstruction of Moscow historical center landscape in the 16th-18th centuries. To work with the interface a virtual reality headset, a motion tracking system and an eye-tracker were integrated. Spatial representation of the historical reconstruction is accompanied by a specialized interface that allows one to access the source database. The authors introduce a criterion that provides for estimating the optimum order of interface elements in the virtual space. The problem is handled in case there are unknown factors such as the size of user's hands, deviations in the position of an interactive object and restrictions related to the disposition of interface elements. The article sets the general problem and solves some internal problems related to the construction of acceptable multiple dispositions of interface elements and the modeling of eyesight movement from one interface element to another. The article is the first to suggest an algorithm to numerically optimize the interface in 3D virtual space modeling the relief and historical buildings in the center of Moscow. It provides for user’s movement and gives access to historical sources which are the basis for virtual reconstruction of the heritage understudy.