This paper introduces a real-time 3D reconstruction of a human captured using a depth sensor and has integrated it with a holographic telepresence application. Holographic projection is widely recognized as one of the most promising 3D display technologies, and it is expected to become more widely available in the near future. This technology may also be deployed in various ways, including holographic prisms and Z-Hologram, which this research has used to demonstrate the initial results by displaying the reconstructed 3D representation of the user. The realization of a stable and inexpensive 3D data acquisition system is a problem that has yet to be solved. When we involve multiple sensors we need to compress and optimize the data so that it can be sent to a server for a telepresence. Therefore the paper presents the processes in real-time 3D reconstruction, which consists of data acquisition, background removal, point cloud extraction, and a surface generation which applies a marching cube algorithm to finally form an isosurface from the set of points in the point cloud which later texture mapping is applied on the isosurface generated. The compression results has been presented in this paper, and the results of the integration process after sending the data over the network also have been discussed.
Despite massive advancements in the telecommunications industry over the last few decades, telepresence video-based teleconferencing is still far from giving a physical co-presence experience. Applications like Skype, Zoom and WebEx are constrained as it is only able to display the head and shoulders of the users on one monitor. It offers the user flat two-dimensional (2D) upper body imageries, a fixed viewpoint, inconsistent gaze direction, and restriction. Therefore, the problem arises when video-based teleconferencing is unable to support effective communication in telepresence. Thus, this research aims to propose life-size telepresence by using a projector-based holographic display. To actualize the aim, there are three phases have been proposed in this research. The first phase is to enable the tracking technique using the Kinect sensor. The second phase is to enable networking using Agora.io. The last phase is to set up the holographic display using a projector before the evaluation phase. Based on the evaluation results, the life-size telepresence using holographic display application has succeeded in achieving the project aim and shown the life-size display increases the co-presence experience of the users and increases the efficient communication between the users.