The dynamic COVID-19 pandemic has destabilized education and forced academic centers to explore non-traditional teaching modalities. A key challenge this creates is in reconciling the fact that hands-on time in lab settings has been shown to increase student understanding and peak their interests. Traditional visualization methods are already limited and topics such as 3D molecular structures remain difficult to understand. This is where advances in Information and Communication Technologies (ICT), including remote meetings, Virtual Reality (VR), Augmented Reality (AR), Mixed Reality (MR), and Extended Reality (XR, so-called Metaverse) offer vast potential to revolutionize the education landscape. Specifically, how MR merges real and virtual life in a uniquely promising way and offers opportunities for entirely new educational applications. In this paper, we briefly overview and report our initial experience using MR to teach medical and pharmacy students. We also explore the future usefulness of MR in pharmacy education. MR mimics real-world experiences both in distance education and traditional laboratory classes. We also propose ICT-based systems designed to run on the Microsoft HoloLens2 MR goggles and can be successfully applied in medical and pharmacy coursework. The models were developed and implemented in Autodesk Maya and exported to Unity. Our findings demonstrate that MR-based solutions can be an excellent alternative to traditional classes, notably in medicine, anatomy, organic chemistry, and biochemistry (especially 3D molecular structures), in both remote and traditional in-person teaching modalities. MR therefore has the potential to become an integral part of medical education in both remote learning and in-person study.

The priority of modern dentistry is to keep patients’ teeth for as long as possible. Tooth extraction is a procedure performed as a last resort when conservative methods and endodontic surgery procedures have not brought the expected results. As a consequence, the number of patients in dental offices, who require first and repeated endodontic treatment, is increasing. Thus, the development of new technologies in the medical industry, including microscopy, computer tomography (CT), as well as diode and neodymium-YAG-erbium lasers, enables dentists to increase the percentage of successful treatments. Moreover, mixed reality (MR) is a very new technology, in which the 3D view can help plan or simulate various types of tasks before they will be carried out in real life. In dentistry, 3D holography can be applied to display CT data to plan endodontic treatment. The most important element in effective root canal treatment is the precise imaging of the root canal. The CT scans allow dentists to view the anatomy of the patient’s tooth with much higher precision and understanding than using 2D radiography (RTG-radiographic photo) pictures. Recently, the development of new 3D technologies allows dentists to obtain even more data from existing CT scans. In this paper, the CT scan data were applied to generate patient teeth in 3D and simulate the view of the root canal’s anatomy in MR devices, i.e., Microsoft HoloLens 2. Using DICOM RAW data from the CT exam, we generated a 3D model of the jaw with a tooth. In the next step, the crown of the tooth was removed in a similar way to how a dentist would do this using a dental handpiece. Furthermore, all root canals were cleaned of everything inside. This way we achieved empty tunnels, namely root canals. Finally, we added appropriate lighting, similar to the type of lighting that dentists use. The proposed approach enables to display of the root canals in the same way as during the endodontic procedure using a microscope. It allows for the visualization of the root canal and changing its direction, in which dimensional accuracy is crucial. It turns out that mixed reality can be considered a complementary method to the traditional approach, which reduces the amount of time for the root canal treatment procedure by up to 72.25%, depending on the complexity of the case, and increases its effectiveness. Thus, the mixed reality-based system can be considered an effective tool for planning dental treatment.

Information and communication technologies combined with extended reality improve diagnostics, medical treatment, and surgical operations courses. Thus, the new generation of devices, which enable displaying of holographic objects, allows visualizing a patients internal organs, both anatomical and pathological structures, as interactive 3D objects, based on retrospective 2D images, namely computer tomography (CT) or magnetic resonance imaging (MRI). Remote users can observe ongoing surgery with additional features like standing in front of the operation table, walking around in, and changing the users perspective without disrupting the operating doctors. Moreover, the operation can be recorded, then played with additional functionalitiesremote pointing and painting, which is important in medical education. The operating surgeon may also ask remotely more experienced operators for consultation, and as a consequence, the number of complications and failed procedures can decrease. It can be also applied to robot surgeries as a first step to remote surgery.