Recent research published in the Journal of Marine Science and Engineering explores the promising integration of mixed reality (MR) technologies into maritime navigation, specifically focusing on remote pilotage. Led by Arbresh Ujkani from the Fraunhofer Center for Maritime Logistics and Services in Hamburg, this study assesses the usability and situational awareness provided by augmented reality (AR) and virtual reality (VR) systems for maritime pilots and vessel captains.
The core function of maritime pilots is to navigate ships through challenging waters, leveraging their expertise in local conditions. However, the traditional practice of having pilots physically onboard can pose risks during transfer operations. The research highlights remote pilotage as a potential solution to enhance safety by allowing pilots to operate from shore. Ujkani notes, “By removing the need for a pilot to be physically present onboard a vessel, remote pilotage can reduce the risks associated with accidents and injuries during pilot transfer operations.”
The study tested a prototype system that uses AR glasses, specifically the Hololens 2, to display critical navigation data directly in the captain’s field of view. Meanwhile, shore-based pilots received live video feeds and essential information through desktop and VR applications. This innovative approach aims to improve situational awareness (SA) and communication between the ship’s crew and the pilot.
The in situ tests conducted during a ferry voyage in the Baltic Sea revealed promising results. Both the desktop and immersive MR technologies achieved comparable usability ratings, indicating that they are suitable for remote pilotage operations. Ujkani emphasizes the importance of these findings, stating, “This hands-on testing not only provides more realistic insights but also bridges the gap between theoretical concepts and practical implementation.”
The commercial implications of these advancements are significant. Shipping companies and maritime service providers could benefit from reduced operational risks and enhanced navigation efficiency. As the industry grapples with challenges such as crew shortages and the need for more flexible operations, remote pilotage technologies offer a viable solution. Furthermore, the integration of AR and VR can lead to cost savings through improved training programs for pilots and crew, as immersive simulations can replicate real-world scenarios without the associated risks.
However, the research also identified technical constraints that need addressing before widespread implementation. For instance, the study highlighted the necessity for high-resolution cameras and improved zoom functionalities to ensure clear visibility during operations. Additionally, reducing eye fatigue for users of AR and VR systems is crucial for prolonged use. Ujkani pointed out that “the stability and reliability of AR overlays must be ensured,” indicating that the technology must withstand the maritime environment’s challenges.
As the maritime sector continues to adopt new technologies, the findings from this research pave the way for further exploration and development of remote pilotage systems. Future studies will focus on extended testing durations and the potential for combining desktop and immersive technologies within a single operational framework. This evolution could ultimately lead to safer, more efficient maritime navigation, benefiting both the industry and the professionals who navigate it.
