Ivantsits, MatthiasHuellebrand, MarkusWalczak, LarsWelz, JuriGreve, DustinWamala, IsaacSuendermann, SimonKempfert, JörgFalk, VolkmarHennemuth, AnjaGarrison, LauraJönsson, Daniel2024-09-172024-09-172024978-3-03868-244-82070-5786https://doi.org/10.2312/vcbm.20241185https://diglib.eg.org/handle/10.2312/vcbm20241185Minimally invasive surgery is the state-of-the-art approach for repairing the mitral valve, which controls the blood flow into the left heart chamber. The surgeons rely on camera and sensor technologies to support visualization, navigation, and measurement. As patients are connected to the cardio-pulmonary bypass, the anatomy is severely deformed by the altered pressure conditions. We developed a technique that combines stereo-endoscopic video with three-dimensional transesophageal echocardiography (3D TEE) to improve anatomic visualization and measurement accuracy during mitral valve repairs. Our methodology includes stereo camera calibration, image segmentation, and 3D model reconstruction. Anatomical landmarks are used to align the imaging modalities. This approach allows the visualization of pre-operatively determined mitral valve properties, e.g., overlaying heat maps in stereo endoscopic data. Our validation results showed high precision and accuracy within an error range of 0.5 ± 0.1 mm. The effectiveness of the heatmap visualization in complex prolapse cases varied. Integrating stereoscopic and 3D TEE promises greater precision in mitral valve repairs. In the future, this approach can also be used to visualize local tissue properties or the optimal locations of implants.Attribution 4.0 International LicenseCCS Concepts: Computing methodologies → Image segmentation; Matching; Reconstruction; Interest point and salient region detections; Shape inferenceComputing methodologies → Image segmentationMatchingReconstructionInterest point and salient region detectionsShape inference10.2312/vcbm.202411855 pages