The RoDEM Benchmark:
Evaluating the Robustness of Monocular Depth Estimation Methods in MIS

DIA2M, DRCI, CHU Clermont-Ferrand, France
Institut Pascal, UMR6602 CNRS/UCA, Clermont-Ferrand, France
SurgAR, Surgical Augmented Reality, Clermont-Ferrand, France
IPCAI 2025, IJCARS 2025

*Indicates Equal Contribution

We present RoDEM (Robust Depth Estimation in MIS), a comprehensive benchmark for evaluating the accuracy and robustness of monocular single-shot depth estimation (MoSDE) methods in MIS. RoDEM introduces nine representative perturbations—seven image perturbations (smoke, bleeding, lighting variations, defocus, motion blur, and lens dirtiness) and two surgical gestures perturbations (organ deformation and incision)—and provides an ex-vivo dataset of 29,803 laparoscopic RGB-D images of sheep organs (liver, kidney, heart-lung). Using carefully defined metrics, RoDEM benchmarks nine state-of-the-art MoSDE methods under realistic surgical conditions.

Samples from the RoDEM dataset

Blood
Blood
Defocus
Defocus
Deformation
Deformation
Dirty Lens
Dirty Lens
Incision
Incision
Light Change
Light
Motion Blur
Motion Blur
Smoke
Smoke

Data acquisition setup

Teaser figure for RoDEM

Left, the proposed RoDEM dataset acquisition setup. Right, schematic of the depth sensor, laparoscope, their fields of view, coordinate systems, and the rigid transformation between them. The calibration has demonstrated an average residual of 1.21 pixels across 313 calibration images of size 640×480.

Usage policy

If you use the RoDEM dataset in your research, please make sure to cite our associated publication. For any commercial or industrial applications, we kindly ask you to contact us in advance to discuss licensing and usage terms.

Poster

BibTeX


  @article{sharifian2025rodem,
  title={The RoDEM benchmark: evaluating the robustness of monocular single-shot depth estimation methods in minimally-invasive surgery},
  author={Sharifian, Rasoul and Rabbani, Navid and Bartoli, Adrien},
  journal={International Journal of Computer Assisted Radiology and Surgery, special issue: selected papers from IPCAI 2025},
  volume={20},
  number={6},
  pages={1215--1229},
  year={2025},
  publisher={Springer}
}