3DGS-CD dataset, F1 / mean IoU (their metrics.py, released masks_gt = move-in only) ### held-out | method | Mustard | Bench | Desk | Sill | Swap | mean | |---|---|---|---|---|---|---| | 3dgscd_edit (move-in) | 0.641 / 0.472 | 0.769 / 0.624 | 0.813 / 0.685 | 0.979 / 0.958 | 0.967 / 0.936 | 0.834 / 0.735 | | ours_obj (move-in) | 0.955 / 0.913 | 0.532 / 0.362 | 0.943 / 0.892 | 0.589 / 0.418 | 0.948 / 0.901 | 0.793 / 0.697 | | 3dgscd_edit (union) | 0.527 / 0.358 | 0.558 / 0.387 | 0.525 / 0.356 | 0.979 / 0.958 | 0.808 / 0.678 | 0.679 / 0.547 | | ours_obj (union) | 0.805 / 0.674 | 0.307 / 0.182 | 0.603 / 0.432 | 0.589 / 0.418 | 0.797 / 0.663 | 0.621 / 0.474 | ### all photos | method | Mustard | Bench | Desk | Sill | Swap | mean | |---|---|---|---|---|---|---| | 3dgscd_cd (move-in) | 0.666 / 0.499 | 0.920 / 0.851 | 0.869 / 0.769 | 0.336 / 0.202 | 0.901 / 0.820 | 0.738 / 0.628 | | ours_2d (move-in) | 0.992 / 0.984 | 0.985 / 0.970 | 0.982 / 0.964 | 0.990 / 0.980 | 0.992 / 0.984 | 0.988 / 0.976 | | 3dgscd_cd (union) | 0.549 / 0.378 | 0.640 / 0.470 | 0.554 / 0.383 | 0.336 / 0.202 | 0.786 / 0.648 | 0.573 / 0.416 | | mv3dcd (union) | 0.713 / 0.554 | 0.447 / 0.288 | 0.505 / 0.338 | 0.763 / 0.617 | 0.741 / 0.589 | 0.634 / 0.477 | | oscd_offline (union) | 0.720 / 0.563 | 0.571 / 0.400 | 0.523 / 0.354 | fail | 0.760 / 0.613 | 0.644 / 0.482 (n=4) | | oscd_online (union) | 0.534 / 0.364 | 0.510 / 0.342 | 0.389 / 0.242 | fail | 0.639 / 0.470 | 0.518 / 0.354 (n=4) | | oscd_pp_offline (union) | 0.731 / 0.576 | 0.536 / 0.366 | 0.491 / 0.325 | 0.786 / 0.647 | 0.732 / 0.578 | 0.655 / 0.499 | | oscd_pp_online (union) | 0.530 / 0.360 | 0.494 / 0.328 | 0.360 / 0.219 | 0.800 / 0.667 | 0.621 / 0.450 | 0.561 / 0.405 | | oscdpp_ourposes_online (union) | 0.680 / 0.515 | 0.529 / 0.359 | 0.515 / 0.347 | 0.665 / 0.498 | 0.723 / 0.566 | 0.622 / 0.457 | | oscdpp_ourposes_retro (union) | 0.678 / 0.512 | 0.530 / 0.361 | 0.501 / 0.334 | 0.678 / 0.513 | 0.732 / 0.578 | 0.624 / 0.459 | | ours_2d (union) | 0.838 / 0.721 | 0.671 / 0.505 | 0.625 / 0.454 | 0.990 / 0.980 | 0.809 / 0.680 | 0.787 / 0.668 | | ours_obj (union) | 0.820 / 0.695 | 0.559 / 0.388 | 0.587 / 0.416 | 0.990 / 0.980 | 0.791 / 0.654 | 0.749 / 0.627 | fail: O-SCD's own PnP pose init fails on Sill's first POST frame ("Too few inliers for pose initialization", output/3DGS-CD/logs/Sill_allpost.log); O-SCD++ (COLMAP poses) runs there.