Real-time Normal Gaussian Splats

Introduction

Gaussian version for NFL with instance. For real-time updates, gaussian is a better option. Track spatial change in real-time. We first extract SAM2 temporal masks and use a render-and-compare pipeline

Gaussian splatting of NFL

RGB input

Normal field

Depth

Dynamic scene

Scene where objects move

SAM2 masks

Tracking results

Object 1

Object 2

Object 3

Object 4