ESL: Event-based Structured Light



Description

Event cameras are bio-inspired sensors providing significant advantages over standard cameras such as low latency, high temporal resolution, and high dynamic range. We propose a novel structured-light system using an event camera to tackle the problem of accurate and high-speed depth sensing. Our setup consists of an event camera and a laser-point projector that uniformly illuminates the scene in a raster scanning pattern during 16 ms. Previous methods match events independently of each other, and so they deliver noisy depth estimates at high scanning speeds in the presence of signal latency and jitter. In contrast, we optimize an energy function designed to exploit event correlations, called spatio-temporal consistency. The resulting method is robust to event jitter and therefore performs better at higher scanning speeds. Experiments demonstrate that our method can deal with high-speed motion and outperform state-of-the-art 3D reconstruction methods based on event cameras, reducing the RMSE by 83% on average, for the same acquisition time.


Depth Estimation with ESL- Dataset

The code and dataset used our paper ESL: Event-based Structured Light is below.

We thank Dr. Dario Brescianini and Kira Erb for their valuable help in this work.


Citing

Please cite the following paper if you use this dataset for your research:

ESL: Event-based Structured Light

M.Muglikar, G. Gallego D. Scaramuzza

ESL: Event-based Structured Light

IEEE International Conference on 3D Vision (3DV), 2021.

PDF Video Code Project Page Poster



Static Sequences

Sequence Preview
Download link
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias

Dynamic Sequences

Sequence Preview
Download link
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias
events.zip
data.raw
data.bias

Coin

events.zip
data.raw
data.bias

Tape spin

events.zip
data.raw
data.bias

Origami fan

events.zip
data.raw
data.bias