Non-line of Sight imaging by SPAD​

Introduction

Silicon single photon avalanche detector (Si SPAD) has become a hot topic today for its single photon sensitivity, pico-second timing resolution and CMOS compatibility and low cost. Because of its unique properties, it becomes a tool to capture transient imaging for computer vision industry.

One of applications enabled by transient imaging is non-line of sight problem, usually being referred to "look around the corner", where using Si SPAD, we could locate, track and recognize the shape of objects around the corner without directly seeing it.

By utilizing the SPAD’s character we can calculate the time/distance between the object and light source. And by using that information we can ‘tell’ where the object is.

There have been multiple papers published on this topic. The one we have studied is “Detection and tracking of moving objects hidden from view”. It was published last year on nature photonics. The scenario they provided is as follow. First they have the SPAD and laser light source hang at the wall. Then the laser and SPAD would first hit the ground. And these two regions at the ground are our starting point and the end point.

This remains a hot area for recently years. The one we focus on is "“Detection and tracking of moving objects hidden from view".

Background

1) SPAD / APD difference 2) SPAD work principle 3) SPAD image model

Methods

1) paper scene experiment 2) volumetric reconstruction

Results

1) Ray optic distribution 2) distance relationship 3) ray optics distribution verification 4) volumetric reconstruction verification

Results 4.1

File:Abcd.png

Example of two iterations of the meanshift algorithm