CIS Seminar

CATS: A Color And Thermal Stereo Benchmark

Speaker: Wayne Treible



Abstract: Stereo matching is a well researched area using visibleband color cameras. Thermal images are typically lower resolution, have less texture, and are noisier compared to their visible-band counterparts and are more challenging for stereo matching algorithms. Previous benchmarks for stereo matching either focus entirely on visible-band cameras or contain only a single thermal camera. We present the Color And Thermal Stereo (CATS) benchmark, a dataset consisting of stereo thermal, stereo color, and cross-modality image pairs with high accuracy ground truth (< 2mm) generated from a LiDAR. We scanned 100 cluttered indoor and 80 outdoor scenes featuring challenging environments and conditions. CATS contains approximately 1400 images of pedestrians, vehicles, electronics, and other thermally interesting objects in different environmental conditions, including nighttime, daytime, and foggy scenes. Ground truth was projected to each of the four cameras to generate color-color, thermal-thermal, and cross-modality disparity maps. A semi-automatic LiDAR to camera alignment procedure was developed that does not require a calibration target. We compare state-of-the-art algorithms to baseline the dataset and show that in the thermal and cross modalities there is still much room for improvement. We expect our dataset to provide researchers with a more diverse set of imaged locations, objects, and modalities than previous benchmarks for stereo matching.

Wednesday, September 13, 2017 at 1:25pm to 2:15pm

Smith Hall, Room 102A
Smith Hall, University of Delaware, Newark, DE 19716, USA

Event Type

Academics, College of Engineering, Students, Lectures & Programs, Community, Lectures and Programs



Computer & Information Sciences


ENGR - Computer & Information Sciences

Contact Email

Contact Name

Chandra Kambhamettu


Recent Activity