Array Camera Image Fusion using Physics-Aware Transformers

TitleArray Camera Image Fusion using Physics-Aware Transformers
Publication TypeJournal Article
Year of Publication2022
AuthorsQ Huang, M Hu, and DJ Brady
JournalJournal of Imaging Science and Technology
Volume66
Issue6
Date Published11/2022
Abstract

We demonstrate a physics-aware transformer for feature-based data fusion from cameras with diverse resolution, color spaces, focal planes, focal lengths, and exposure. We also demonstrate a scalable solution for synthetic training data generation for the transformer using open-source computer graphics software. We demonstrate image synthesis on arrays with diverse spectral responses, instantaneous field of view and frame rate.

DOI10.2352/J.ImagingSci.Technol.2022.66.6.060401
Short TitleJournal of Imaging Science and Technology