Berends, David C. and van der Wall, Gooitzen S. (2010) “Implementing real-time imaging systems using the Sarnoff Acadia II vision processor”, Proc. SPIE 7710, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2010, 77100T (April 28, 2010).
Vision system designers often face the daunting challenge of implementing powerful image processing capabilities in severely size, weight and power constrained systems. Multi-sensor fusion, image stabilization, image enhancement, target detection and object tracking are fundamental processing techniques required by UAVs (Unmanned Aerial Vehicles), smart cameras, weapon sights, and vehicle situational awareness systems. All of these systems also process non-vision data while communicating large amounts of information elsewhere. To meet their demanding requirements, Sarnoff developed the Acadia® II System-on-a-Chip, combining dedicated image processing cores, four ARM®11 processors and an abundance of peripherals in a single Integrated Circuit. This paper will describe how to best use the power of the Acadia® II as both an all-in-one image processor and as a general purpose computer for performing other critical non-vision tasks, such as flight control and system-to-system communication.