Data-In-situ Computing with One-Pixel-Multiple-Memristor Architecture for Neuromorphic Sequential Vision

Abstract

Abstract Neuromorphic vision systems based on memristors offer an energy-efficient approach to artificial vision, yet traditional pixel(s)-to-one-memristor architectures remain inefficient in dynamic image processing due to limited temporary storage. Here, inspired by human visual working memory, we propose a one-pixel-multiple-memristor (1PnR) architecture with a rolling exposure strategy for fast sequential image acquisition. Furthermore, a data-in-situ computing network for efficient image processing is developed. With network weights mapped to voltage vectors and applied to the image storage memristor array, direct computation is enabled where the image is stored, and the energy-intensive data transmission is eliminated. A hardware prototype of the 1PnR architecture achieved 95.7% recognition accuracy on the Weizmann human action flow dataset. Compared to CMOS-based systems, this architecture is estimated to have a 2000× reduction in latency for image sensing and storage, and a 160× reduction in energy consumption image processing, demonstrating significant potential for future neuromorphic visual systems.