[IMG] Rudy Pei 2nd Physicist | ML researcher | quantum &...

Rudy Pei 2nd
Physicist | ML researcher | quantum & neuromorphic computing | behavioral economics | composer

14h  Edited
Follow
Did you know you can build neural networks with FIFO buffers? Check out our latest work from Brainchip (accepted to CVPR 2024 AIS workshop) discussing how a spatio-temporal neural network, built from a stack of FIFO buffers, can be used to perform incredibly efficient eye tracking (one of the many tasks it can do). https://lnkd.in/gXyKynsc Combining ideas from signal processing with deep learning, it becomes clear that FIR filters = temporal convolutions (in fact it's quite literally the definition of FIR). Then a temporal CNN is nothing but a stack of FIR filters / FIFOs. This realization allowed us to build efficient networks for online inference, with small memory footprint. (figure credits to fellow coauthor Sasskia Brüers)

•