These researchers who are independent of Brainchip Inc appear to have a very different opinion to MF where Blackwall style computing and spiking neural network computing is concerned. Indeed they see a future where SNNs that have mastered Sequential learning will replace the GPU for deployed GPT4.
Matei Ioan Stan (The University of Manchester), Oliver Rhodes (The University of Manchester) "This paves the way for deploying SSM-based SNNs to neuromorphic hardware, which could drastically reduce the energy requirements of sequential models. Taking into consideration the efficient scaling of computations with respect to sequence length, SSM-based SNNs could have the potential to replace current solutions such as GPU-deployed GPT4 [OpenAI, 2023]"
As some here clearly missed it this is what Brainchip unleashed last year when announcing AKIDA 2.0: In March this year, we announced a new neural network architecture we call Temporal Event-based Neural Networks (TENNs). These are lightweight neural networks that excel at processing temporal data much more efficiently than traditional Recurrent Neural Networks (RNN) like Long Short-Term Memory (LSRM), or Gated Recurrent Units (GRU). These models often require substantially fewer parameters and orders of magnitude fewer operations to achieve equivalent or better accuracy compared to traditional models. The second generation Akida neural processor platform has also added extremely efficient 3-dimensional (3D) convolution functions that can therefore perform compute-heavy tasks on devices with limited memory and battery resources.
This feat is accomplished by combining the convolution in the 2D spatial domain with that of the 1D time domain, resulting in fewer parameters and fewer multiply-accumulate (MACs) operations per inference than previous networks. This reduced need for computation leads to a substantial reduction in the energy or power draw, making TENNs ideal for ultra-low-power Edge devices.
We have published our research about the advantages of TENNs when they are applied to spatiotemporal data like video from traditional frame-based cameras and events from dynamic vision sensors. TENNs can enable higher quality video object detection in tens of milliwatts.
TENNs are equally suitable for processing purely temporal data, like raw audio from microphones and vital signs from health monitors. In these situations, TENNs can minimize the need for expensive DSP or filtering hardware thereby reducing silicon footprint, energy draw as well as Bill of Materials (BOM) cost. This clears the path for much more compact form factor devices such as more advanced hearables, wearables or even new, embeddable medical devices that can be sustained through energy-harvesting.
Since TENNs can operate on data from different sensors, they radically improve analytical decision-making and intelligence for multi-sensor environments in real-time.
The Akida platform still includes Edge learning capabilities for classifier networks. This complements TENNs to enable a new generation of smart, secure Edge devices that far exceeds what has been possible so far in power envelopes that are measured in milliwatts or microwatts.”VIDEO
(20min delay)