Australia's largest stock trading and investment forum Australia's #1 stock forum

BRN

Click for more information

0.00%

21.5¢ brainchip holdings ltd

3 months ago the question was , can we scale up ?Today we learnt...

First 7 Last

Share
Profile

Follow
Doz

4,507 Posts.

4301

16/05/24

18:56

Post #: 73864629
Share

Originally posted by Fact Finder: ↑

Introducing TENN: Revolutionizing Computing with an Energy Efficient Transformer Replacement

By Dr. Tony Lewis, CTO at BrainChip, Olivier Coenen, Senior Research Scientist at BrainChip andYan Ru Pei, research Scientist at BrainChip
The Rise of TENN: A Game Changer in AI
TENN, or Temporal Event-based Neural Network, is redefining the landscape of artificial intelligence by offering a highly efficient alternative to traditional transformer models. Developed by BrainChip, this technology aims to address the substantial energy and computational demands of existing AI systems. TENN specializes in sequential, or continuous data streams for edge and event-based processing, making it ideal for applications in smart home, automotive, healthcare, and industrial sectors.
By integrating the concepts of state space models, entirely developed in parallel, independently, and from a generalization of convolution kernels, TENN can handle various transformer tasks such as processing language, time-series, and spatiotemporal data. This capability not only broadens its applicability but also enhances its efficiency, offering a reduction in energy consumption by orders of magnitude compared to traditional models.
The Evolution of Kernel Representation

Figure 1. A) Receptive field of a simple cell in V1 (DeAngelis, et al, 1995), B) A **or Model of the receptive field of simple cell. C) Learned receptive fields of a CNN (Brachmann & Redies,2016)
The path from biological neurons to artificial neural networks has witnessed several innovations, with each step bringing us closer to more efficient and capable AI systems. Initially, fixed, non-learnable kernels like the **or filter above mimicked the visual processing of the human brain Figure 1A, focusing on specific features within visual stimuli Figure 1B. These early models laid the groundwork for more complex representations.
With the advent of deep learning, learnable kernels became prevalent, allowing AI models to adapt their filters based on the data they processed (Figure 1C). However, this flexibility comes with increased computational demands and a surge in the number of parameters. TENN addresses these challenges by revisiting the foundation of kernel representation. It uses a structured approach to reduce parameter explosion and discretization issues, thereby maintaining computational efficiency while retaining flexibility.
Leveraging Polynomials for Advanced Data Representation
TENN utilizes a novel approach by employing orthogonal polynomials, such as Chebyshev and Legendre polynomials, to represent the convolution kernel. This mathematical technique allows TENN to achieve exponential convergence rates in approximating most kernels, even those characterized by discontinuities or complex behaviors. The choice of polynomials ensures that the network can dial in the desired accuracy while maintaining efficiency, even in challenging conditions. It also permits changing discretization, binning, input resolution and frame rate without the need to retrain.
The integration of these polynomials into TENN’s architecture allows to transform the network kernel convolutional computations from a buffer mode to a recurrent mode without loss of accuracy or retraining. The buffer mode facilitates efficient training on parallel hardware whereas the recurrent mode permits smaller memory footprint for data processing at the edge. This duality in processing modes ensures stable training and fast execution, which are crucial for real-time AI applications.
TENN’s Dual Modes: Enhancing Flexibility and Efficiency
One of the standout features of TENN is its dual-mode operation, which includes kernel convolutional computations in buffer and recurrent modes. This flexibility allows TENN to adapt to different computational tasks efficiently. In buffer mode, TENN behaves like traditional convolutional neural networks, processing data through various layers of kernel convolutions. In recurrent mode, it leverages the recurrence relationships of classical orthogonal polynomials to process data sequences more naturally and efficiently with much smaller memory requirements.
This dual capability not only makes TENN versatile but also enhances its performance across a wide range of applications. From real-time language translation to complex data analysis in autonomous vehicles, TENN’s dual modes enable it to deliver high performance during training while minimizing energy usage for inference at the edge.
Implementation and Future Directions
The implementation of TENN within BrainChip’s hardware in the Akida 2.0, showcases a significant step forward in hardware-accelerated AI. Akida 2.0’s architecture is designed to fully exploit TENN’s capabilities, featuring a mesh network of nodes each equipped with an event-based TENN processing unit. This design ensures scalability and enhances computational efficiency, making it suitable for deployment in environments where power and space are limited.
Looking ahead, BrainChip plans to continue refining TENN’s capabilities, focusing on enhancing activation sparsity and exploiting more of the polynomial space. These advancements are expected to further improve the efficiency and applicability of TENN in more complex AI tasks.
Broad Applications and Impressive Performance
TENN’s application range is impressive, extending from audio processing tasks like noise reduction and speech recognition to more demanding applications such as biomedical signal processing and industrial monitoring. Its ability to efficiently process large volumes of data in real-time makes it a potent tool for developing advanced AI applications in various sectors.
Figure 2. Comparison of TENNs on an NLP task sentence generation. The score we use is related to perplexity but transformed to so that the higher the score the better.
Performance metrics indicate that TENN not only holds its own against larger models like GPT-2 but often exceeds them in efficiency and speed, particularly in tasks that benefit from its event-based processing capabilities. TENN produced text at the rate of 2500 words/min vs 10 words/min on the same laptop CPU, single threaded performance.
Figure 3. Audio denoised on standard benchmark. TENN processes audio directly, saving a power consuming data conversion step.
On speech enhancement through denoising, TENN was compared to the state of the art (SoTA) networks. While providing almost the same performance with this particular implementation, the number of parameters and number of operations (MACs) with TENN are nearly 3 times and 12 times less.
TENN is a spatiotemporal network that performs as well with visual inputs in either image sequence format or event-based visual data. Below is an example of gesture recognition on the DVS Hand Gesture Recognition dataset (IBM DVS128).

These results highlight TENN’s potential to reshape the future of AI, making it more accessible and sustainable.
Conclusion: A New Era of Efficient AI
BrainChip’sdevelopment of TENN marks a significant milestone in the evolution of artificial intelligence. By addressing key challenges related to power consumption and computational efficiency, TENN is poised to lead a new era of AI technology. As it continues to evolve, its impact is expected to grow, opening new possibilities for smart technology across global industries.

Expand

3 months ago the question was , can we scale up ?

Today we learnt the answer to the big question :

Strap in .

All in my opinion ……..

BRN Price at posting: 26.0¢ Sentiment: None Disclosure: Held
19 Upvote

1 Great analysis

Reply

Top Stories

TM1

Shares up 196% on Terra's news of major reef discovery at Dante

GYG

Guzman Y Gomez shot up nearly 40% in first hour of trades. Can it last?

BRX

Belararox delineates another porphyry in Argentina at Tambo South

ASX Market Update: Shares fall flat as GYG soars on debut | 20 June, 2024

Your questions From the Floor: Investment experts respond...

There are more pages in this discussion • 2 more messages in this thread...

First 7 Last

Add BRN (ASX) to my watchlist

(20min delay)
Last 21.5¢		Change 0.000(0.00%)		Mkt cap ! $399.0M

Open	High	Low	Value	Volume
21.5¢	21.5¢	21.0¢	$631.4K	2.960M

Buyers (Bids)

No.	Vol.	Price($)
32	976602	21.0¢

Sellers (Offers)

Price($)	Vol.	No.
21.5¢	649767	10

View Market Depth

No.	Vol.	Price($)
31	926602	0.210
34	1176937	0.205
86	1930279	0.200
19	590106	0.195
29	355664	0.190

Price($)	Vol.	No.
0.215	649767	10
0.220	626110	18
0.225	1081962	18
0.230	564810	24
0.235	435226	11

Last trade - 16.10pm 20/06/2024 (20 minute delay)

BRN (ASX) Chart

SPONSORED BY