BRN (ASX) QUALCOMM is worth watching

Originally posted by TulipTrader: ↑

@DingoBorat

https://www.qualcomm.com/news/onq/2021/10/28/enabling-device-learning-scale

Enabling on-device learning at scaleOur latest AI research to personalise and adapt models while keeping data private.
OCT 28, 2021

One size doesn’t fit all. The need for intelligent, personalized experiences powered by AI is ever-growing. Our devices are producing more and more data that could help improve our AI-powered experiences. How can we learn and efficiently process all this data from edge devices? On-device learning rather than cloud training can address these challenges. In this blog post, I’ll describe how our latest research is making on-device learning feasible at scale.
What is on-device learning?
In the past, AI was primarily associated with the cloud. We have moved from a cloud-centric AI where all the training and inference occurs in the cloud, to today where we have partially distributed AI with inference happening on both the device and cloud. In the future, we expect not only inference but also the training or adaptation of models to happen on the device. We call this fully-distributed AI, where devices will see continuous enhancements from on-device learning, complementing cloud training. Processing data closest to the source helps AI to scale and provides important benefits such as privacy, low latency, reliability, and efficient use of network bandwidth.
On-device intelligence provides important benefits.
On-device learning is challenging
The benefits of on-device learning are clear. So why aren’t we doing it? The reality is that that there is a number of challenges to overcome to make on-device learning feasible at scale. For example:
Model training and fine tuning can be power, compute, and storage hungry. This is why learning has traditionally occurred in the cloud on datacenters with much more available resources than edge devices.
Local data can be limited, unlabeled, biased, and imbalanced, which makes it hard to learn an improved model.
Overfitting or catastrophic forgetting results in models that are not robust to a variety of situations.
Our research is solving on-device learning challenges
To overcome some of the feasibility and deployment issues
for on-device learning,Qualcomm AI Researchis actively investigating several topics and seeing very encouraging results.
Our AI research areas address the key deployment challenges of on-device learning.
Few-shot learningexplores how to adapt the AI model to a few labeled data samples. Learning from limited labeled data is crucial since there may not be as many opportunities for user-assisted labeling. Consider keyword spotting, where the task is to identify when a keyword is spoken, such as “Hey Snapdragon,” using always-on machine learning. A typical keyword-spotting model may not be sensitive to users’ accents and have poor performance for outliers. By using our methods to locally adapt the model to a few examples of the user saying, “Hey Snapdragon,” we’ve seen personalization improvements across the board but particularly for outliers, with up to 30% outlier detection rate gain.
Continuous learningis learning that continues after enrollment with the benefit that the AI model improves and adjusts over time. Continuous learning is also often unsupervised learning, which means the data is unlabeled since it is not practical for users to do enrollments or label data repeatedly. On the positive side, there are often plentiful samples of unlabeled data. To address the training challenge of unlabeled data, our research method assigns pseudo labels to the training data through the verification process. To address the challenge of overfitting and forgetting a useful capability of the model when the number of collected data is small, we exploit regularization loss that maintains some metrics from a pre-trained model.
Federated learningprovides the best of both worlds from on-device training and cloud training. It maintains the privacy benefit and scale of on-device learning by keeping the data local, while also getting the benefit of learning from diverse data across many users by having the cloud aggregate many different locally-trained models. Raw data is never sent to the cloud, and model updates can be shared in ways that still preserve privacy.
Federated learning aggregates model updates from devices capable of on-device learming.

Of course, the device must be capable of on-device learning for federated learning to work, and there are also many other system challenges for producing a good, federated model. Our research is largely focused on solving these challenges. Consider user verification, where a person is authenticated through biometrics. Deep learning is a powerful tool for user verification but typically requires large amounts of very personal data across a diverse set of users. Federated learning enables the training of such models while keeping all this personal data private. In fact, our user verification models trained with our federated learning methods are able to achieve competitive performance compared to state-of-the-art techniques, which do not preserve privacy. And our research is not all theory. We have developed a federated learning framework for research and application development on mobile, and we will be demonstrating this user verification use case at upcoming conferences. We want to make federated learning available at scale and address deployment challenges.
Low-complexity on-device learningis key to making all three of the learning techniques I described above possible. Backpropagation, which is the technique used during training of AI models, is computationally demanding and challenging to do on most power and thermal-constrained devices.
Overcoming challenges to efficiently adapt a neural net on a device.
We’re investigating several approaches to efficiently adapt the AI model on a device, such as quantized training, efficient models for backpropagation, and adaptation based on inference results.

TT

Expand

Hi @Yak52 and @DingoBorat

I am reading the above posted by TT as aspirational meaning this is what they know is needed and they are trying to achieve it so all our long term loyal customers stick with us we are big and reliable don’t go off to these new kids on the block you know us we send you Christmas cards and remember your children’s names etc; etc.

I do not see this as confirmation that they are using AKIDA simply confirmation that they know they need to achieve what AKIDA technology already does.

It gives me confidence that Brainchip’s patents will most likely ensure that they will be forced to determine the most sensible course of action is to come knocking.

My opinion only DYOR
FF

AKIDA BALLISTA

(20min delay)
Last 19.0¢		Change 0.010(5.56%)		Mkt cap ! $372.2M

Open	High	Low	Value	Volume
18.5¢	19.0¢	18.0¢	$935.0K	5.019M

No.	Vol.	Price($)
5	148000	0.185
19	689363	0.180
25	935182	0.175
60	2004344	0.170
51	1195778	0.165

Price($)	Vol.	No.
0.190	412404	9
0.195	1115133	19
0.200	925394	41
0.205	782425	11
0.210	847412	16

QUALCOMM is worth watching, page-54

What is on-device learning?

On-device learning is challenging

Our research is solving on-device learning challenges

EIS co-funded campaign sees Miramar kick off maiden drilling at Bangemall, Gascoyne WA

Week 33 Wrap: US recession fears forgotten; RBNZ’s surprise rate cut; more iron ore trouble

Emerald & Azure score Digger & Dealer awards

Victory Metals dips -8% even as company set to grow heavy REE resource at North Stanmore

Bitcoin: Current State of Play & Where to Next | Swyftx

IMDEX to receive $10M in out-of-court settlement with Boart Longyear over downhole tool patent

Court of Appeal upholds environmental group's challenge to Silver Mines Ltd's Bowden project

EQ Resources transitions historic Mt Carbine tungsten mine to owner-operator system

Argent begins search for VMS mineralisation at Kempfield Cu-Pb-Zn-Au-Ag play in NSW

Wellnex sees first special access scheme prescriptions for new Wellness Life brand

Featured News

Buyers (Bids)

Sellers (Offers)

Featured News

QUALCOMM is worth watching, page-54

Top Stories

EIS co-funded campaign sees Miramar kick off maiden drilling at Bangemall, Gascoyne WA

Week 33 Wrap: US recession fears forgotten; RBNZ’s surprise rate cut; more iron ore trouble

Emerald & Azure score Digger & Dealer awards

Victory Metals dips -8% even as company set to grow heavy REE resource at North Stanmore

Bitcoin: Current State of Play & Where to Next | Swyftx

IMDEX to receive $10M in out-of-court settlement with Boart Longyear over downhole tool patent

Court of Appeal upholds environmental group's challenge to Silver Mines Ltd's Bowden project

EQ Resources transitions historic Mt Carbine tungsten mine to owner-operator system

Argent begins search for VMS mineralisation at Kempfield Cu-Pb-Zn-Au-Ag play in NSW

Wellnex sees first special access scheme prescriptions for new Wellness Life brand

Featured News

Buyers (Bids)

Sellers (Offers)

Featured News