WBT

2.98%

$1.90 weebit nano ltd

Think of each neuron as a balloon.To perform a computation,...

First 4 Last

Share
Profile

Follow
bobfossil

226 Posts.

48

26/07/19

06:10

Post #: 39700222
Share

Originally posted by Interloping: ↑

I've had a look around for a good description to explain the science/technology of spiking neural networks. But, turns out most people who understand it are no good at explaining it. The best video on it I've seen is Vsauce's video "The Stilwell Brain" - but it is only available to youtube premium subscribers. That video simulates a spiking neural network using humans; it's pretty cool. They basically use people to reproduce a simple version of the below:

What you're seeing here is an input of pixels arranged in the shape of a numeric digit on a screen at the front (that's basically working like your retina). Behind that, various configurations of simulated neurons are "excited" by the information on that screen. Suppose each neuron was looking at a grid of 9 retinal "cells" (pixels). If only one of those 9 cells is white, the neuron will only be a little bit excited. But once a certain threshold is reached - perhaps 4 cells being white - it will excite the neuron enough to "spike" and fire a signal to other cells connected to it. Those cells are then similarly connected to multiple other neurons in the first layer of neurons behind the retina - and will only "spike" if enough of those first-layer neurons send them a signal. In the video you can see this as a progressive cascade of activation from the front screen to the back output. In contrast, the other types of network in this video are basically in constant activation front-to-back.

In software, simulating this process requires bits in memory to track every "level" of excitation that can apply to each neuron. If a neuron will spike when it has received three or four inputs, it needs at least two bits of memory to track its state (probably more - I don't know if these simulated networks are model adaptation effects like real neurons, but if they do a lot more information needs to be tracked than just the stimulation needed for initial spiking). As a neural network simulated in software increases in complexity, the amount of memory required will increase exponentially. The CPU also needs to interact with the information in memory to keep track of what the neurons need to do - so both memory-intensive and CPU-intensive.

Where weebit comes in is that the individual cells of weebit "bits" don't have to change state from 0 to 1 with a single input, but it can actually operate like a brain neuron where successive inputs to the cell bring it closer to the threshold that will cause the bit to flip from 0 to 1. Thus, the behaviour of the neuron can be modelled directly by the memory bits, instead of needing the CPU to keep track of it and the memory just storing the current state of each neuron.

There are lots of details that I know nothing about - like how the connections of a weebit neural network are configured (i.e. do they have to be manufactured in a specific configuration or does software in some way simulate the connections between virtual neurons), or whether the activation thresholds can be tweaked for different purposes.

Anyway, I look forward to finding out more when the demonstration is public.

Expand

Think of each neuron as a balloon.

To perform a computation, specific balloons within the network are rapidly inflated at specific time intervals.

When a balloon pops, its value is reset, ready for the next computation to begin.

(Each neuron is injected with an electrical current until it "spikes" [pops] at which point it flips from a 1 back to a 0, or vice versa)

WBT Price at posting: 42.5¢ Sentiment: None Disclosure: Held
11 Upvote

0 Great analysis

Reply

Top Stories

NTI

Neurotech knocked back by FDA as agency declares target condition not rare enough for special status

RCE

Recce eyes Indonesia for novel anti-infective as Indo-Aus ties grow stronger

COD

Coda Minerals (ASX:COD) enters rights issue to further exploration in South Australia

Week 40 Wrap: China's nonsensical stimmy hype wanes (shocking!); HotCopper's picks; oil & inflation

ACW

Actinogen Medical ramps up Alzheimer’s treatment trials, targeting fast-track global approvals

SLS

Solstice Minerals to ramp up drilling campaign at Yarri Gold Project

BCI

BCI reaches close of funding facility for salt-first part of Mardie project

BUX

Buxton projects new graphite province discovery at WA Narryer play

WCN

White Cliff jumps 24% on 'bonanza grade' copper rock chips at Rae project, Canada

CKA

Cokal upgrades infrastructure for BBM ramp-up in Indonesia

There are more pages in this discussion • 8 more messages in this thread...

First 4 Last

Add WBT (ASX) to my watchlist

(20min delay)
Last $1.90		Change 0.055(2.98%)		Mkt cap ! $358.9M

Open	High	Low	Value	Volume
$1.84	$1.96	$1.82	$1.648M	868.1K

Buyers (Bids)

No.	Vol.	Price($)
2	18554	$1.89

Sellers (Offers)

Price($)	Vol.	No.
$1.90	10988	2

View Market Depth

No.	Vol.	Price($)
2	18554	1.885
1	1604	1.870
1	20000	1.850
1	410	1.830
3	10326	1.820

Price($)	Vol.	No.
1.900	1000	1
1.910	5000	1
1.930	30965	1
1.935	59000	1
1.940	20000	1

Last trade - 16.10pm 04/10/2024 (20 minute delay)

WBT (ASX) Chart

Think of each neuron as a balloon.To perform a computation,...

Neurotech knocked back by FDA as agency declares target condition not rare enough for special status

Recce eyes Indonesia for novel anti-infective as Indo-Aus ties grow stronger

Coda Minerals (ASX:COD) enters rights issue to further exploration in South Australia

Week 40 Wrap: China's nonsensical stimmy hype wanes (shocking!); HotCopper's picks; oil & inflation

Actinogen Medical ramps up Alzheimer’s treatment trials, targeting fast-track global approvals

Solstice Minerals to ramp up drilling campaign at Yarri Gold Project

BCI reaches close of funding facility for salt-first part of Mardie project

Buxton projects new graphite province discovery at WA Narryer play

White Cliff jumps 24% on 'bonanza grade' copper rock chips at Rae project, Canada

Cokal upgrades infrastructure for BBM ramp-up in Indonesia

Featured News

Buyers (Bids)

Sellers (Offers)

Featured News

Think of each neuron as a balloon.To perform a computation,...

Top Stories

Neurotech knocked back by FDA as agency declares target condition not rare enough for special status

Recce eyes Indonesia for novel anti-infective as Indo-Aus ties grow stronger

Coda Minerals (ASX:COD) enters rights issue to further exploration in South Australia

Week 40 Wrap: China's nonsensical stimmy hype wanes (shocking!); HotCopper's picks; oil & inflation

Actinogen Medical ramps up Alzheimer’s treatment trials, targeting fast-track global approvals

Solstice Minerals to ramp up drilling campaign at Yarri Gold Project

BCI reaches close of funding facility for salt-first part of Mardie project

Buxton projects new graphite province discovery at WA Narryer play

White Cliff jumps 24% on 'bonanza grade' copper rock chips at Rae project, Canada

Cokal upgrades infrastructure for BBM ramp-up in Indonesia

Featured News

Buyers (Bids)

Sellers (Offers)

Featured News