WBT (ASX) Wondering what a spiking neural network is?

Originally posted by Interloping: ↑

I've had a look around for a good description to explain the science/technology of spiking neural networks. But, turns out most people who understand it are no good at explaining it. The best video on it I've seen is Vsauce's video "The Stilwell Brain" - but it is only available to youtube premium subscribers. That video simulates a spiking neural network using humans; it's pretty cool. They basically use people to reproduce a simple version of the below:

What you're seeing here is an input of pixels arranged in the shape of a numeric digit on a screen at the front (that's basically working like your retina). Behind that, various configurations of simulated neurons are "excited" by the information on that screen. Suppose each neuron was looking at a grid of 9 retinal "cells" (pixels). If only one of those 9 cells is white, the neuron will only be a little bit excited. But once a certain threshold is reached - perhaps 4 cells being white - it will excite the neuron enough to "spike" and fire a signal to other cells connected to it. Those cells are then similarly connected to multiple other neurons in the first layer of neurons behind the retina - and will only "spike" if enough of those first-layer neurons send them a signal. In the video you can see this as a progressive cascade of activation from the front screen to the back output. In contrast, the other types of network in this video are basically in constant activation front-to-back.

In software, simulating this process requires bits in memory to track every "level" of excitation that can apply to each neuron. If a neuron will spike when it has received three or four inputs, it needs at least two bits of memory to track its state (probably more - I don't know if these simulated networks are model adaptation effects like real neurons, but if they do a lot more information needs to be tracked than just the stimulation needed for initial spiking). As a neural network simulated in software increases in complexity, the amount of memory required will increase exponentially. The CPU also needs to interact with the information in memory to keep track of what the neurons need to do - so both memory-intensive and CPU-intensive.

Where weebit comes in is that the individual cells of weebit "bits" don't have to change state from 0 to 1 with a single input, but it can actually operate like a brain neuron where successive inputs to the cell bring it closer to the threshold that will cause the bit to flip from 0 to 1. Thus, the behaviour of the neuron can be modelled directly by the memory bits, instead of needing the CPU to keep track of it and the memory just storing the current state of each neuron.

There are lots of details that I know nothing about - like how the connections of a weebit neural network are configured (i.e. do they have to be manufactured in a specific configuration or does software in some way simulate the connections between virtual neurons), or whether the activation thresholds can be tweaked for different purposes.

Anyway, I look forward to finding out more when the demonstration is public.

Expand

Think of each neuron as a balloon.

To perform a computation, specific balloons within the network are rapidly inflated at specific time intervals.

When a balloon pops, its value is reset, ready for the next computation to begin.

(Each neuron is injected with an electrical current until it "spikes" [pops] at which point it flips from a 1 back to a 0, or vice versa)

No.	Vol.	Price($)
1	15000	$2.12

No.

Vol.

Price($)

15000

$2.12

Price($)	Vol.	No.
$2.17	6380	2

Price($)

Vol.

No.

$2.17

6380

No.	Vol.	Price($)
1	15000	2.120
2	10000	2.090
2	7000	2.080
1	1183	2.070
2	785	2.060

No.

Vol.

Price($)

15000

2.120

10000

2.090

7000

2.080

1183

2.070

785

2.060

Price($)	Vol.	No.
2.170	6380	2
2.180	10000	1
2.190	14807	1
2.200	3759	3
2.210	2000	1

Price($)

Vol.

No.

2.170

6380

2.180

10000

2.190

14807

2.200

3759

2.210

2000

(20min delay)
Last $2.14		Change 0.010(0.47%)		Mkt cap ! $446.0M

Open	High	Low	Value	Volume
$2.11	$2.16	$2.05	$1.079M	514.7K

Wondering what a spiking neural network is?, page-4

Listen: HotCopper Wire Podcast 019 – Dreaming of the 9,000s

Japan tariff deal inked at 15% – as long as US gets half a trillion of investment

Trigg brings famed Finnish metals refiner – and its tech – onboard to bolster antimony processing

ASX Market Close: Iron awe keeps the XJO tracking along

Telix sinks as US regulator SEC issues subpoena over claims

Featured News

Buyers (Bids)

Sellers (Offers)

Featured News

Wondering what a spiking neural network is?, page-4

Top Stories

Listen: HotCopper Wire Podcast 019 – Dreaming of the 9,000s

Japan tariff deal inked at 15% – as long as US gets half a trillion of investment

Trigg brings famed Finnish metals refiner – and its tech – onboard to bolster antimony processing

ASX Market Close: Iron awe keeps the XJO tracking along

Telix sinks as US regulator SEC issues subpoena over claims

Featured News

Buyers (Bids)

Sellers (Offers)

Featured News