WBT (ASX) Wondering what a spiking neural network is?

Originally posted by Interloping: ↑

I've had a look around for a good description to explain the science/technology of spiking neural networks. But, turns out most people who understand it are no good at explaining it. The best video on it I've seen is Vsauce's video "The Stilwell Brain" - but it is only available to youtube premium subscribers. That video simulates a spiking neural network using humans; it's pretty cool. They basically use people to reproduce a simple version of the below:

What you're seeing here is an input of pixels arranged in the shape of a numeric digit on a screen at the front (that's basically working like your retina). Behind that, various configurations of simulated neurons are "excited" by the information on that screen. Suppose each neuron was looking at a grid of 9 retinal "cells" (pixels). If only one of those 9 cells is white, the neuron will only be a little bit excited. But once a certain threshold is reached - perhaps 4 cells being white - it will excite the neuron enough to "spike" and fire a signal to other cells connected to it. Those cells are then similarly connected to multiple other neurons in the first layer of neurons behind the retina - and will only "spike" if enough of those first-layer neurons send them a signal. In the video you can see this as a progressive cascade of activation from the front screen to the back output. In contrast, the other types of network in this video are basically in constant activation front-to-back.

In software, simulating this process requires bits in memory to track every "level" of excitation that can apply to each neuron. If a neuron will spike when it has received three or four inputs, it needs at least two bits of memory to track its state (probably more - I don't know if these simulated networks are model adaptation effects like real neurons, but if they do a lot more information needs to be tracked than just the stimulation needed for initial spiking). As a neural network simulated in software increases in complexity, the amount of memory required will increase exponentially. The CPU also needs to interact with the information in memory to keep track of what the neurons need to do - so both memory-intensive and CPU-intensive.

Where weebit comes in is that the individual cells of weebit "bits" don't have to change state from 0 to 1 with a single input, but it can actually operate like a brain neuron where successive inputs to the cell bring it closer to the threshold that will cause the bit to flip from 0 to 1. Thus, the behaviour of the neuron can be modelled directly by the memory bits, instead of needing the CPU to keep track of it and the memory just storing the current state of each neuron.

There are lots of details that I know nothing about - like how the connections of a weebit neural network are configured (i.e. do they have to be manufactured in a specific configuration or does software in some way simulate the connections between virtual neurons), or whether the activation thresholds can be tweaked for different purposes.

Anyway, I look forward to finding out more when the demonstration is public.

Expand

Think of each neuron as a balloon.

To perform a computation, specific balloons within the network are rapidly inflated at specific time intervals.

When a balloon pops, its value is reset, ready for the next computation to begin.

(Each neuron is injected with an electrical current until it "spikes" [pops] at which point it flips from a 1 back to a 0, or vice versa)

No.	Vol.	Price($)
6	32744	$2.29

No.

Vol.

Price($)

32744

$2.29

Price($)	Vol.	No.
$2.33	2145	1

Price($)

Vol.

No.

$2.33

2145

No.	Vol.	Price($)
6	32744	2.290
5	28298	2.280
4	6360	2.270
5	17981	2.260
14	20152	2.250

No.

Vol.

Price($)

32744

2.290

28298

2.280

6360

2.270

17981

2.260

20152

2.250

Price($)	Vol.	No.
2.330	2145	1
2.340	17332	2
2.350	315	1
2.360	433	1
2.380	2000	1

Price($)

Vol.

No.

2.330

2145

2.340

17332

2.350

315

2.360

433

2.380

2000

(20min delay)
Last $2.29		Change -0.060(2.55%)		Mkt cap ! $438.2M

Open	High	Low	Value	Volume
$2.36	$2.36	$2.29	$1.381M	595.9K

Think of each neuron as a balloon.To perform a computation,...

The Big Deal: Free-to-air TV swings the axe, but will it be enough as enormous sports deal bills loom?

Climate change to drive market trends to the moon

Red Hill Minerals Signs $6.5 Million Agreement with Peel Mining to Explore Curnamona Project, NSW

KGL sniffs 19% Cu from drilling at Rockface play in NT

Tivan and EARTH AI gear up to commence fresh drilling at Sandover lead-silver project, NT

Featured News

Buyers (Bids)

Sellers (Offers)

Featured News

Think of each neuron as a balloon.To perform a computation,...

Top Stories

The Big Deal: Free-to-air TV swings the axe, but will it be enough as enormous sports deal bills loom?

Climate change to drive market trends to the moon

Red Hill Minerals Signs $6.5 Million Agreement with Peel Mining to Explore Curnamona Project, NSW

KGL sniffs 19% Cu from drilling at Rockface play in NT

Tivan and EARTH AI gear up to commence fresh drilling at Sandover lead-silver project, NT

Featured News

Buyers (Bids)

Sellers (Offers)

Featured News