Wondering what a spiking neural network is?, page-4

First 4 Last

Share
Profile

Follow
bobfossil

226 Posts.

48

26/07/19

06:10

Post #: 39700222
Share

Originally posted by Interloping: ↑

I've had a look around for a good description to explain the science/technology of spiking neural networks. But, turns out most people who understand it are no good at explaining it. The best video on it I've seen is Vsauce's video "The Stilwell Brain" - but it is only available to youtube premium subscribers. That video simulates a spiking neural network using humans; it's pretty cool. They basically use people to reproduce a simple version of the below:

What you're seeing here is an input of pixels arranged in the shape of a numeric digit on a screen at the front (that's basically working like your retina). Behind that, various configurations of simulated neurons are "excited" by the information on that screen. Suppose each neuron was looking at a grid of 9 retinal "cells" (pixels). If only one of those 9 cells is white, the neuron will only be a little bit excited. But once a certain threshold is reached - perhaps 4 cells being white - it will excite the neuron enough to "spike" and fire a signal to other cells connected to it. Those cells are then similarly connected to multiple other neurons in the first layer of neurons behind the retina - and will only "spike" if enough of those first-layer neurons send them a signal. In the video you can see this as a progressive cascade of activation from the front screen to the back output. In contrast, the other types of network in this video are basically in constant activation front-to-back.

In software, simulating this process requires bits in memory to track every "level" of excitation that can apply to each neuron. If a neuron will spike when it has received three or four inputs, it needs at least two bits of memory to track its state (probably more - I don't know if these simulated networks are model adaptation effects like real neurons, but if they do a lot more information needs to be tracked than just the stimulation needed for initial spiking). As a neural network simulated in software increases in complexity, the amount of memory required will increase exponentially. The CPU also needs to interact with the information in memory to keep track of what the neurons need to do - so both memory-intensive and CPU-intensive.

Where weebit comes in is that the individual cells of weebit "bits" don't have to change state from 0 to 1 with a single input, but it can actually operate like a brain neuron where successive inputs to the cell bring it closer to the threshold that will cause the bit to flip from 0 to 1. Thus, the behaviour of the neuron can be modelled directly by the memory bits, instead of needing the CPU to keep track of it and the memory just storing the current state of each neuron.

There are lots of details that I know nothing about - like how the connections of a weebit neural network are configured (i.e. do they have to be manufactured in a specific configuration or does software in some way simulate the connections between virtual neurons), or whether the activation thresholds can be tweaked for different purposes.

Anyway, I look forward to finding out more when the demonstration is public.

Expand

Think of each neuron as a balloon.

To perform a computation, specific balloons within the network are rapidly inflated at specific time intervals.

When a balloon pops, its value is reset, ready for the next computation to begin.

(Each neuron is injected with an electrical current until it "spikes" [pops] at which point it flips from a 1 back to a 0, or vice versa)

WBT Price at posting: 42.5¢ Sentiment: None Disclosure: Held
11 Upvote

0 Great analysis

Reply

Top Stories

MEU

Double-time: Marmota starts deeper Greenewood drilling days after title transfer

Wednesday's HotCopper trends: Trigg $12.5M placement, Domino's shock exit | July 2

ASX Market Close: Another ATH close for Oz bourse on mining rally | July 2

Trump chides Powell as Goldman call for calm. The RBA must be nervous

Listen: HotCopper Wire Podcast 016 – FY25 ended up not so bad... but Trump unpause is coming

First 4 Last

Add to My Watchlist

What is My Watchlist?

A personalised tool to help users track selected stocks. Delivering real-time notifications on price updates, announcements, and performance stats on each to help make informed investment decisions.

(20min delay)
Last $1.69		Change -0.045(2.59%)		Mkt cap ! $352.2M

Open	High	Low	Value	Volume
$1.75	$1.77	$1.67	$464.8K	271.7K

Buyers (Bids)

No.	Vol.	Price($)
1	5000	$1.68

Sellers (Offers)

Price($)	Vol.	No.
$1.70	1000	1

View Market Depth

No.	Vol.	Price($)
1	5000	1.680
1	2500	1.675
1	10000	1.670
2	1250	1.660
2	4624	1.650

Price($)	Vol.	No.
1.700	1000	1
1.715	5502	1
1.740	5501	1
1.750	5000	1
1.765	25000	2

Last trade - 16.10pm 02/07/2025 (20 minute delay)

WBT (ASX) Chart

Wondering what a spiking neural network is?, page-4

Double-time: Marmota starts deeper Greenewood drilling days after title transfer

Wednesday's HotCopper trends: Trigg $12.5M placement, Domino's shock exit | July 2

ASX Market Close: Another ATH close for Oz bourse on mining rally | July 2

Trump chides Powell as Goldman call for calm. The RBA must be nervous

Listen: HotCopper Wire Podcast 016 – FY25 ended up not so bad... but Trump unpause is coming

Featured News

Buyers (Bids)

Sellers (Offers)

Featured News

Wondering what a spiking neural network is?, page-4

Top Stories

Double-time: Marmota starts deeper Greenewood drilling days after title transfer

Wednesday's HotCopper trends: Trigg $12.5M placement, Domino's shock exit | July 2

ASX Market Close: Another ATH close for Oz bourse on mining rally | July 2

Trump chides Powell as Goldman call for calm. The RBA must be nervous

Listen: HotCopper Wire Podcast 016 – FY25 ended up not so bad... but Trump unpause is coming

Featured News

Buyers (Bids)

Sellers (Offers)

Featured News