Iwouldliketohavedoneabitmoreresearchbeforepostingagainhere,butIwantedtoprovideanupdatebeforetheAGMsothatyouguyscanusethistoinformanyquestionsyoumaywanttoraise.Trothlis said: As it currently stands, I am unfortunately more concerned about the viability of Akida than I was at the start of this inquiry. Despite having clarified my understanding of the design and published numbers, the task of extracting these clarifications was confusing and the technology still appears to me to not be feasible as it is described. I am open to the possibility that there are still additional explanations that would resolve this - but there is good reason why Loihi has "only" 131K neurons and 130M synapses.
InearlyAprilIemailedKrisCarlsonasanalternatepathtotryandresolvemyconcernsabouttheAkidahardwareresources.AfewdayslaterIreceivedanemailfromPetervanderMade.Thisstartedalengthyseriesofemailsexchangedoverthelast7weekstotryandsortoutmyconcernsregardingthehardwareresourcesthatarerequiredtomeettheclaimspublishedforAkida.Achronological,26pagecopyoftheentireexchangeisattachedtothispost(PVDM_Correspondence.pdf),andwasonlyredactedtoremovecontactinformation.IntheemailsfromMay13thand15thhegavepermissiontosharetheinformation.
Someofthehighlightsfromthisdiscussion:
- TheAkidaneuralarchitectureisafairlysignificantdeparturefromSNAP64andthepublishedpatents,andemployssomekindofhardwarethatcanbereallocatedbetweensynapsesandneurons.
- Theadvertised10Bsynapsenumberis"equivalentsynapses",whichiseasilycalculatedfromthenetworkdefinitionbysummingthe(filter_size*number_of_strides)*filter_countacrossalllayers.Incontrast,thenumberofphysicalsynapsesinanAkidaimplementationisthesumoffilter_size*filter_countacrossalllayers.
- Itisstillambiguouswhatthe1.2Mneuronnumberrefersto,butmostrecentlyitwasdefinedasanaverageneuroncount.Seethe2ndconcernbelow.
- Peterwasconsistentinstatingthatthehardwareisnotmultiplexed.IftheAkidaspecificationislegitimate,thenIthinkthataproperinterpretationofthisisprobablycentraltotheexplanation.
- PeterhasbeenfarmoreavailableandresponsivethanIanticipated.Hewasawareofthisthreadandexpressedadesiretoresolvetheconcerns.HewillprobablythenalsobeawareofthispostandIhopeitspursfurtherclarification.
Andafewkeyconcerns:
- Afterestablishingthetechniqueforcalculatingthenumberofhardwareentities,thenetworkwhichwasgivenastheexemplarfor10billionequivalentsynapsesappearstorequireresourcesthatarenotfeasiblefora$10-$20chipwitha28nmprocess(andprobablynotevenforanypriceortechnology).Icouldbewrong,butsomethinginthedescriptionisgoingtohavetochangeformetoseethat.
- Itsometimesseemedthattheexplanationswerechanginginresponsetomyfurtherqueries.Forexample,inthefirstemailonApril5Peterstatedthatthepublishedneuronandsynapsecountswerethe"maximumnumberofneuronsandmaximumnumberofsynapses".Thiswasrestatedas1.2Mphysicalneuronsand10B"equivalentsynapses"laterthesameday.ButthenintheMay17emailhesaysthat"The1.2Mneuronswepublishedisanaveragefigure"afterIobservedthatthegivennetworkrequiredmorethan1.2Mphysicalneurons.
- InthecourseofthediscussionabouttheimageclassifierCNNs,PetersuggestedthatthediscrepancywasduetoCNNsreporting"neuronequivalents"anditwasinferredthattheAkidaphysicalneuronwasreusedoneachconvolutionalstride.However,thatdidnotalignwiththesubsequentdescriptionoftheAkidaphysicalneuronandthetechniquegivenforcalculatingphysicalneuronsinAkidaendedupbeingidenticaltothethecountofneuronsinaCNN.
Asitcurrentlystands,IamunfortunatelymoreconcernedabouttheviabilityofAkidathanIwasatthestartofthisinquiry.Despitehavingclarifiedmyunderstandingofthedesignandpublishednumbers,thetaskofextractingtheseclarificationswasconfusingandthetechnologystillappearstometonotbefeasibleasitisdescribed.Iamopentothepossibilitythattherearestilladditionalexplanationsthatwouldresolvethis-butthereisgoodreasonwhyLoihihas"only"131Kneuronsand130Msynapses.Iamcurrentlyawaitingaccesstothedevelopmentenvironmenttoseeifthatcanprovideadditionalclarification.IfIhadtoguessatanexplanationwhichwouldchangemymind,IthinkthatthechipspecificationscouldbefeasibleifthereallocatablehardwareisjustspaceinSRAM,andthesynapticandneuralhardwareentitiesareactuallybeingreusedwithinalayer(i.e.,multiplexing,orserialization,orpipelining)bysequentiallypullingandstoringvaluestotheSRAM.ButPeterrepeatedlystatedthatthisisnotthecase.It'spossiblethatthereisaseveredisconnectbetweenusonwhatthatactuallymeans.
Lastly,IalsocontactedSocionexttoconfirmthattheMoUwasinplaceandaskedwhethermaterialshadbeenprovidedbyBrainchipfortheirevaluation.TheyrefusedtosayanythingandwouldonlyrefermetotheBrainchippressrelease.Idon'tthinkthere'smuchtoreadintothat,butIthoughtIwouldshare.
IfanybodyhasanyquestionsthattheywanttoaskmebeforetheAGM,youshoulddosobeforethe24th.Myavailabilitywillbelimitedthereafter.
Hi Trothlis ,all that research only to end up as you started still concerned and doubting Akida's 'viability' ,you must find it frustrating that even with your understanding of the design and published numbers of Akida that you found Peters assistance confusing.
Trothlis, some of the Akida design/explanations you seek maybe too hot !! …….. to be honest I would be more concerned if you figured out how Akida works with all those MEGA neurons and synapse , poor little cousin Loihi.
Trothlis thanks for efforts, but at the end of the day the only Akida opinion that will truly matter is the one Socionext will make ! …...anybody else sweating bullets
- Forums
- ASX - By Stock
- Technology due diligence
Trothlis said: As it currently stands, I am unfortunately more...
-
-
- There are more pages in this discussion • 175 more messages in this thread...
You’re viewing a single post only. To view the entire thread just sign in or Join Now (FREE)
Featured News
Add BRN (ASX) to my watchlist
(20min delay)
|
|||||
Last
16.5¢ |
Change
0.000(0.00%) |
Mkt cap ! $323.8M |
Open | High | Low | Value | Volume |
16.5¢ | 17.0¢ | 16.0¢ | $842.4K | 5.117M |
Buyers (Bids)
No. | Vol. | Price($) |
---|---|---|
11 | 316637 | 16.5¢ |
Sellers (Offers)
Price($) | Vol. | No. |
---|---|---|
17.0¢ | 1386823 | 34 |
View Market Depth
No. | Vol. | Price($) |
---|---|---|
41 | 943514 | 0.160 |
76 | 2258508 | 0.155 |
129 | 3224854 | 0.150 |
35 | 720212 | 0.145 |
39 | 763660 | 0.140 |
Price($) | Vol. | No. |
---|---|---|
0.170 | 1148424 | 30 |
0.175 | 1807272 | 27 |
0.180 | 972364 | 22 |
0.185 | 538384 | 13 |
0.190 | 871538 | 18 |
Last trade - 16.10pm 20/09/2024 (20 minute delay) ? |
Featured News
BRN (ASX) Chart |