The neurobench framework for benchmarking neuromorphic computing algorithms and systems

Jason Yik; Korneel Van den Berghe; Douwe den Blanken; Younes Bouhadjar; Maxime Fabre; Paul Hueber; Weijie Ke; Mina A. Khoei; Denis Kleyko; Noah Pacik-Nelson; Alessandro Pierro; Philipp Stratmann; Pao-Sheng Vincent Sun; Guangzhi Tang; Shenqi Wang; Biyan Zhou; Soikat Hasan Ahmed; George Vathakkattil Joseph; Benedetto Leto; Aurora Micheli; Anurag Kumar Mishra; Gregor Lenz; Tao Sun; Zergham Ahmed; Mahmoud Akl; Brian Anderson; Andreas G. Andreou; Chiara Bartolozzi; Arindam Basu; Petrut Bogdan; Sander Bohte; Sonia Buckley; Gert Cauwenberghs; Elisabetta Chicca; Federico Corradi; Guido de Croon; Andreea Danielescu; Anurag Daram; Mike Davies; Yigit Demirag; Jason Eshraghian; Tobias Fischer; Jeremy Forest; Vittorio Fra; Steve Furber; P. Michael Furlong; William Gilpin; Aditya Gilra; Hector A. Gonzalez; Giacomo Indiveri; Siddharth Joshi; Vedant Karia; Lyes Khacef; James C. Knight; Laura Kriener; Rajkumar Kubendran; Dhireesha Kudithipudi; Shih-Chii Liu; Yao-Hong Liu; Haoyuan Ma; Rajit Manohar; Josep Maria Margarit-Taulé; Christian Mayr; Konstantinos Michmizos; Dylan R. Muir; Emre Neftci; Thomas Nowotny; Fabrizio Ottati; Ayca Ozcelikkale; Priyadarshini Panda; Jongkil Park; Melika Payvand; Christian Pehle; Mihai A. Petrovici; Christoph Posch; Alpha Renner; Yulia Sandamirskaya; Clemens J. S. Schaefer; André van Schaik; Johannes Schemmel; Samuel Schmidgall; Catherine Schuman; Jae-sun Seo; Sadique Sheik; Sumit Bam Shrestha; Manolis Sifalakis; Amos Sironi; Kenneth Stewart; Matthew Stewart; Terrence C. Stewart; Jonathan Timcheck; Nergis Tömen; Gianvito Urgese; Marian Verhelst; Craig M. Vineyard; Bernhard Vogginger; Amirreza Yousefzadeh; Fatima Tuz Zohora; Charlotte Frenkel; Vijay Janapa Reddi

doi:10.1038/s41467-025-56739-4

The neurobench framework for benchmarking neuromorphic computing algorithms and systems

J Jason Yik K Korneel Van den Berghe D Douwe den Blanken Y Younes Bouhadjar M Maxime Fabre P Paul Hueber W Weijie Ke M Mina A. Khoei D Denis Kleyko N Noah Pacik-Nelson A Alessandro Pierro P Philipp Stratmann P Pao-Sheng Vincent Sun G Guangzhi Tang S Shenqi Wang B Biyan Zhou S Soikat Hasan Ahmed G George Vathakkattil Joseph B Benedetto Leto A Aurora Micheli A Anurag Kumar Mishra G Gregor Lenz T Tao Sun Z Zergham Ahmed M Mahmoud Akl B Brian Anderson A Andreas G. Andreou C Chiara Bartolozzi A Arindam Basu P Petrut Bogdan S Sander Bohte S Sonia Buckley G Gert Cauwenberghs E Elisabetta Chicca F Federico Corradi G Guido de Croon A Andreea Danielescu A Anurag Daram M Mike Davies Y Yigit Demirag J Jason Eshraghian T Tobias Fischer J Jeremy Forest V Vittorio Fra S Steve Furber P P. Michael Furlong W William Gilpin A Aditya Gilra H Hector A. Gonzalez G Giacomo Indiveri (Institute of Neuroinformatics) S Siddharth Joshi V Vedant Karia L Lyes Khacef J James C. Knight L Laura Kriener R Rajkumar Kubendran D Dhireesha Kudithipudi S Shih-Chii Liu Y Yao-Hong Liu H Haoyuan Ma R Rajit Manohar J Josep Maria Margarit-Taulé C Christian Mayr K Konstantinos Michmizos D Dylan R. Muir E Emre Neftci T Thomas Nowotny F Fabrizio Ottati A Ayca Ozcelikkale P Priyadarshini Panda J Jongkil Park M Melika Payvand C Christian Pehle M Mihai A. Petrovici C Christoph Posch A Alpha Renner Y Yulia Sandamirskaya C Clemens J. S. Schaefer A André van Schaik J Johannes Schemmel S Samuel Schmidgall C Catherine Schuman J Jae-sun Seo S Sadique Sheik S Sumit Bam Shrestha M Manolis Sifalakis A Amos Sironi K Kenneth Stewart M Matthew Stewart T Terrence C. Stewart J Jonathan Timcheck N Nergis Tömen G Gianvito Urgese M Marian Verhelst C Craig M. Vineyard B Bernhard Vogginger A Amirreza Yousefzadeh F Fatima Tuz Zohora C Charlotte Frenkel V Vijay Janapa Reddi

Abstract

Abstract Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it difficult to accurately measure technological advancements, compare performance with conventional methods, and identify promising future research directions. This article presents NeuroBench, a benchmark framework for neuromorphic algorithms and systems, which is collaboratively designed from an open community of researchers across industry and academia. NeuroBench introduces a common set of tools and systematic methodology for inclusive benchmark measurement, delivering an objective reference framework for quantifying neuromorphic approaches in both hardware-independent and hardware-dependent settings. For latest project updates, visit the project website (neurobench.ai).

Download PDF View Original

APA MLA Chicago BibTeX RIS

Article Details

Journal Nature Communications

Volume / Issue Vol. 16, Issue 1

Published February 11, 2025

DOI 10.1038/s41467-025-56739-4

ISSN 2041-1723

Publisher Nature Portfolio

Journal Info

Nature Communications

Nature Portfolio

ISSN: 2041-1723 Open Access Life Sciences

Authors (100)

J

Jason Yik

K

Korneel Van den Berghe

D

Douwe den Blanken

Y

Younes Bouhadjar

M

Maxime Fabre

P

Paul Hueber

W

Weijie Ke

M

Mina A. Khoei

D

Denis Kleyko

N

Noah Pacik-Nelson

A

Alessandro Pierro

P

Philipp Stratmann

P

Pao-Sheng Vincent Sun

G

Guangzhi Tang

S

Shenqi Wang

B

Biyan Zhou

S

Soikat Hasan Ahmed

G

George Vathakkattil Joseph

B

Benedetto Leto

A

Aurora Micheli

A

Anurag Kumar Mishra

G

Gregor Lenz

T

Tao Sun

Z

Zergham Ahmed

M

Mahmoud Akl

B

Brian Anderson

A

Andreas G. Andreou

C

Chiara Bartolozzi

A

Arindam Basu

P

Petrut Bogdan

S

Sander Bohte

S

Sonia Buckley

G

Gert Cauwenberghs

E

Elisabetta Chicca

F

Federico Corradi

G

Guido de Croon

A

Andreea Danielescu

A

Anurag Daram

M

Mike Davies

Y

Yigit Demirag

J

Jason Eshraghian

T

Tobias Fischer

J

Jeremy Forest

V

Vittorio Fra

S

Steve Furber

P

P. Michael Furlong

W

William Gilpin

A

Aditya Gilra

H

Hector A. Gonzalez

G

Giacomo Indiveri

Institute of Neuroinformatics

S

Siddharth Joshi

V

Vedant Karia

L

Lyes Khacef

J

James C. Knight

L

Laura Kriener

R

Rajkumar Kubendran

D

Dhireesha Kudithipudi

S

Shih-Chii Liu

Y

Yao-Hong Liu

H

Haoyuan Ma

R

Rajit Manohar

J

Josep Maria Margarit-Taulé

C

Christian Mayr

K

Konstantinos Michmizos

D

Dylan R. Muir

E

Emre Neftci

T

Thomas Nowotny

F

Fabrizio Ottati

A

Ayca Ozcelikkale

P

Priyadarshini Panda

J

Jongkil Park

M

Melika Payvand

C

Christian Pehle

M

Mihai A. Petrovici

C

Christoph Posch

A

Alpha Renner

Y

Yulia Sandamirskaya

C

Clemens J. S. Schaefer

A

André van Schaik

J

Johannes Schemmel

S

Samuel Schmidgall

C

Catherine Schuman

J

Jae-sun Seo

S

Sadique Sheik

S

Sumit Bam Shrestha

M

Manolis Sifalakis

A

Amos Sironi

K

Kenneth Stewart

M

Matthew Stewart

T

Terrence C. Stewart

J

Jonathan Timcheck

N

Nergis Tömen

G

Gianvito Urgese

M

Marian Verhelst

C

Craig M. Vineyard

B

Bernhard Vogginger

A

Amirreza Yousefzadeh

F

Fatima Tuz Zohora

C

Charlotte Frenkel

V

Vijay Janapa Reddi

The neurobench framework for benchmarking neuromorphic computing algorithms and systems

Abstract

Article Details

Journal Info

Authors (100)

Related Articles from this Journal

Synthesis of adaptive 15N-nitrosyl-Co7 nanocluster for electrocatalytic C–H functionalization

Pan-Ebolavirus nanoparticle vaccine provides protection in rodents from lethal infection by Zaire and Sudan viruses

Multi-population GWAS meta-analysis identifies bladder cancer susceptibility loci and highlights genetic regulation of smoking-related risk

Genome-wide annotation of human multi-nucleotide variants reveals widespread functional differences from single nucleotide variants

Allele-specific chromatin architecture shapes imprinted domains and coordinates a distal enhancer and antisense transcription at the mouse Mest-Copg2 domain