Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tutorial/Highlight: Exploring Parameter and Hyper-Parameter Spaces of Neuroscience Models on High Performance Computers With Learning to Learn #133

Open
sanjayankur31 opened this issue May 31, 2023 · 0 comments
Labels
C: Community General community related tasks C: Software Highlights Sessions highlighting a particular software tool P: medium Priority: medium S: Needs comment Status: needs comments S: Needs location Status: needs a location: online URL etc. S: Needs scheduling Status: needs to be scheduled S: Needs to be announced Status: needs to be announced/publicised S: Needs web post Status: needs a post on website S: WIP Status: work in progress

Comments

@sanjayankur31
Copy link
Collaborator

https://www.frontiersin.org/articles/10.3389/fncom.2022.885207/full

Abstract:

Neuroscience models commonly have a high number of degrees of freedom and only specific regions within the parameter space are able to produce dynamics of interest. This makes the development of tools and strategies to efficiently find these regions of high importance to advance brain research. Exploring the high dimensional parameter space using numerical simulations has been a frequently used technique in the last years in many areas of computational neuroscience. Today, high performance computing (HPC) can provide a powerful infrastructure to speed up explorations and increase our general understanding of the behavior of the model in reasonable times. Learning to learn (L2L) is a well-known concept in machine learning (ML) and a specific method for acquiring constraints to improve learning performance. This concept can be decomposed into a two loop optimization process where the target of optimization can consist of any program such as an artificial neural network, a spiking network, a single cell model, or a whole brain simulation. In this work, we present L2L as an easy to use and flexible framework to perform parameter and hyper-parameter space exploration of neuroscience models on HPC infrastructure. Learning to learn is an implementation of the L2L concept written in Python. This open-source software allows several instances of an optimization target to be executed with different parameters in an embarrassingly parallel fashion on HPC. L2L provides a set of built-in optimizer algorithms, which make adaptive and efficient exploration of parameter spaces possible. Different from other optimization toolboxes, L2L provides maximum flexibility for the way the optimization target can be executed. In this paper, we show a variety of examples of neuroscience models being optimized within the L2L framework to execute different types of tasks. The tasks used to illustrate the concept go from reproducing empirical data to learning how to solve a problem in a dynamic environment. We particularly focus on simulations with models ranging from the single cell to the whole brain and using a variety of simulation engines like NEST, Arbor, TVB, OpenAIGym, and NetLogo.

A session on this would be very useful to the community.

@sanjayankur31 sanjayankur31 added S: WIP Status: work in progress S: Needs comment Status: needs comments P: medium Priority: medium S: Needs to be announced Status: needs to be announced/publicised S: Needs location Status: needs a location: online URL etc. S: Needs scheduling Status: needs to be scheduled S: Needs web post Status: needs a post on website C: Community General community related tasks C: Software Highlights Sessions highlighting a particular software tool labels May 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C: Community General community related tasks C: Software Highlights Sessions highlighting a particular software tool P: medium Priority: medium S: Needs comment Status: needs comments S: Needs location Status: needs a location: online URL etc. S: Needs scheduling Status: needs to be scheduled S: Needs to be announced Status: needs to be announced/publicised S: Needs web post Status: needs a post on website S: WIP Status: work in progress
Projects
None yet
Development

No branches or pull requests

1 participant