-
Denoising diffusion models for neuroscience
2022 was the year of generative AI models: DALL-E 2, MidJourney, Stable Diffusion, and Imagen all showed that it’s possible to generate grounded, photorealistic images. These generative AIs are instances of conditional denoising diffusion probabilistic models, or DDPMs. Despite these flashy applications, DDPMs have thus far had little impact on neuroscience. I want to change…
-
2022 in review: neuroAI comes of age
2022 has come and gone and we’ve learned a lot about how the brain is – or isn’t – like an artificial neural network. There isn’t a single journal or venue that focuses exclusively on neuroAI so the literature is spread across preprint servers, conference proceedings and the occasional prestige journal. As an end-of-year treat,…
-
How science startups actually work
It’s tough being an academic these days. Between the tiny number of permanent positions and the systemic exploitation of cheap labour, people are looking for a way out. Students, postdocs, and even PIs are asking themselves: should I join a startup? Should I make my own startup? It sounds seductive—change the world! Make money! Keep…
-
Large language models will change science
It takes dedication to keep up with the scientific literature. 2344 papers were accepted at last year’s NeurIPS conference. Who has time to read all of that? It’s difficult to see the forest from the trees as ever more research is published. What if every single one of us had infinite access to world experts…
-
What’s the endgame of neuroAI?
This blog post was adapted into an article for a16z’s Future. It’s been 60 years since Hubel and Wiesel first started unlocking the mysteries of the visual system. Proceeding one neuron at a time, they discovered the fundamental building blocks of vision, the simple and complex cells. Yet for a long time, neurons in high-level…
-
Unsupervised models of the brain
We’re in a golden age of merging AI and neuroscience. No longer tied to conventional publication venues with year-long turnaround times, our field is moving at record speed. 2021 saw a Cambrian explosion of research into unsupervised learning to explain brain representations, which is teaching us about how the brain might have evolved for sensing.…