-
How can a neural network be like the brain?
NeuroAI is the budding research field at the intersection of neuroscience and artificial intelligence. One of the core concepts used in the field is that artificial neural networks can act as good models of the brain. For example, it’s often claimed that convolutional neural networks can account for the response of the ventral visual stream…
-
How much energy does ChatGPT use?
I received this intriguing question from Daria Marchenko, who is a contributor on Moteur de Recherche, on Canadian public radio. I went into a deep rabbit hole trying to find a good answer–especially since she also interviewed the wonderful Sasha Luccioni, an expert on ML and climate change. Most of the estimates I’ve found online…
-
Does GPT-4 have common sense?
There’s been remarkable progress in Masked Language Modeling (MLM) and Reinforcement Learning from Human Feedback (RLHF), taking us much closer to generally useful AI than I could have imagined. GPT-4 exhibits impressive capabilities such as passing the bar exam, navigating virtual mazes, and even demonstrating what seems like a theory of mind. This brings us…
-
Denoising diffusion models for neuroscience
2022 was the year of generative AI models: DALL-E 2, MidJourney, Stable Diffusion, and Imagen all showed that it’s possible to generate grounded, photorealistic images. These generative AIs are instances of conditional denoising diffusion probabilistic models, or DDPMs. Despite these flashy applications, DDPMs have thus far had little impact on neuroscience. I want to change…
-
2022 in review: neuroAI comes of age
2022 has come and gone and we’ve learned a lot about how the brain is – or isn’t – like an artificial neural network. There isn’t a single journal or venue that focuses exclusively on neuroAI so the literature is spread across preprint servers, conference proceedings and the occasional prestige journal. As an end-of-year treat,…
-
How science startups actually work
It’s tough being an academic these days. Between the tiny number of permanent positions and the systemic exploitation of cheap labour, people are looking for a way out. Students, postdocs, and even PIs are asking themselves: should I join a startup? Should I make my own startup? It sounds seductive—change the world! Make money! Keep…
xcorr: AI & neuro 