Machine Learning in Science

Machine Learning in Science

@mackelab.bsky.social

We build probabilistic #MachineLearning and #AI Tools for scientific discovery, especially in Neuroscience. Probably not posted by @jakhmack.bsky.social. 📍 @ml4science.bsky.social‬, Tübingen, Germany

2.6K followers198 following128 posts

View full thread
View full thread
View full thread

ModelSMC: we frame LLM-based scientific model discovery as Bayesian inference. Sequential Monte Carlo over executable model structures, with the LLM as a probabilistic proposal mechanism. 📍 Wed Jul 8, at 2:30–4:15 PM KST in Hall A #3512 📄 arxiv.org/abs/2602.18266 🧵 bsky.app/profile/mack...

Machine Learning in Science@mackelab.bsky.social

New paper: We recast automated scientific model discovery with LLMs as Bayesian inference! LLMs write code and carry domain knowledge, great for proposing models. The key idea: discovery is inference, not just generation. What distribution of models explains the data? 🧵 arxiv.org/abs/2602.18266

View full thread

Casting discovery as inference over programs lets scientists: • weigh competing mechanistic hypotheses • quantify uncertainty and non-identifiability • reuse established SMC methods for principled posterior exploration • unify proposal, refinement, and selection.

View full thread

We treat Hodgkin-Huxley models as a structural problem: infer missing ion-channel mechanism. ModelSMC uncovers mechanistically meaningful extensions, exposing structural ambiguities and improving fit, yielding a posterior over plausible models rather than a single best model.

A unique benefit of our framework? We can analyse the model posterior! We semantically cluster the generated HH models by their added ion-channel mechanisms. Low-weight clusters flag structural mismatch scientists can discard; high-weight clusters point to the mechanisms actually worth pursuing.

View full thread

As one concrete instantiation of this framework, we introduce ModelSMC: Sequential Monte Carlo directly in model space. We keep a population of candidate programs as particles, propose refinements via the LLM, weight by likelihood, and resample.

Most LLM discovery systems are agentic loops: propose, evaluate, keep the best one. This gives a single point estimate, discarding the probabilistic structure scientists rely on to know what to rule out, what is uncertain, and where more data would help. Instead, we frame discovery as inference.

Our group is at NeurIPS and EurIPS this year with four papers and one workshop poster. If you are either curious about SBI with autoML, with foundation models, or on function spaces or about differentiable simulators with Jaxley, have a look below 👇 1/11

View full thread

Our group is at NeurIPS and EurIPS this year with four papers and one workshop poster. If you are either curious about SBI with autoML, with foundation models, or on function spaces or about differentiable simulators with Jaxley, have a look below 👇 1/11

View full thread

Fourth, in collaboration with Ian C Tanoh and Scott Linderman, we used the Jaxley toolbox and extended Kalman filters to estimate the marginal log-likelihood of a biophysical neuron model. We showed that this enables identifying biophysical parameters given extracellular recordings. 8/11

Our group is at NeurIPS and EurIPS this year with four papers and one workshop poster. If you are either curious about SBI with autoML, with foundation models, or on function spaces or about differentiable simulators with Jaxley, have a look below 👇 1/11

View full thread

Our group is at NeurIPS and EurIPS this year with four papers and one workshop poster. If you are either curious about SBI with autoML, with foundation models, or on function spaces or about differentiable simulators with Jaxley, have a look below 👇 1/11

View full thread

Our group is at NeurIPS and EurIPS this year with four papers and one workshop poster. If you are either curious about SBI with autoML, with foundation models, or on function spaces or about differentiable simulators with Jaxley, have a look below 👇 1/11

Machine Learning in Science reposted