Machine Learning Done Right.

Exploring Diffusion Transformer Designs via Grafting

Keshigeyan Chandrasegaran, Michael Poli

How Effectively Does a Model Use Its Memory

Rom Parnichkun, Neehal Tumma, Stefano Massaroli, Michael Poli, Armin Thomas, Liquid Team

Convolutional Multi-Hybrids for Edge Devices

Armin Thomas, Stefano Massaroli, Michael Poli, Liquid Edge Team

Automated Architecture Synthesis via Targeted Evolution

LFM-1B-Math: Can Small Models Be Concise Reasoners?

Tim Seyde, Rohin Manvi, Maxime Labonne, Liquid AI Team

From Liquid Neural Networks to Liquid Foundation Models

The Key to State Reduction in Linear Attention: A Rank-based Perspective

Philipp Nazari, T. Konstantin Rusch

Low-Pass Flow Matching

Francesco M. Ruscio, T. Konstantin Rusch

AlphaQ: Calibration-Free Bit Allocation for Mixture-of-Experts Quantization

Wanqi Yang, Yuexiao Ma, Alexander Conzelmann, Xiawu Zheng, Michael W. Mahoney, T. Konstantin Rusch, Shiwei Liu

The Curious Case of In-Training Compression of State Space Models

Makram Chahine, Philipp Nazari, Daniela Rus, T. Konstantin Rusch

Antislop: A Comprehensive Framework for Identifying and Eliminating Repetitive Patterns in Language Models

Samuel J Paech, Allen G Roush, Judah Goldfeder, Ravid Shwartz-Ziv

Learning residue level protein dynamics with multiscale Gaussians

Mihir Bafna, Bowen Jing, Bonnie Berger

Zero-Overhead Introspection for Adaptive Test-Time Compute

Rohin Manvi, Joey Hong, Tim Seyde, Maxime Labonne, Mathias Lechner, Sergey Levine

LFM2 Technical Report

Alexander Amini, Anna Banaszak, Harold Benoit, Arthur Böök, Tarek Dakhran, Song Duong, Alfred Eng, Fernando Fernandes, Marc Härkönen, Anne Harrington, Ramin Hasani, Saniya Karwa, Yuri Khrustalev, Maxime Labonne, Mathias Lechner, Valentine Lechner, Simon Lee, Zetian Li, Noel Loo, Jacob Marks, Edoardo Mosca, Samuel J. Paech, Paul Pak, Rom N. Parnichkun, Alex Quach, Ryan Rogers, Daniela Rus, Nayan Saxena, Bettina Schlager, Tim Seyde, Jimmy T.H. Smith, Aditya Tadimeti, Neehal Tumma

RL Squeezes, SFT Expands: A Comparative Study of Reasoning LLMs

Kohsei Matsutani, Shota Takashiro, Gouki Minegishi, Takeshi Kojima, Yusuke Iwasawa, Yutaka Matsuo

Towards a theory of learning dynamics in deep state space models

Jakub Smekal, Jimmy Smith, Michael Kleinman, Dan Biderman, Scott Linderman