nielsr's picture
nielsr HF Staff
Add model card metadata, links and citation
7632464 verified
|
Raw
History Blame
1.54 kB
metadata
license: mit
library_name: transformers
pipeline_tag: text-generation

Multi-Block Diffusion Language Models (MBD-LMs)

This repository contains the model weights for MBD-LMs, presented in the paper Multi-Block Diffusion Language Models.

Introduction

Block Diffusion Language Models (BD-LMs) improve diffusion-based text generation with KV caching and flexible-length generation. Multi-Block Diffusion Language Models (MBD-LMs) extend this paradigm to Multi-Block Diffusion (MultiBD), where a running-set of consecutive blocks is decoded concurrently for inter-block parallelism.

This model is obtained by post-training BD-LMs with Multi-block Teacher Forcing (MultiTF), which integrates teacher forcing and diffusion forcing by training on bounded noise-groups conditioned on clean prefixes.

Citation

If you find this work useful, please consider citing the paper:

@article{jin2026multiblock,
  title={Multi-Block Diffusion Language Models},
  author={Jin, Yijie and Xu, Jiajun and Liu, Yuxuan and Xu, Chenkai and Tu, Yi and Li, Jiajun and Tu, Dandan and Yan, Xiaohui and Yu, Kai and Liu, Pengfei and Deng, Zhijie},
  journal={arXiv preprint arXiv:2606.29215},
  year={2026}
}