alpa
Alpa streamlines the scalable training and inference of large neural networks using automatic parallelization in distributed environments, leveraging integrations with advanced libraries such as Jax and XLA. Despite the project being inactive, its core algorithms are part of the maintained XLA, offering continuous benefits for model scaling.