Megatron LM
Megatron LM has a verified tagged release, NVIDIA Megatron Core 0.19.0.
GitHub Repo — pick #3; tagged release NVIDIA Megatron Core 0.19.0; recent activity Deduplicate MFSDP context post-backward hooks (reference 7196) — https: //github.com/NVIDIA/Megatron-LM.
Megatron LM: Ongoing research training transformer models at scale.
- Watch next
- README, latest release, and issue health.
