Issues

• Assert in verify_correctness for mistral-7B

  epfLLM/Megatron-LLM#107 · Filter by author abgoswam opened on Sep 1, 2024
  3

• Any plans to rebase the codebase to most recent Megatron-LM for MoE?

  epfLLM/Megatron-LLM#100 · Filter by author xingyaoww opened on Mar 7, 2024

• Support QWen？

  epfLLM/Megatron-LLM#96 · Filter by author Vincent131499 opened on Feb 5, 2024
  2

• error: preprocess.py file error while working on custom data

  epfLLM/Megatron-LLM#94 · Filter by author toqeer618 opened on Jan 30, 2024

• One question about the permute function code in permute_qkv.py

  epfLLM/Megatron-LLM#89 · Filter by author drxmy opened on Nov 24, 2023
  2

• support falcon 180B

  epfLLM/Megatron-LLM#71 · Filter by author martinjaggi opened on Sep 25, 2023

• Nice-to-have training features

  enhancement
  epfLLM/Megatron-LLM#30 · Filter by author andreaskoepf opened on Aug 15, 2023