6 Commits (394df4187daa618e94f11d7c0af9aad9f5bdadbc)

Author SHA1 Message Date
Qinkai 84365c7d72
Merge branch 'main' into develop 2 years ago
Stanislas0 f3e8eff5cb Update language tag 2 years ago
Stanislas0 5dcecd07bf Update LANGUAGE_TAG 2 years ago
Stanislas0 965abd81b4 Update data processing 2 years ago
Stanislas0 02241e057c Add megatron data processing 2 years ago
Stanislas0 800e5b3cf1 Add dataset for megatron 2 years ago