6 Commits (4758dcec0f963d72d90ff651014a64a671fcf13f)

Author SHA1 Message Date
Qinkai 84365c7d72
Merge branch 'main' into develop 2 years ago
Stanislas0 f3e8eff5cb Update language tag 2 years ago
Stanislas0 5dcecd07bf Update LANGUAGE_TAG 2 years ago
Stanislas0 965abd81b4 Update data processing 2 years ago
Stanislas0 02241e057c Add megatron data processing 2 years ago
Stanislas0 800e5b3cf1 Add dataset for megatron 2 years ago