Commit Graph

27 Commits (0e78dc85e4a14065d180cdba90914d752d6b8657)

Author SHA1 Message Date
Stanislas0 2147a88827 Update megatron tokenizer
Stanislas0 a3347b25b3 add save_name
Stanislas0 683f2f6625 Merge branch 'develop' of github_qinkai:THUDM/CodeGeeX into develop
Stanislas0 140a5ea218 Fix parallel ckpt conversion
Qinkai 84365c7d72
Merge branch 'main' into develop
Stanislas0 b0544da8b4 Refactor
Stanislas0 3000d22c08 add arguments
Stanislas0 df2b2a95a0 add valid forward
Stanislas0 a81ef7e571 add finetune codegeex
Semen Zhydenko 0151e0d09f Fixed typo: succesfully -> successfully
Semen Zhydenko 479aa44d0e Fixed typo: thier -> their
Semen Zhydenko 4fe98f71a0 Fixed typo: continous -> continuous
Semen Zhydenko e4ccb2d28b Fixed typo: begining -> beginning
Semen Zhydenko f76d660c49 Fixed typo: compatiblity -> compatibility
Stanislas0 079b9ebd94 Refactor
Stanislas0 5c9dab3701 Fix merge parallel ckpt
Stanislas0 25467799d5 Refactor
Stanislas0 177e44bf66 Fix parallel ckpt conversion
Stanislas0 67514d09ae Refactor beam search
Stanislas0 4198b21b9e Update
Stanislas0 76c550d876 Refactor
Stanislas0 e5c9b22e81 Update pretraining megatron
Stanislas0 a866d8db20 Refactor
Stanislas0 31c3bf351d Update model parallelism
Stanislas0 879b01df03 Add megatron pretraining
Stanislas0 02241e057c Add megatron data processing
Qinkai 07b8d7f10f Release cross-platform source code and weights