ai
/
CodeGeeX
mirror of https://github.com/THUDM/CodeGeeX.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
main
develop
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '0e78dc85e4'
${ noResults }
CodeGeeX/codegeex/megatron/tokenizer
History
Stanislas0 2147a88827 Update megatron tokenizer 2 years ago
..
__init__.py Release cross-platform source code and weights 3 years ago
gpt2_tokenization.py Release cross-platform source code and weights 3 years ago
tokenizer.py Update megatron tokenizer 2 years ago