Skip to content

samber/go-gpt-3-encoder

About

Go BPE tokenizer (Encoder+Decoder) for GPT2 and GPT3

pkg.go.dev/github.com/samber/go-gpt-3-encoder

Topics

go encoder decoder tokenizer transformer openai token codex bpe byte-pair-encoding gpt-2 gpt-3

Resources

Readme

License

MIT license
Activity

Stars

81 stars

Watchers

2 watching

Forks

21 forks
Report repository

Releases 4

v0.3.1 Latest
Feb 27, 2023
+ 3 releases

Sponsor this project

 
Learn more about GitHub Sponsors

Contributors 4

  •  
  •  
  •  
  •  

Languages