1
0
mirror of https://github.com/rust-unofficial/awesome-rust.git synced 2025-03-03 14:32:38 +02:00

Merge pull request #1462 from zurawiki/patch-1

Add tiktoken-rs
This commit is contained in:
Tom Parker-Shemilt 2023-03-23 07:31:17 +00:00 committed by GitHub
commit 46a297a042
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -767,6 +767,7 @@ See also [About Rust’s Machine Learning Community](https://medium.com/@autumn_
#### OpenAI
* [64bit/async-openai](https://github.com/64bit/async-openai) [[async-openai](https://crates.io/crates/async-openai)] — Ergonomic Rust bindings for OpenAI API based on OpenAPI spec.
* [zurawiki/tiktoken-rs](https://github.com/zurawiki/tiktoken-rs) [[tiktoken-rs](https://crates.io/crates/tiktoken-rs)] — Rust library for tokenizing text with OpenAI models using tiktoken. [![CI](https://github.com/zurawiki/tiktoken-rs/actions/workflows/ci.yml/badge.svg)](https://github.com/zurawiki/tiktoken-rs/actions/workflows/ci.yml)
### Astronomy