A small Node.js benchmark suite for the tiktoken WASM port.
-
Updated
May 29, 2023 - TypeScript
A small Node.js benchmark suite for the tiktoken WASM port.
В рамках хакатона был создан телеграм бот для консультации с клиентами с сфере обслуживания магазина "Ашан"
console based game based on a llm
This project harnesses the power of Tiktoken and the OpenAI API to create a Python Streamlit web application with a primary focus on token counting and price estimation.
An Industry Standard Tokenizer, purposed for large-scale language models like OpenAI's GPT Series.
Web crawling GUI app for non-govermental events, easy integration with custom proxy, user agents, ApenAI Api and Redis Stack. Enjoy!
Extracts Google Sheets to JSONL for fine-tuning, estimates task costs with tiktoken.
Tiktoken-counter as standalone API
Logseq Markdown Tokenizer is a Python application that tokenizes and estimates prices for one to many markdown files.
OpenShield is a firewall designed for AI models.
Add a description, image, and links to the tiktoken topic page so that developers can more easily learn about it.
To associate your repository with the tiktoken topic, visit your repo's landing page and select "manage topics."