mirror of
https://github.com/zml/zml.git
synced 2026-11-16 19:11:09 +00:00
# HF tokenizers & Llama improvements 1. Added HuggingFace tokenizer and SentencePiece bindings, removed old tokenizers 2. Improved Llama example ## 1. zml/tokenizer: add HuggingFace tokenizers binding, remove old tokenizers `zml.Tokenizer` now uses the new HuggingFace tokenizer bindings when loading a `tokenizer.json`. To move fast, we dropped the `tinyllama`, `gguf`, and `sentencepiece` tokenizers. ## 2. examples/llama Changes to the llama example: - config.json support -> less cmdline flags - switched to [zig-clap](https://github.com/Hejsil/zig-clap) for cmdline args parsing - using HuggingFace tokenizer - re-worked and simplified the code - single token prediction - removed esoteric models from BUILD.bazel - default container now uses Llama-3.2-1B-Instruct --------- Co-authored-by: Steeve Morin <steeve@zml.ai> Co-authored-by: Corentin Godeau <corentin.godeau@zml.ai> Co-authored-by: Corentin Kerisit <corentin.kerisit@gmail.com> |
History
|
|
|---|---|---|
| .. | ||
| howtos | ||
| learn | ||
| misc | ||
| tutorials | ||
| huggingface-access-token.md | ||
| README.md | ||
Greetings, Programs!
If you want to run our example models, please head over to Getting Started.
Ready to write some code? Try starting with your first model in ZML, or familiarize yourself with the high-level ZML concepts first.
MENU:
Tutorials
- Getting Started : install ZML, run LLama
- Writing your first model
- Simplifying Dimension Handling - Tagged Tensors!
How to ?
- HuggingFace Authentication
- Port Pytorch models to ZML
- Add Weights Files to your projects
- Cross Compile and Deploy Models on a Server
- Dockerize Models
Learn more...
- ZML Concepts : Tensors, Models, Executables, etc. explained