0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00
zml/examples
Rene Schallner edf5d9a93d
llama: fix dims & dtypes -> fix #170 (#171)
This PR fixes issue #170 , making Llama run again on CUDA and RoCM.

- Latest Llama changes had introduced an unnecessary batching dimension:
fixed
- Ops returning indices return i32 yet we now use u32 as token indices
-> dtype conversion requred: fixed

Tested on CUDA.
History 2025-01-27 17:06:03 +01:00
..
.vscode zml/tokenizer: use HuggingFace Tokenizers and SentencePiece & Llama improvements (#162) 2025-01-24 18:25:57 +01:00
benchmark examples: fix logFn usages (#167) 2025-01-24 21:07:36 +01:00
llama llama: fix dims & dtypes -> fix #170 (#171) 2025-01-27 17:06:03 +01:00
loader pjrt/zml: expose client creation flags (#129) 2024-12-11 13:38:04 +01:00
mnist examples: fix logFn usages (#167) 2025-01-24 21:07:36 +01:00
simple_layer pjrt/zml: expose client creation flags (#129) 2024-12-11 13:38:04 +01:00
third_party zml/tokenizer: use HuggingFace Tokenizers and SentencePiece & Llama improvements (#162) 2025-01-24 18:25:57 +01:00
tools workspace: rework code completion using a custom build runner (#131) 2024-12-16 13:20:27 +01:00
.bazelignore zml: initial release 2024-09-17 11:11:18 +02:00
.bazelrc zml/tokenizer: use HuggingFace Tokenizers and SentencePiece & Llama improvements (#162) 2025-01-24 18:25:57 +01:00
.bazelversion workspace: upgrade to Bazel 8 (#143) 2025-01-23 18:36:57 +01:00
.gitignore zml: initial release 2024-09-17 11:11:18 +02:00
.nvim.lua Fix LSP in Neovim (#65) 2024-10-23 14:07:48 +02:00
bazel.sh workspace: upgrade to Bazel 8 (#143) 2025-01-23 18:36:57 +01:00
BUILD.bazel zml/tokenizer: use HuggingFace Tokenizers and SentencePiece & Llama improvements (#162) 2025-01-24 18:25:57 +01:00
build.zig zml: initial release 2024-09-17 11:11:18 +02:00
MODULE.bazel zml/tokenizer: use HuggingFace Tokenizers and SentencePiece & Llama improvements (#162) 2025-01-24 18:25:57 +01:00
MODULE.bazel.lock zml/tokenizer: use HuggingFace Tokenizers and SentencePiece & Llama improvements (#162) 2025-01-24 18:25:57 +01:00
platform_mappings zml: initial release 2024-09-17 11:11:18 +02:00
zls.build.json workspace: rework code completion using a custom build runner (#131) 2024-12-16 13:20:27 +01:00