0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

..

98 commits

Author SHA1 Message Date
Raphael NAHOUM
9b7e2caea3 rename shift to circular and update comment 2026-02-23 11:38:34 +01:00
Raphael NAHOUM
9f98b994f0 merge step functions 2026-02-23 11:29:37 +01:00
Raphael NAHOUM
69c2ac8f3c replace deprecated function 2026-02-23 11:17:20 +01:00
Raphael NAHOUM
e59325497b centralize into sp 2026-02-23 11:15:29 +01:00
Raphael NAHOUM
110c6dab71 start to comment code 2026-02-23 11:11:38 +01:00
Raphael NAHOUM
d08fe92634 remove explicit right padding and prefill reflective padding 2026-02-20 18:37:54 +01:00
Raphael NAHOUM
6d0794ad66 inline mel prefill and rename prompt tokens 2026-02-20 17:04:15 +01:00
Raphael NAHOUM
6cd9781f50 one func for prefill and loop 2026-02-20 16:45:31 +01:00
Raphael NAHOUM
fe7bffd606 remove unused old code 2026-02-20 16:10:15 +01:00
Raphael NAHOUM
6eb4288593 move swiglu to common 2026-02-20 15:46:34 +01:00
Raphael NAHOUM
a4b0fa9706 remove padding and change convert position 2026-02-20 15:19:35 +01:00
Raphael NAHOUM
a21811927f opti step 1 2026-02-20 15:13:17 +01:00
Raphael NAHOUM
0bbd034724 shift and circular implem 2026-02-20 14:24:43 +01:00
Raphael NAHOUM
231dcfb540 Shift kv cache 2026-02-19 18:00:44 +01:00
Raphael NAHOUM
ff7128ac30 remove unused old code 2026-02-19 16:37:11 +01:00
Raphael NAHOUM
5029738105 from mel history to state tensors 2026-02-18 18:36:38 +01:00
Raphael NAHOUM
9c8d401393 make kv cache sequential but keep experimental circular 2026-02-18 12:35:21 +01:00
Raphael NAHOUM
f8f94ec302 remove unused code 2026-02-18 11:51:22 +01:00
Raphael NAHOUM
eecb9139f9 isolate terminalwave code 2026-02-18 11:28:01 +01:00
Raphael NAHOUM
65b4ab10db start of cleanup 2026-02-18 11:13:59 +01:00
Raphael NAHOUM
facfe51ba0 force temperature and experimental reordering of cicular buffer 2026-02-17 16:31:38 +01:00
Raphael NAHOUM
719b2ee347 Add terminalwave 2026-02-17 16:06:09 +01:00
Raphael NAHOUM
9a69d1bd7b add sliding window 2026-02-17 14:42:03 +01:00
Raphael NAHOUM
908a97a7ea correct audio shift 2026-02-17 14:28:14 +01:00
Raphael NAHOUM
87852ac75e good prefill and log information 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
b5897a127c start reading stdin (wrong prefill) 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
d018298cb1 test mel specto chunks 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
0035ce2ed1 args derived kvcache size + metrics 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
f43fff4f88 remove forwardstep 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
946421c6d8 fix new zig and disable vfs for now 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
394a5e59e8 divide runPipeline into 3 parts 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
ee0644c6a9 store params in a struct 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
3002cc985c step conv stem + prefill 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
cc06ee95b8 encoder uses attention directly as well 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
81effa4e40 support diff len input 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
8338a2fe15 start of paper match 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
b14e898a80 use sampleTokens 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
ea56f50ee8 inline embedder into decoder 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
bccd580635 Remove hardcoded dsf and pad encoder output instead of truncating after 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
93f0f67133 Remove hardcoded values 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
eb6d66e0a8 better naming and formatting 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
c3f9e1ecc2 Some cleanup 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
f2d79dfcb9 decode loop test 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
f5b9372bbe test embedder 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
3f5e00564f Pad audio 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
1a9688e662 First decode try 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
cf5d01a5ea Change acceptable error 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
3e32eb2063 Load embedder and decoder weights 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
e4d80948de Remove hardcoded values and read from config 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
ff0e3ba39a Add embedder, compile every model and load weights 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
234f814404 hardcode tokens and compile encoder 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
f1c4850041 Decoder prefill tests 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
8c83dcc7c8 add layer by layer encoder transformer test 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
e8c7afe77b new testLayer and remove convert 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
839d78ad89 type conversion 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
313c46191e simplify encoder layout 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
7cd2745353 Assert same type for linear forward for input and weights and fix format for tensor dot 2026-02-17 14:27:50 +01:00
Raphael NAHOUM
11d1f62d90 Base encoder 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
6308e40431 add transformer layers to encoder 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
7c63280833 parse whole config 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
450abf35c1 Encoder seems to be working 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
567ec83e99 encoder conv stem 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
82c82ed8b0 separate test file 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
e9456b806c harness to tag mel test tensors 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
fbe5970f7a use vfs, tensor store and registry to test 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
1c406b29a2 separate mel spectrogram to different file 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
8bdc64b2ed add pre-computed mel filter as an asset 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
e72e979c9c fix pad function args order 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
0179c3b884 voxtral: convert old code to use tags 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
5101eb2612 correct output 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
d18dd5e1dd Call model 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
742622d979 Compile model and load buffers 2026-02-17 14:27:07 +01:00
Raphael NAHOUM
cce0923490 voxtral: support wav inputs 2026-02-17 14:27:07 +01:00
Corentin Godeau
fe5777db1c zml: added paged_attention to zml 2026-02-17 11:07:01 +00:00
Steeve Morin
798a6c2819 third_party/zls: allow using outside of ZML repo 2026-02-16 20:28:59 +00:00
Steeve Morin
ef2ae9253b examples/llama: fix new flashattn 2026-02-16 20:28:35 +00:00
Corentin Godeau
d03c92950b zml/nn: remove useless convert 2026-02-16 20:22:57 +00:00
Corentin Godeau
7a5b371ea1 zml/nn: added default value for rope_theta + linear scaling 2026-02-16 20:22:57 +00:00
Corentin Godeau
1b562d9302 zml/attention: added options for paged_attention 2026-02-16 20:22:57 +00:00
Corentin Godeau
35f184ab66 zml/testing: formatting fix 2026-02-16 20:22:57 +00:00
Corentin Godeau
f6b1c107ff zml/nn: added common rope_theta parameter to rope variants 2026-02-16 20:22:57 +00:00
Corentin Godeau
4f1000cf11 zml/attention: update to latest zml/v2 changes 2026-02-16 20:22:57 +00:00
Corentin Godeau
cdd49268ad zml: added some convenience to paged_attention 2026-02-16 20:21:55 +00:00
Corentin Godeau
c46989654b zml: added ops.scaledDot()
It implements a scaled dot product
2026-02-16 20:21:55 +00:00
Corentin Godeau
4e079c58df zml/testing: Made testlayer take a runtime name 2026-02-16 20:21:55 +00:00
Corentin Godeau
3306cc2b49 zml/nn: Improved Yarn logic 2026-02-16 20:21:55 +00:00
Corentin Godeau
f3333fd65f zml/attention: Re-introduced allocationSize 2026-02-16 20:21:55 +00:00
Corentin Godeau
9b6388079e zml/io: added TensorStore.hasKey() to check key existence
It's a bit hacky since it does an array traversal to see if there is a
match.
2026-02-16 20:21:55 +00:00
Corentin Godeau
b563bbed5e zml/nn: Use higher precision for rmsNorm 2026-02-16 20:21:55 +00:00
Corentin Godeau
b4fd283abe zml/nn: removed commented code 2026-02-16 20:21:55 +00:00
Corentin Godeau
d6ac5ac590 zml/attention: fix wrong causal option 2026-02-16 20:21:55 +00:00
Corentin Godeau
fef994659d third_party/flashattn: bump libflashattn.so 2026-02-16 20:21:55 +00:00
Corentin Godeau
b2d60e0be6 small fixes 2026-02-16 20:21:55 +00:00
Corentin Godeau
6962d13aae flashattn lib override 2026-02-16 20:21:55 +00:00
Corentin Godeau
790dc98384 zml: added simple tracer support back 2026-02-16 20:21:55 +00:00
Corentin Godeau
47132159ae Added paged attention FA3 2026-02-16 20:21:54 +00:00
Corentin Godeau
eb4ab8853a wip: argument baking 2026-02-16 20:21:21 +00:00
Corentin Godeau
aa21c7fa26 wip it works 2026-02-16 20:21:20 +00:00
1100 changed files with 33907 additions and 214134 deletions

11
.gitignore vendored

2073
MODULE.bazel.lock generated

Binary file not shown.

Before

Width:  |  Height:  |  Size: 421 B

Binary file not shown.

Before

Width:  |  Height:  |  Size: 2.1 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 106 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 1.9 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 1.7 KiB

Binary file not shown.

Before

Width:  |  Height:  |  Size: 1.8 KiB

Some files were not shown because too many files have changed in this diff Show more