0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00
Commit graph

219 commits

Author SHA1 Message Date
Raphael NAHOUM
9b7e2caea3 rename shift to circular and update comment 2026-02-23 11:38:34 +01:00
Raphael NAHOUM
9f98b994f0 merge step functions 2026-02-23 11:29:37 +01:00
Raphael NAHOUM
69c2ac8f3c replace deprecated function 2026-02-23 11:17:20 +01:00
Raphael NAHOUM
e59325497b centralize into sp 2026-02-23 11:15:29 +01:00
Raphael NAHOUM
110c6dab71 start to comment code 2026-02-23 11:11:38 +01:00
Raphael NAHOUM
d08fe92634 remove explicit right padding and prefill reflective padding 2026-02-20 18:37:54 +01:00
Raphael NAHOUM
6d0794ad66 inline mel prefill and rename prompt tokens 2026-02-20 17:04:15 +01:00
Raphael NAHOUM
6cd9781f50 one func for prefill and loop 2026-02-20 16:45:31 +01:00
Raphael NAHOUM
fe7bffd606 remove unused old code 2026-02-20 16:10:15 +01:00
Raphael NAHOUM
6eb4288593 move swiglu to common 2026-02-20 15:46:34 +01:00
Raphael NAHOUM
a4b0fa9706 remove padding and change convert position 2026-02-20 15:19:35 +01:00
Raphael NAHOUM
a21811927f opti step 1 2026-02-20 15:13:17 +01:00
Raphael NAHOUM
0bbd034724 shift and circular implem 2026-02-20 14:24:43 +01:00
Raphael NAHOUM
231dcfb540 Shift kv cache 2026-02-19 18:00:44 +01:00
Raphael NAHOUM
ff7128ac30 remove unused old code 2026-02-19 16:37:11 +01:00
Raphael NAHOUM
5029738105 from mel history to state tensors 2026-02-18 18:36:38 +01:00
Raphael NAHOUM
9c8d401393 make kv cache sequential but keep experimental circular 2026-02-18 12:35:21 +01:00
Raphael NAHOUM
f8f94ec302 remove unused code 2026-02-18 11:51:22 +01:00
Raphael NAHOUM
eecb9139f9 isolate terminalwave code 2026-02-18 11:28:01 +01:00
Raphael NAHOUM
65b4ab10db start of cleanup 2026-02-18 11:13:59 +01:00
Raphael NAHOUM
facfe51ba0 force temperature and experimental reordering of cicular buffer 2026-02-17 16:31:38 +01:00
Raphael NAHOUM
719b2ee347 Add terminalwave 2026-02-17 16:06:09 +01:00
Raphael NAHOUM
9a69d1bd7b add sliding window 2026-02-17 14:42:03 +01:00
Raphael NAHOUM
908a97a7ea correct audio shift 2026-02-17 14:28:14 +01:00
Raphael NAHOUM
87852ac75e good prefill and log information 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
b5897a127c start reading stdin (wrong prefill) 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
d018298cb1 test mel specto chunks 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
0035ce2ed1 args derived kvcache size + metrics 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
f43fff4f88 remove forwardstep 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
946421c6d8 fix new zig and disable vfs for now 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
394a5e59e8 divide runPipeline into 3 parts 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
ee0644c6a9 store params in a struct 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
3002cc985c step conv stem + prefill 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
cc06ee95b8 encoder uses attention directly as well 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
81effa4e40 support diff len input 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
8338a2fe15 start of paper match 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
b14e898a80 use sampleTokens 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
ea56f50ee8 inline embedder into decoder 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
bccd580635 Remove hardcoded dsf and pad encoder output instead of truncating after 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
93f0f67133 Remove hardcoded values 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
eb6d66e0a8 better naming and formatting 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
c3f9e1ecc2 Some cleanup 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
f2d79dfcb9 decode loop test 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
f5b9372bbe test embedder 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
3f5e00564f Pad audio 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
1a9688e662 First decode try 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
cf5d01a5ea Change acceptable error 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
3e32eb2063 Load embedder and decoder weights 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
e4d80948de Remove hardcoded values and read from config 2026-02-17 14:27:51 +01:00
Raphael NAHOUM
ff0e3ba39a Add embedder, compile every model and load weights 2026-02-17 14:27:51 +01:00