0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

...

28 commits

Author SHA1 Message Date
Rene Schallner
543a595b52
fixed loader/xferman segfault: wait for load events before deinit buffer_store 2025-03-05 11:02:15 +01:00
Rene Schallner
03b8b0c20a
wip removed extensive logging, fixed examples/loader 2025-03-05 10:35:40 +01:00
Rene Schallner
58fba19018
wip fix dims ptr bug 2025-03-04 23:46:35 +01:00
Rene Schallner
8b7e3757e5
wip: dump pjrt buffer dims, honor metadata offset of safetensors file in mmap2 2025-03-04 22:42:57 +01:00
Rene Schallner
b77181baf2
wip log shape_specs 2025-03-04 22:10:06 +01:00
Rene Schallner
ab704e1137
wip: log device buffer sizes 2025-03-04 21:51:05 +01:00
Steeve Morin
e1ed32d7c2 switch xferman:mmap to bf16, add more logging 2025-03-04 14:14:11 +00:00
Rene Schallner
b799accf78
unfck cuda pjrt plugin build 2025-03-04 13:30:05 +01:00
Rene Schallner
8c2dbc0f9a
xferman/mmap* : auto-select memory kind based on platform 2025-03-04 12:06:09 +01:00
Rene Schallner
e36613421c
rebase on master 2025-03-04 11:32:28 +01:00
Rene Schallner
3d054ba23b
wip repro transfermanager bug 2025-03-04 11:27:14 +01:00
Rene Schallner
8f66015cf9
wip investigating 2025-03-04 11:27:14 +01:00
Rene Schallner
9c77c4fe12
wip checking for overlaps 2025-03-04 11:27:14 +01:00
Rene Schallner
bc80be2298
wip xferman example with mmapped file 2025-03-04 11:27:14 +01:00
Rene Schallner
6a31c2b2b1
wip example with many largish buffers 2025-03-04 11:27:14 +01:00
Rene Schallner
7da626586a
wip, nearly there 2025-03-04 11:27:12 +01:00
Rene Schallner
a94351a1b1
platform.TransferManager.progress() 2025-03-04 11:26:39 +01:00
Rene Schallner
1ae9926770
wip 2025-03-04 11:26:39 +01:00
Rene Schallner
04864f026d
wip TransferManager.transferDataSlices() 2025-03-04 11:26:39 +01:00
Rene Schallner
c1a1363c57
wip fix 2025-03-04 11:26:39 +01:00
Rene Schallner
4c98a10864
wip TransferManager 2025-03-04 11:26:39 +01:00
Rene Schallner
10ae2fd62a
wip 1 buffer 2025-03-04 11:26:39 +01:00
Rene Schallner
3685491953
runs on cpu 2025-03-04 11:26:39 +01:00
Rene Schallner
8a853dab66
wip compiles 2025-03-04 11:26:39 +01:00
Rene Schallner
0a7252931c
more wip 2025-03-04 11:26:39 +01:00
Rene Schallner
7c2c19b2d1
WIP in-progress stuff 2025-03-04 11:26:39 +01:00
Rene Schallner
ce99e228e6
WIP tests pass 2025-03-04 11:26:39 +01:00
Rene Schallner
463b7ed403
WIP bring in TransferManager 2025-03-04 11:26:37 +01:00
28 changed files with 1911 additions and 6835 deletions