0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

..

28 commits

Author SHA1 Message Date
Rene Schallner
543a595b52
fixed loader/xferman segfault: wait for load events before deinit buffer_store 2025-03-05 11:02:15 +01:00
Rene Schallner
03b8b0c20a
wip removed extensive logging, fixed examples/loader 2025-03-05 10:35:40 +01:00
Rene Schallner
58fba19018
wip fix dims ptr bug 2025-03-04 23:46:35 +01:00
Rene Schallner
8b7e3757e5
wip: dump pjrt buffer dims, honor metadata offset of safetensors file in mmap2 2025-03-04 22:42:57 +01:00
Rene Schallner
b77181baf2
wip log shape_specs 2025-03-04 22:10:06 +01:00
Rene Schallner
ab704e1137
wip: log device buffer sizes 2025-03-04 21:51:05 +01:00
Steeve Morin
e1ed32d7c2 switch xferman:mmap to bf16, add more logging 2025-03-04 14:14:11 +00:00
Rene Schallner
b799accf78
unfck cuda pjrt plugin build 2025-03-04 13:30:05 +01:00
Rene Schallner
8c2dbc0f9a
xferman/mmap* : auto-select memory kind based on platform 2025-03-04 12:06:09 +01:00
Rene Schallner
e36613421c
rebase on master 2025-03-04 11:32:28 +01:00
Rene Schallner
3d054ba23b
wip repro transfermanager bug 2025-03-04 11:27:14 +01:00
Rene Schallner
8f66015cf9
wip investigating 2025-03-04 11:27:14 +01:00
Rene Schallner
9c77c4fe12
wip checking for overlaps 2025-03-04 11:27:14 +01:00
Rene Schallner
bc80be2298
wip xferman example with mmapped file 2025-03-04 11:27:14 +01:00
Rene Schallner
6a31c2b2b1
wip example with many largish buffers 2025-03-04 11:27:14 +01:00
Rene Schallner
7da626586a
wip, nearly there 2025-03-04 11:27:12 +01:00
Rene Schallner
a94351a1b1
platform.TransferManager.progress() 2025-03-04 11:26:39 +01:00
Rene Schallner
1ae9926770
wip 2025-03-04 11:26:39 +01:00
Rene Schallner
04864f026d
wip TransferManager.transferDataSlices() 2025-03-04 11:26:39 +01:00
Rene Schallner
c1a1363c57
wip fix 2025-03-04 11:26:39 +01:00
Rene Schallner
4c98a10864
wip TransferManager 2025-03-04 11:26:39 +01:00
Rene Schallner
10ae2fd62a
wip 1 buffer 2025-03-04 11:26:39 +01:00
Rene Schallner
3685491953
runs on cpu 2025-03-04 11:26:39 +01:00
Rene Schallner
8a853dab66
wip compiles 2025-03-04 11:26:39 +01:00
Rene Schallner
0a7252931c
more wip 2025-03-04 11:26:39 +01:00
Rene Schallner
7c2c19b2d1
WIP in-progress stuff 2025-03-04 11:26:39 +01:00
Rene Schallner
ce99e228e6
WIP tests pass 2025-03-04 11:26:39 +01:00
Rene Schallner
463b7ed403
WIP bring in TransferManager 2025-03-04 11:26:37 +01:00
1112 changed files with 46903 additions and 231311 deletions

1
.bazelignore Symbolic link

1
.bazelrc Symbolic link

1
.bazelversion Symbolic link

11
.gitignore vendored

1
.nvim.lua Symbolic link

1
.vscode Symbolic link

3705
MODULE.bazel.lock generated

File diff suppressed because one or more lines are too long

Some files were not shown because too many files have changed in this diff Show more