mirror of
https://github.com/zml/zml.git
synced 2026-11-16 19:11:09 +00:00
CPU buffers behave differently from Cuda/Rocm/TPU buffers, and in particular they are addressable from main memory. This was annoying and prevented us to add some safety checks that weren't valid for CPU. I'm adding a tag to buffers so that we know which target they refer to. Also there is a bug in PJRT unitialized which doesn't respected the memory. I've opened https://github.com/openxla/xla/pull/31292 but in the meantime I've a workaround in ZML that uses the regular .fromHostBuffer. (I've also a patched version of PJRT plugins in https://github.com/zml/pjrt-artifacts/pull/41 but not merged yet) |
History
|
|
|---|---|---|
| .. | ||
| add_weights.md | ||
| deploy_on_server.md | ||
| dockerize_models.md | ||
| howto_torch2zml.md | ||
| huggingface_access_token.md | ||