0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

...

21 commits

Author SHA1 Message Date
Rene Schallner
0a4545a6fe
module-cache: increase max_pjrt_executable_size from 200MB to 400MB
Some PJRT executables get really large (e.g. ca. 300MB). We want to
be able to load them.
2024-11-19 16:42:39 +01:00
Corentin Godeau
bf204ede0b zml/module.zig: increase SerializedExecutable size limit
On Neuron, some artifacts can reach more than 100MB.
2024-11-15 17:16:39 +00:00
Corentin Godeau
b3238caf0e zml/platform.zig: increase max device limit 2024-11-15 17:16:39 +00:00
Steeve Morin
b31973f543 workspace: update MODULE.bazel.lock 2024-11-15 18:09:34 +01:00
Steeve Morin
9b3aa02960 runtimes/neuron: switch to rules_distroless apt resolver 2024-11-15 18:09:01 +01:00
Steeve Morin
a42afd4e1d examples,runtimes: add layers for each runtime
Some runtimes require additional layers to be built. This change adds
a generic `layers` filegroup to each runtime. It should be embedded into
OCI images.
2024-11-15 18:08:50 +01:00
Steeve Morin
7f925d1d45 runtimes/neuron: rework neuronx-cc sandboxing
- use codegen for python environment setup
- rework use of runfiles to do that properly
- switch to the script version of the py_binary rule
2024-11-15 18:08:32 +01:00
Steeve Morin
dd8516edb5 runtimes/neuron: add compiler env and flags
Notably:
- `--enable-fast-loading-neuron-binaries
- `--optlevel=1`: 30% speed up in compilation, no performance penalty on llama
- NEURON_RT_STOCHASTIC_ROUNDING_EN=1 for more precision
2024-11-15 18:08:08 +01:00
Steeve Morin
02b616c314 runtimes/neuron: disable pyc precompiling
Given the time it takes to compile, I'm not sure it's worth it.
2024-11-15 18:08:08 +01:00
Corentin Godeau
62776dec67 zml/module.zig: increase loaded module size 2024-11-15 18:08:08 +01:00
Steeve Morin
3b684e3227 zml: rework device assignment when compiling the modul
First, do not copy `DeviceAssignmentProto` but use `@TypeOf` to fetch it.
Then, use a named block to set it inline.
2024-11-15 18:08:08 +01:00
Corentin Godeau
c949ce38ba zml/module: disable donation for Neuron 2024-11-15 18:08:08 +01:00
Corentin Godeau
7aebe0da89 runtimes/neuron: Set required env before Python initialization 2024-11-15 18:08:08 +01:00
Steeve Morin
2c92c18f4c runtimes/neuron: bump requirements 2024-11-15 18:08:05 +01:00
Steeve Morin
003b399a39 +neuron 2024-11-15 18:04:58 +01:00
Steeve Morin
9a052d4aba runtimes/neuron: wchar handling 2024-11-15 18:04:58 +01:00
Steeve Morin
2d0ad45e95 neurontmp 2024-11-15 18:04:58 +01:00
Steeve Morin
aea3726f41 NEURON 2024-11-15 18:04:58 +01:00
Steeve Morin
b1a7c59f3c neuron 2024-11-15 18:04:58 +01:00
Steeve Morin
f85e1b91d6 neuron 2024-11-15 18:04:58 +01:00
Steeve Morin
d942b019d6 neuron 2024-11-15 18:04:58 +01:00
25 changed files with 1874 additions and 797 deletions