0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00

Compare commits

..

21 commits

Author SHA1 Message Date
Rene Schallner
0a4545a6fe
module-cache: increase max_pjrt_executable_size from 200MB to 400MB
Some PJRT executables get really large (e.g. ca. 300MB). We want to
be able to load them.
2024-11-19 16:42:39 +01:00
Corentin Godeau
bf204ede0b zml/module.zig: increase SerializedExecutable size limit
On Neuron, some artifacts can reach more than 100MB.
2024-11-15 17:16:39 +00:00
Corentin Godeau
b3238caf0e zml/platform.zig: increase max device limit 2024-11-15 17:16:39 +00:00
Steeve Morin
b31973f543 workspace: update MODULE.bazel.lock 2024-11-15 18:09:34 +01:00
Steeve Morin
9b3aa02960 runtimes/neuron: switch to rules_distroless apt resolver 2024-11-15 18:09:01 +01:00
Steeve Morin
a42afd4e1d examples,runtimes: add layers for each runtime
Some runtimes require additional layers to be built. This change adds
a generic `layers` filegroup to each runtime. It should be embedded into
OCI images.
2024-11-15 18:08:50 +01:00
Steeve Morin
7f925d1d45 runtimes/neuron: rework neuronx-cc sandboxing
- use codegen for python environment setup
- rework use of runfiles to do that properly
- switch to the script version of the py_binary rule
2024-11-15 18:08:32 +01:00
Steeve Morin
dd8516edb5 runtimes/neuron: add compiler env and flags
Notably:
- `--enable-fast-loading-neuron-binaries
- `--optlevel=1`: 30% speed up in compilation, no performance penalty on llama
- NEURON_RT_STOCHASTIC_ROUNDING_EN=1 for more precision
2024-11-15 18:08:08 +01:00
Steeve Morin
02b616c314 runtimes/neuron: disable pyc precompiling
Given the time it takes to compile, I'm not sure it's worth it.
2024-11-15 18:08:08 +01:00
Corentin Godeau
62776dec67 zml/module.zig: increase loaded module size 2024-11-15 18:08:08 +01:00
Steeve Morin
3b684e3227 zml: rework device assignment when compiling the modul
First, do not copy `DeviceAssignmentProto` but use `@TypeOf` to fetch it.
Then, use a named block to set it inline.
2024-11-15 18:08:08 +01:00
Corentin Godeau
c949ce38ba zml/module: disable donation for Neuron 2024-11-15 18:08:08 +01:00
Corentin Godeau
7aebe0da89 runtimes/neuron: Set required env before Python initialization 2024-11-15 18:08:08 +01:00
Steeve Morin
2c92c18f4c runtimes/neuron: bump requirements 2024-11-15 18:08:05 +01:00
Steeve Morin
003b399a39 +neuron 2024-11-15 18:04:58 +01:00
Steeve Morin
9a052d4aba runtimes/neuron: wchar handling 2024-11-15 18:04:58 +01:00
Steeve Morin
2d0ad45e95 neurontmp 2024-11-15 18:04:58 +01:00
Steeve Morin
aea3726f41 NEURON 2024-11-15 18:04:58 +01:00
Steeve Morin
b1a7c59f3c neuron 2024-11-15 18:04:58 +01:00
Steeve Morin
f85e1b91d6 neuron 2024-11-15 18:04:58 +01:00
Steeve Morin
d942b019d6 neuron 2024-11-15 18:04:58 +01:00
975 changed files with 41672 additions and 234436 deletions

1
.bazelignore Symbolic link

1
.bazelrc Symbolic link

1
.bazelversion Symbolic link

14
.gitignore vendored

1
.nvim.lua Symbolic link

1
.vscode Symbolic link

2933
MODULE.bazel.lock generated

File diff suppressed because it is too large Load diff

Some files were not shown because too many files have changed in this diff Show more