0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00
zml/MODULE.bazel.lock

2150 lines
131 KiB

2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2026-02-16 19:59:38 +00:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2025-11-26 17:47:50 +01:00
2026-02-16 19:59:38 +00:00
2024-09-17 11:11:18 +02:00
2026-02-16 19:59:38 +00:00
2025-11-26 17:47:50 +01:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2026-02-16 19:59:38 +00:00
2026-02-16 19:59:38 +00:00
2024-09-17 11:11:18 +02:00
zml/tokenizer: add IREE tokenizer (#416) Adding the [IREE tokenizer](https://github.com/iree-org/iree/blob/main/runtime/src/iree/tokenizer/README.md).Being made from the ground up with streaming (de-)tokenization in mind, I've extended the APIs to expose a `std.Io.Writer` for the tokenization. I've quickly benchmarked IREE's tokenizer vs HuggingFace's one with a request I retrieved from a coding agent (opencode) in the middle of a session. The request body was 360KB encoded in 95K tokens. I also did another test with a similarly sized request with the same results as shown hereafter. I've tested two cases: - oneshot: the template is rendered all at once and only then we encode the whole string. - stream: the template rendering and encoding are pipelined to avoid the intermediate allocation. There is a slight difference in the generated tokens between HuggingFace and IREE. Some tokens like `introdu` were encoded as `i`, `n`, `t`, etc. Decoding them returns the same text. It's very close in terms of total token count: - hf: 95779 - iree/stream: 95705 - iree/oneshot: 95587 | Model | IREE avg (oneshot / stream) ms | HuggingFace avg (ms) | Uplift vs HF (oneshot / stream) | |---|---:|---:|---| | liquidai/LFM2.5-1.2B-Instruct | 8.5 / 7.3 | 40.5 | 4.8x / 5.5x | | Qwen/Qwen3.5-9B | 6.0 / 8.2 | 59.4 | 9.9x / 7.2x | | mistralai/Ministral-3-3B-Reasoning-2512 | 7.4 / 6.9 | 59.2 | 8x / 8.6x | It's unclear why the Qwen's chat template is somehow slower in the stream case, maybe because there are more writes. Adding non-empty buffer in the interface helps a bit, but tends to slow down mistral case. So well --------- Co-authored-by: Corentin Kerisit <corentin.kerisit@gmail.com>
2026-04-07 16:42:55 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2026-01-01 08:47:52 +00:00
platform/intel: bump oneapi=2026.1 and rules_distroless=0.8.0 (#644) # Bump intel oneapi and rules_distroless The Debian package set is now also exposed separately through the rules_distroless APT extension: Now use `rules_distroless` to install the oneAPI packages in a distroless container image. So the platforms/oneapi/packages.lock.json file is now generated from the platforms/oneapi/packages.yaml file, and the packages.yaml file is now the source of truth for the oneAPI packages. The MODULE.bazel contain rules_distroless patch `third_party/rules_distroless/accept-nospace-version-constraints.patch` because the rules_distroless APT extension does not support version constraints with spaces, e.g. `>= 2023.2.0` is not supported, but `>=2023.2.0` is supported. A PR has been submitted to rules_distroless to fix this issue, but until it is merged and released, the patch is needed in zml https://github.com/bazel-contrib/rules_distroless/pull/229. `_ROOT_MODULE_DIRECT_DEPS` does not need anymore to list the individual oneAPI and Ubuntu package repositories. `_ROOT_PACKAGES` is now in `_UBUNTU_PACKAGES` because all the package share the same `_UBUNTU_STRIP_PREFIX` ## Tests ``` bazel run @apt_oneapi//:lock ``` ``` ONEAPI_DEVICE_SELECTOR=level_zero:0 \ bazel run \ --config=release \ --@zml//platforms:cpu=false \ --@zml//platforms:oneapi=true \ //examples/llm -- \ --model=/var/models/meta-llama/Llama-3.1-8B-Instruct \ --topk=4 \ --prompt="Tell me a story about evariste galois" ``` __-> decode 26.248s · 34.9tok/s__ ``` ONEAPI_DEVICE_SELECTOR=level_zero:0,1 \ bazel run \ --config=release \ --@zml//platforms:cpu=false \ --@zml//platforms:oneapi=true \ //examples/llm -- \ --model=/var/models/meta-llama/Llama-3.1-8B-Instruct \ --topk=4 \ --prompt="Tell me a story about evariste galois" ``` __-> decode 13.017s · 56.6tok/s__
2026-07-15 16:21:56 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2026-02-16 19:59:38 +00:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2026-02-16 19:59:38 +00:00
2025-11-26 17:47:50 +01:00
2025-11-26 17:47:50 +01:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2026-02-16 19:59:38 +00:00
2025-11-26 17:47:50 +01:00
2025-11-26 17:47:50 +01:00
2026-02-16 19:59:38 +00:00
2026-02-16 19:59:38 +00:00
2024-09-17 11:11:18 +02:00
2024-09-17 11:11:18 +02:00
2026-01-14 18:08:56 +01:00
workspace: support zig-only local execution (#546) This PR bumps rules_zig back to upstream/main where we now have all the necessary features to enable zig local actions while the reste on remote. It also adds the necessary configurable to actually enable this. Additionally, since rules_zig now ships ZLS support, we remove zls entirely from zml. ### How the Bazel resolution works Bazel resolves execution platforms and toolchains during analysis for each target that requires toolchains. If a rule defines exe, resolution happens separately for the default target execution group and for each `exec_group`; actions assigned to an exec group use that group’s selected execution platform and toolchains. Execution platforms come from an ordered set. In this repository’s remote configuration, the relevant order is: 1. `//:rbe_platform`, supplied by `--extra_execution_platforms=@zml//:rbe_platform` 2. `//bazel/zig_toolchain_config:local_execution_platform`, registered by this PR 3. the host platform, included automatically by Bazel Earlier platforms are selected when they can satisfy the requested toolchains. For each target or exec group, Bazel takes the required toolchain types, the target platform, the ordered execution platforms, and the ordered registered toolchains. It filters execution platforms by execution constraints, then tries to find a matching toolchain for every required toolchain type. A toolchain matches when: - its `exec_compatible_with` constraints are present on the candidate execution platform - its `target_compatible_with` constraints are present on the target platform - its `target_settings` match the current configuration Any execution platform missing a required toolchain is rejected. The first remaining execution platform wins, and the first matching toolchain for each type is selected. ### How this makes Zig local-only This PR defines a custom execution constraint: - `//bazel/zig_toolchain_config:local_zig_execution` It then defines a host-derived execution platform: - `//bazel/zig_toolchain_config:local_execution_platform` That platform inherits the host OS/CPU constraints from `@platforms//host`, adds `local_zig_execution`, and sets: ```starlark exec_properties = { "no-remote-exec": "1", } ``` The zig.toolchain(...) module extension call now passes: extra_exec_compatible_with = ["//bazel/zig_toolchain_config:local_zig_execution"] rules_zig appends that extra execution constraint to every generated Zig SDK toolchain. As a result, when rules_zig resolves @rules_zig//zig:toolchain_type for its zig execution group: - the remote execution platform is considered first, but it does not have local_zig_execution, so it cannot match the Zig SDK toolchain - the custom local execution platform has both the host OS/CPU constraints and local_zig_execution, so it matches - the selected platform carries no-remote-exec, so Zig actions execute locally even in remote builds Other toolchains are not constrained by local_zig_execution, so they can continue to resolve to the remote execution platform first. This keeps the build remote by default while carving out Zig actions as local-only. --------- Co-authored-by: Steeve Morin <steeve@zml.ai>
2026-05-20 16:13:59 +02:00
workspace: support zig-only local execution (#546) This PR bumps rules_zig back to upstream/main where we now have all the necessary features to enable zig local actions while the reste on remote. It also adds the necessary configurable to actually enable this. Additionally, since rules_zig now ships ZLS support, we remove zls entirely from zml. ### How the Bazel resolution works Bazel resolves execution platforms and toolchains during analysis for each target that requires toolchains. If a rule defines exe, resolution happens separately for the default target execution group and for each `exec_group`; actions assigned to an exec group use that group’s selected execution platform and toolchains. Execution platforms come from an ordered set. In this repository’s remote configuration, the relevant order is: 1. `//:rbe_platform`, supplied by `--extra_execution_platforms=@zml//:rbe_platform` 2. `//bazel/zig_toolchain_config:local_execution_platform`, registered by this PR 3. the host platform, included automatically by Bazel Earlier platforms are selected when they can satisfy the requested toolchains. For each target or exec group, Bazel takes the required toolchain types, the target platform, the ordered execution platforms, and the ordered registered toolchains. It filters execution platforms by execution constraints, then tries to find a matching toolchain for every required toolchain type. A toolchain matches when: - its `exec_compatible_with` constraints are present on the candidate execution platform - its `target_compatible_with` constraints are present on the target platform - its `target_settings` match the current configuration Any execution platform missing a required toolchain is rejected. The first remaining execution platform wins, and the first matching toolchain for each type is selected. ### How this makes Zig local-only This PR defines a custom execution constraint: - `//bazel/zig_toolchain_config:local_zig_execution` It then defines a host-derived execution platform: - `//bazel/zig_toolchain_config:local_execution_platform` That platform inherits the host OS/CPU constraints from `@platforms//host`, adds `local_zig_execution`, and sets: ```starlark exec_properties = { "no-remote-exec": "1", } ``` The zig.toolchain(...) module extension call now passes: extra_exec_compatible_with = ["//bazel/zig_toolchain_config:local_zig_execution"] rules_zig appends that extra execution constraint to every generated Zig SDK toolchain. As a result, when rules_zig resolves @rules_zig//zig:toolchain_type for its zig execution group: - the remote execution platform is considered first, but it does not have local_zig_execution, so it cannot match the Zig SDK toolchain - the custom local execution platform has both the host OS/CPU constraints and local_zig_execution, so it matches - the selected platform carries no-remote-exec, so Zig actions execute locally even in remote builds Other toolchains are not constrained by local_zig_execution, so they can continue to resolve to the remote execution platform first. This keeps the build remote by default while carving out Zig actions as local-only. --------- Co-authored-by: Steeve Morin <steeve@zml.ai>
2026-05-20 16:13:59 +02:00
workspace: support zig-only local execution (#546) This PR bumps rules_zig back to upstream/main where we now have all the necessary features to enable zig local actions while the reste on remote. It also adds the necessary configurable to actually enable this. Additionally, since rules_zig now ships ZLS support, we remove zls entirely from zml. ### How the Bazel resolution works Bazel resolves execution platforms and toolchains during analysis for each target that requires toolchains. If a rule defines exe, resolution happens separately for the default target execution group and for each `exec_group`; actions assigned to an exec group use that group’s selected execution platform and toolchains. Execution platforms come from an ordered set. In this repository’s remote configuration, the relevant order is: 1. `//:rbe_platform`, supplied by `--extra_execution_platforms=@zml//:rbe_platform` 2. `//bazel/zig_toolchain_config:local_execution_platform`, registered by this PR 3. the host platform, included automatically by Bazel Earlier platforms are selected when they can satisfy the requested toolchains. For each target or exec group, Bazel takes the required toolchain types, the target platform, the ordered execution platforms, and the ordered registered toolchains. It filters execution platforms by execution constraints, then tries to find a matching toolchain for every required toolchain type. A toolchain matches when: - its `exec_compatible_with` constraints are present on the candidate execution platform - its `target_compatible_with` constraints are present on the target platform - its `target_settings` match the current configuration Any execution platform missing a required toolchain is rejected. The first remaining execution platform wins, and the first matching toolchain for each type is selected. ### How this makes Zig local-only This PR defines a custom execution constraint: - `//bazel/zig_toolchain_config:local_zig_execution` It then defines a host-derived execution platform: - `//bazel/zig_toolchain_config:local_execution_platform` That platform inherits the host OS/CPU constraints from `@platforms//host`, adds `local_zig_execution`, and sets: ```starlark exec_properties = { "no-remote-exec": "1", } ``` The zig.toolchain(...) module extension call now passes: extra_exec_compatible_with = ["//bazel/zig_toolchain_config:local_zig_execution"] rules_zig appends that extra execution constraint to every generated Zig SDK toolchain. As a result, when rules_zig resolves @rules_zig//zig:toolchain_type for its zig execution group: - the remote execution platform is considered first, but it does not have local_zig_execution, so it cannot match the Zig SDK toolchain - the custom local execution platform has both the host OS/CPU constraints and local_zig_execution, so it matches - the selected platform carries no-remote-exec, so Zig actions execute locally even in remote builds Other toolchains are not constrained by local_zig_execution, so they can continue to resolve to the remote execution platform first. This keeps the build remote by default while carving out Zig actions as local-only. --------- Co-authored-by: Steeve Morin <steeve@zml.ai>
2026-05-20 16:13:59 +02:00
platform/intel: bump oneapi=2026.1 and rules_distroless=0.8.0 (#644) # Bump intel oneapi and rules_distroless The Debian package set is now also exposed separately through the rules_distroless APT extension: Now use `rules_distroless` to install the oneAPI packages in a distroless container image. So the platforms/oneapi/packages.lock.json file is now generated from the platforms/oneapi/packages.yaml file, and the packages.yaml file is now the source of truth for the oneAPI packages. The MODULE.bazel contain rules_distroless patch `third_party/rules_distroless/accept-nospace-version-constraints.patch` because the rules_distroless APT extension does not support version constraints with spaces, e.g. `>= 2023.2.0` is not supported, but `>=2023.2.0` is supported. A PR has been submitted to rules_distroless to fix this issue, but until it is merged and released, the patch is needed in zml https://github.com/bazel-contrib/rules_distroless/pull/229. `_ROOT_MODULE_DIRECT_DEPS` does not need anymore to list the individual oneAPI and Ubuntu package repositories. `_ROOT_PACKAGES` is now in `_UBUNTU_PACKAGES` because all the package share the same `_UBUNTU_STRIP_PREFIX` ## Tests ``` bazel run @apt_oneapi//:lock ``` ``` ONEAPI_DEVICE_SELECTOR=level_zero:0 \ bazel run \ --config=release \ --@zml//platforms:cpu=false \ --@zml//platforms:oneapi=true \ //examples/llm -- \ --model=/var/models/meta-llama/Llama-3.1-8B-Instruct \ --topk=4 \ --prompt="Tell me a story about evariste galois" ``` __-> decode 26.248s · 34.9tok/s__ ``` ONEAPI_DEVICE_SELECTOR=level_zero:0,1 \ bazel run \ --config=release \ --@zml//platforms:cpu=false \ --@zml//platforms:oneapi=true \ //examples/llm -- \ --model=/var/models/meta-llama/Llama-3.1-8B-Instruct \ --topk=4 \ --prompt="Tell me a story about evariste galois" ``` __-> decode 13.017s · 56.6tok/s__
2026-07-15 16:21:56 +02:00
2026-01-14 18:08:56 +01:00
2024-09-17 11:11:18 +02:00