0
Fork 0
mirror of https://github.com/zml/zml.git synced 2026-11-16 19:11:09 +00:00
Commit graph

18 commits

Author SHA1 Message Date
Damien Mehala
47e692c300
platforms/oneapi: bump to IGC 2.41.15 (#996)
Bump to resolve a compiler bug encountered on LFM3.

LFM3 broadcasts one sigmoid gate per attention head. This generated code
of sigmoid introduced a BF16 conversion and conditional select. The
compiler then lower it to a scalar computation which had a
register-aligment bug. The fix introduced in 2.41.11
<5d92530a07>
enforces alignment.
2026-10-29 11:15:39 +01:00
Benjamin Rabier
773fb8f2f3
platforms/oneapi: update latest pjrt artifact (#883) 2026-10-02 22:30:34 +02:00
Benjamin Rabier
4d6c61f595
platforms/oneapi: update pjrt plugin (#877) 2026-09-30 19:24:34 +02:00
Steeve Morin
9b7d8fb58c bazel: rework zig_options to be config_settting compatible
zig_option can now take a `flag` dependency to expose existing flags or
`bool`, `int or `string` for config_setting flags
2026-09-24 22:21:44 +02:00
Benjamin Rabier
cabcdd8f59
platforms/oneapi: Use latest pjrt artifact (#855) 2026-09-24 20:13:04 +02:00
Steeve Morin
6de80971d2 platforms/oneapi: add missing header in oneapi target 2026-09-16 21:53:11 +02:00
Steeve Morin
df3a43d29f
bazel: add zig_options rule (#820)
Introduce `zig_option` and `zig_options` rules to generate the bazel
equivalent of option modules plugged on bazel flags.

On `string` flags, if the flag has a `allowed_values`, the `string` is
converted into a `enum` in zig code.

Also, port platforms to this and remove the ugly `defines` hack to
comptime test for platforms enablement.

In the process, port `arocc` to the `zig_options`.
2026-09-16 21:50:22 +02:00
Hugo Mano
0ebb0c21a9 platforms: bump plugins for CPU, ROCm, CUDA and Metal (#788) 2026-09-10 14:34:40 +00:00
Kevin Barre
bb860a050b
platforms/oneapi: bundle oneDNN and TBB with PJRT update PJRT_ONEAPI_RELEASE (#706)
platforms/oneapi: bundle oneDNN and TBB with PJRT
Add oneDNN 2026.0 and TBB 2023.1 to the hermetic oneAPI packages.
the pjrj plugin need it for the mistral models type with the support of
the FP8 scaled matmul with libdnn.

platforms/oneapi: update PJRT_ONEAPI_RELEASE and SHA256 for new artifact
version
2026-08-18 09:56:05 +02:00
Benjamin Rabier
9c38bad5be
platforms/oneapi: update pjrt artifact with collectives fixes (#666) 2026-07-17 22:23:57 +02:00
Benjamin Rabier
f29ed52ea8
platforms/oneapi: 4 GPUs fixes (#661)
Co-authored-by: Kevin Barre <kevin@zml.ai>
2026-07-17 11:18:53 +02:00
Kevin Barre
24165146b9
platform/intel: bump oneapi=2026.1 and rules_distroless=0.8.0 (#644)
# Bump intel oneapi and rules_distroless

The Debian package set is now also exposed separately through the
rules_distroless APT extension:

Now use `rules_distroless` to install the oneAPI packages in a
distroless container image.

So the platforms/oneapi/packages.lock.json file is now generated from
the platforms/oneapi/packages.yaml file, and the packages.yaml file is
now the source of truth for the oneAPI packages.

The MODULE.bazel contain rules_distroless patch
`third_party/rules_distroless/accept-nospace-version-constraints.patch`
because the rules_distroless APT extension does not support version
constraints with spaces, e.g. `>= 2023.2.0` is not supported, but
`>=2023.2.0` is supported.

A PR has been submitted to rules_distroless to fix this issue, but until
it is merged and released, the patch is needed in zml
https://github.com/bazel-contrib/rules_distroless/pull/229.

`_ROOT_MODULE_DIRECT_DEPS` does not need anymore to list the individual
oneAPI and Ubuntu package repositories.

`_ROOT_PACKAGES` is now in `_UBUNTU_PACKAGES` because all the package
share the same `_UBUNTU_STRIP_PREFIX`

## Tests

```
bazel run @apt_oneapi//:lock
```

```
ONEAPI_DEVICE_SELECTOR=level_zero:0 \
    bazel run  \
    --config=release  \
    --@zml//platforms:cpu=false  \
    --@zml//platforms:oneapi=true   \
    //examples/llm --  \
    --model=/var/models/meta-llama/Llama-3.1-8B-Instruct  \
    --topk=4  \
    --prompt="Tell me a story about evariste galois"
```

__-> decode 26.248s · 34.9tok/s__

```
ONEAPI_DEVICE_SELECTOR=level_zero:0,1 \
    bazel run  \
    --config=release  \
    --@zml//platforms:cpu=false  \
    --@zml//platforms:oneapi=true   \
    //examples/llm --  \
    --model=/var/models/meta-llama/Llama-3.1-8B-Instruct  \
    --topk=4  \
    --prompt="Tell me a story about evariste galois"
```

__-> decode 13.017s · 56.6tok/s__
2026-07-15 16:21:56 +02:00
Hugo Mano
5cacbe606e
platforms/intel: full hermetic sandboxing (#638)
Needed sandboxing for SDK less and distroless OCI image

---------

Co-authored-by: Kevin Barre <kevin@zml.ai>
2026-07-08 12:02:28 +02:00
Kevin Barre
73cbeca7cf
platform/intel: update intel pjrt and limit the intel device to 2 (#628) 2026-07-03 17:02:23 +02:00
Hugo Mano
833f42029d
platforms: bump cpu + cuda plugins and align xla (#626)
Related PR: https://github.com/zml/monorepo/pull/304
2026-07-03 14:22:23 +02:00
Kevin Barre
a1acbd36d5
zml/onapi: set defaults for oneAPI PjRT create options (#592)
same as https://github.com/zml/zml/pull/579
And update the pjrt plugin with the collective fix
2026-06-23 05:41:40 +02:00
Kevin Barre
4cd7139477
zml/platform: add hermetic oneAPI 2026 runtime deps (#582)
Fetch oneAPI runtime libraries from locked DEB packages and wire the oneAPI sandbox packaging to use those repositories.
2026-06-19 18:30:57 +02:00
Kevin Barre
73fab92393
zml/platforms: add experimental oneapi (intel) (#550)
Add experimental Intel GPU backend

Add oneAPI as a ZML platform target with Bazel flags, module extension
repositories, and PJRT runtime packaging for Linux Intel GPUs.

- package libpjrt_oneapi with oneAPI runtime libraries, Level Zero
loader,
  libsycl, and a zmlxoneapi dlopen shim for versioned shared libraries
- register the oneAPI platform loader and detect available render
devices
  before loading the packaged PJRT plugin from runfiles
- thread the oneAPI target through platform selection, sharding,
placement,
  buffers, execution, memory, IO, tensor behavior, and XLA compile flags
- document oneAPI prerequisites and example LLM usage
- update Bazel module lockfile entries for the new runtime dependencies

---------

Co-authored-by: Steeve Morin <steeve@zml.ai>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Steeve Morin <steeve@9960x-b70x2.tailb57cfe.ts.net>
2026-05-25 15:52:10 +02:00