mirror of
https://github.com/zml/zml.git
synced 2026-11-16 19:11:09 +00:00
MOE API currently relies on input sharding metadata or partitioning choices made inside backend kernels. Ordinary graph operations can leave that metadata unspecified, making the resulting sharding depend on the backend and preceding operations. Move the manual computation boundary into the shared `zml.kernels.moe.forwardMoe` API using `manualComputation2`. Callers provide a logical mesh and typed input/output partitioning specs. |
History
|
|
|---|---|---|
| .. | ||
| benchmark | ||
| io | ||
| llm | ||
| mnist | ||
| sharding | ||