ggml-org/llama.cpp: b10687
opencl: use a better matmul path on two Adreno GPU generations (#27640) opencl: default the Adreno xmem F16xF32 GEMM on for X2E kernel_mul_mm_f16_f32_l4_lm is the slowest matmul this backend has on Adreno: on the X2-90…
Daily edition · AI Tools
TILens turns technical updates into a focused daily brief: official releases, trusted reporting, and practitioner analysis, deduplicated and organized by topic.
opencl: use a better matmul path on two Adreno GPU generations (#27640) opencl: default the Adreno xmem F16xF32 GEMM on for X2E kernel_mul_mm_f16_f32_l4_lm is the slowest matmul this backend has on Adreno: on the X2-90…
[MPS] Add complex64 support to linalg.lu_factor (unblocks complex det…
Triton reports fp16 and bf16 scalar arguments as distinct 16-bit types, but the static launcher mapped both to the 32-bit float ABI code. CUDA and HIP therefore wrote four-byte values into slots that kernels read as…
metal : assert shared memory padding (#27951) metal : assert shared memory padding cont : add ref Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/43867822 macOS/iOS: macOS…
[BE] Skip bmm_shared_a autotune tests when Triton is unavailable (#19…
metal : add remaining fa-vec tunings for M4 Pro (#27915) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/43865923 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon…
sycl: make --fit respect --fit-target better (#27629) improve the --fit algorithm to take into account the actual peak required VRAM for a given context size on a SYCL backend. This includes both properly accounting for…
[pipelining] Annotate schedule actions with mark_kernels for CUDA gra…
[pipelining] Annotate schedule actions with mark_kernels for CUDA gra…
vulkan: combine duplicated fastdiv functions, rename the one optimizing small divs (#27526) vulkan: combine duplicated fastdiv functions, rename the one optimizing small divs remove one more fastdiv Website:…
metal : add fa-vec tunings for M1 Max (#27932) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/43859747 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64,…
vulkan: Change mul_mat_id to pad K rather than N (#27925) The N padding is needed for mul_mat, but not mul_mat_id. For mul_mat_id, we indirect the row index through a shared memory lookup table which avoids any OOB row…
[ROCm] Guard native BMM outer-product launches against the HIP work-i…
[ROCm] Guard native BMM outer-product launches against the HIP work-i…
Fixes #187988 What linear() accepts a 1-D weight (shape [in_features]): it contracts and drops the last input dimension. mps_linear (forward) already handles this by unsqueezing the weight to [1, in_features]. The…
Fixes #187988 What linear() accepts a 1-D weight (shape [in_features]): it contracts and drops the last input dimension. mps_linear (forward) already handles this by unsqueezing the weight to [1, in_features]. The…
This reverts commit 4078ac4. Reverted #192281 on behalf of https://github.com/pytorch-auto-revert due to Reverted automatically by pytorch's autorevert, to avoid this behaviour add the tag autorevert: disable (comment)
Revert "[distributed] Warn pipeline users about eager NCCL communicat…
This change was prepared with AI assistance and reviewed by a human. MultiProcessTestCase workers inherit LOCAL_RANK from their parent process. A stale value can cause eager NCCL2 initialization to bind every worker to…
Summary: For fbcode AOTI CPU packages, compile the generated sources twice: once against libstdc++ under the existing name, and once against the private __aoti libc++ as _abicompat.so. Both embed the same weights and…
Showing 1 day · 41 items available