ggml-org/llama.cpp: b10694
rpc : fix pre-rdma macOS versions (#27815) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/43962220 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI…
Daily edition · AI
TILens turns technical updates into a focused daily brief: official releases, trusted reporting, and practitioner analysis, deduplicated and organized by topic.
rpc : fix pre-rdma macOS versions (#27815) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/43962220 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI…
hexagon: support for device discovery and create sessions on demand (#27785) hex-devices: add support for lazy session allocation and cleanup dev interfaces Co-authored-by: Marco Colombo mcolombo@qti.qualcomm.com…
sycl: split long rows in TOP_K instead of one work-group per row (#27847) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/43958406 macOS/iOS: macOS Apple Silicon (arm64) macOS…
metal : fix null-pipeline crash for F16 src1 mul_mat/mul_mat_id (#25648) metal : fail closed on mul_mat shapes with missing F16 kernels metal : abort on nil pipeline in encoder_set_pipeline metal : address review…
memory : copy Hadamard matrix to k_rot tensor only if it has buffer assigned to prevent crashes during context shift of unquantized K cache (#27967) Co-authored-by: Stanisław Szymczyk sszymczy@gmail.com Co-authored-by:…
Summary I reviewed the patch before submission and understand the change as a fix to the forward-AD fast-mode diagnostic path, not the normal gradcheck computation. The technical summary and test notes below were…
This PR is auto-generated nightly by this action. Update the pinned torchcomms hash. Pull Request resolved: #195084 Approved by: https://github.com/pytorchbot
This PR is auto-generated nightly by this action. Update the pinned torchcomms hash. Pull Request resolved: #195084 Approved by: https://github.com/pytorchbot
This PR is auto-generated nightly by this action. Update the pinned torchtitan hash. Pull Request resolved: #194670 Approved by: https://github.com/pytorchbot
This PR is auto-generated nightly by this action. Update the pinned vision hash. Pull Request resolved: #195085 Approved by: https://github.com/pytorchbot
This PR is auto-generated nightly by this action. Update the pinned vllm hash. Pull Request resolved: #194967 Approved by: https://github.com/pytorchbot
This PR is auto-generated nightly by this action. Updates the Metamates merge rule with active team members. Pull Request resolved: #195237 Approved by: https://github.com/pytorchbot
This PR is auto-generated nightly by this action. Updates the Metamates merge rule with active team members. Pull Request resolved: #195237 Approved by: https://github.com/pytorchbot
ggml: allow passing alloc dependencies in graph_optimize (#27301) ggml: allow passing alloc dependencies in graph_optimize add alloc dep tests add TODO about using flat array Website: https://llama.app Attestations:…
Summary Adds a dedicated CUDA backward kernel for avg_pool2d when the pooling windows tile the input exactly (stride == kernel_size, no padding, no ceil_mode) -- the common downsampling case such as avg_pool2d(2, 2). In…
Summary Adds a dedicated CUDA backward kernel for avg_pool2d when the pooling windows tile the input exactly (stride == kernel_size, no padding, no ceil_mode) -- the common downsampling case such as avg_pool2d(2, 2). In…
When a dispatch/combine tensor is backed by NCCLSymmetricMemory registered under the process group's name, address it via the registered ncclWindow + offset (RDMA zero-copy path) instead of a plain device pointer,…
Add parameter-contiguous all-gather (symm_mem.all_gather_offset) (#18…
Add parameter-contiguous all-gather (symm_mem.all_gather_offset) (#18…
metal : add fa-vec tunings for M2 (#27940) Website: https://llama.app Attestations: https://github.com/ggml-org/llama.cpp/attestations/43902029 macOS/iOS: macOS Apple Silicon (arm64) macOS Apple Silicon (arm64, KleidiAI…
Showing 1 day · 25 items available