[Perf][Kernel] Adopt PTX 9.4 `ldmatrix.s8.s4` (hardware INT4→INT8 expanding load) in W4A8-INT8 paths
PTX ISA 9.4 (CUDA 13.4.0 Developer Preview) exposes a new ldmatrix variant that performs in-flight sign extension of packed INT4 to INT8 during the shared-memory matrix load: Source data is densely packed signed 4-bit elements; the hardware expands them to signed 8-bit values in the destination fragment. This can elim…
vllm-project/vllm
Eligibility
Check before you begin
For students with basic Git skills who can follow the repository contribution guide; confirm with maintainers before starting.
What you will practice
Related skills
The source does not list specific skills yet. Read the original page before deciding.
Source and verification
Where this information comes from
Keep exploring
Items in the same direction
5 new ways to level up your learning with Search
Here’s how you can use Google Search tools to study for classes and standardized tests.
Get closer to the game with Gemini and Pixel
Google Gemini and Pixel partner with five global football clubs to elevate the fan matchday experience through AI and Smartphone Technology.
AMIE, our research medical AI system, demonstrates real-time clinical video consultation capabilities in a first-of-its-kind study.
Google introduces AMIE for real-time clinical video consultations in simulated settings.
Expanding Managed Agents in Gemini API: background tasks, remote MCP and more
We’re announcing new capabilities in Managed Agents in Gemini API so developers can build reliable, production-ready agents.