high performance computing on graphics processing units: hgpu.org

Zihao Ye, Yingyi Huang, Hongyi Jin, Bohan Hou, Junru Shao, Zhongming Yu, Jinqi Chen, Meghan Cowan, Shiyi Cao, Shanli Xing, Hanfeng Chen, Vinod Grover, Tianqi Chen, Luis Ceze

View

Download (PDF)

Tags: Compilers, Computer science, CUDA, nVidia, PTX

August 17, 2026 by hgpu

FlashPDE: A Drop-In Fused Triton Operator Library for Neural PDE Solvers

Peiyu Zang, Bosen Xie, Ruoxiang Xu, Yongqiang Cai

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, Machine learning, Neural networks, nVidia, Package, Partial differential equations, PDEs, Physics, Triton

August 4, 2026 by hgpu

Harness Engineering for LLM-Driven GPU Kernel Generation

Yue Shui, Chenyu Ma, Hangfei Xu, Shengzhao Wen, Yanpeng Wang

View

Download (PDF)

Source codes

Tags: Computer science, CUDA, LLM, nVidia, nVidia B200, Package, Triton

August 4, 2026 by hgpu

Real FP4 Tensor-Core Code in Pure Rust on a Gaming GPU – with NVIDIA’s Own Compiler

Carter Richardson

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia GeForce RTX 5070 Ti, PTX, Rust

July 13, 2026 by hgpu

Enhancing the Performance Analysis of NCCL GPU Collectives

Jurij Cerar

View

Download (PDF)

Tags: Computer science, CUDA, nVidia, nVidia H100, Performance, Tesla T4, Thesis

July 13, 2026 by hgpu

PTXBench: an open-source environment for kernel agents with architecture-specific CUDA/PTX

PTXBench: Benchmark and Adapt LLMs for GPU Kernel Optimization with Architecture-specific PTX

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

TensorCorePTX: PTX Tensor Core GEMM Exploration

Hand-Written PTX Tensor-Core GEMM Kernels: A Multi-Precision Study on NVIDIA L4

FlashPDE: Triton-fused PDE stencil kernels for physics-informed neural networks

FlashPDE: A Drop-In Fused Triton Operator Library for Neural PDE Solvers

PortLBM: Portable GPU-accelerated Lattice Boltzmann Method Simulations

PortLBM: A Portable Lattice Boltzmann Tool Leveraging SYCL on AMD, NVIDIA, and Intel GPUs

Harness Engineering for LLM-Driven GPU Kernel Generation

CANNBot Skills

Compiler-Grounded Hierarchical Diagnosis for LLM-Based Triton Kernel Optimization

See all packages

* * *

high performance computing on graphics processing units: hgpu.org

Programming

Every Kernel Is a Join: Automatic Multi-GPU Parallelism for AI Computations in Einsummable

Taming Bitwise Behavior in GPU Kernels with Tensor Core: Black-Box Reconstruction, Compiler Enforcement, and Static Verification

Hardware-Aware FP4 FlashAttention-4

An HPC Approach to Accelerate Tensor Decompositions

Concurrency Response of Plain Global Loads on the NVIDIA H100

Benchmarking Confidential Computing Performance on NVIDIA Blackwell GPUs

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

CAKE: Compiler-Agent Co-Design for Frontier Kernel Evolution

FlashPDE: A Drop-In Fused Triton Operator Library for Neural PDE Solvers

Harness Engineering for LLM-Driven GPU Kernel Generation

Real FP4 Tensor-Core Code in Pure Rust on a Gaming GPU – with NVIDIA’s Own Compiler

Enhancing the Performance Analysis of NCCL GPU Collectives

Recent source codes

FP4 FlashAttention forward, backward, and TorchTitan reproduction code

EinsummableV3 - graph-based computation with tensor operations support

MaxKernel: Intelligent TPU Kernel Engineering Agents

PTXBench: an open-source environment for kernel agents with architecture-specific CUDA/PTX

RealisticTritonBench: A Benchmark for Triton-Kernel Generation in Real-World AI Frameworks

TensorCorePTX: PTX Tensor Core GEMM Exploration

FlashPDE: Triton-fused PDE stencil kernels for physics-informed neural networks

PortLBM: Portable GPU-accelerated Lattice Boltzmann Method Simulations

Harness Engineering for LLM-Driven GPU Kernel Generation

CANNBot Skills

Most viewed papers (last 30 days)