The bundled Nsight Systems 2024.5 is excellent. The new "Kernel Fusion Candidate" detection helps identify naive kernel launches that can be manually fused. The memory pool allocator in the CUDA Driver API is also less chatty with the OS, reducing allocation overhead by ~15% in dynamic shape workloads.
Microsoft and NVIDIA have clearly been collaborating. On WSL 2 (Windows 11), nvidia-smi now reports correct power/clock limits, and the CUDA profiler no longer throws spurious "driver mismatch" errors. It feels nearly native. The Pain Points (Read This) - The Driver Wall You must have driver version R555 or later (e.g., 555.42.06 Linux / 556.12 Windows). If you are on a corporate locked-down workstation or an older data center with drivers from 2023, CUDA 12.6 will refuse to run. Check your driver before installing. cuda toolkit 12.6
New projects, Ada/Hopper owners, WSL 2 devs. Hold off for: Framework users, legacy driver environments. The bundled Nsight Systems 2024
Finally, official support for Clang 18 and GCC 13.2 . This is a lifesaver for developers using modern C++ features (C++20/23) in scientific computing. The NVCC frontend feels noticeably more robust with complex template metaprogramming. Microsoft and NVIDIA have clearly been collaborating