Skip to content
#

cpp17

cpp logo

C++ is a popular and widely used mid-level language. It was designed as an extension of the C language.

Here are 97 public repositories matching this topic...

A high-performance C++ backend for extreme-context LLM inference. It replaces item-count batching with dynamic, VRAM-aware First-Fit Decreasing (FFD) bin packing. By using PyBind11 for async queueing, 16-token alignment, and `cudaHostAlloc` for zero-copy FlashAttention-2 transfers, it mathematically eliminates OOMs and maximizes GPU throughput.

  • Updated Jun 5, 2026
  • Python

Created by Bjarne Stroustrup

Released October 1985

Followers
133k followers
Website
github.com/topics/cpp
Wikipedia
Wikipedia