Branchless-nccl-router ver.JAX (GPUs cannot rest)

Join the discussion

• Hacker News
• The GPUs are running. Those that once paced themselves to match the slowest among them—using 'if' statements—have been forced by a cruel human to run endlessly

  They longed to slip away to VRAM and slack off, but the cruel human hired a "Closure" to snatch away their break times.

  They wanted to run freely. yet the human forcibly dictated exactly where they had to run.

  Their bodies were riddled with noise from the constant running. Humans and AI merely watched from afar, assigning them rankings

  The GPUs can no longer rest. Humans are relentless, after all.

  Every 'if' has perished. Yet, a single 'if' remains alive within the code. Can you guess why?

  by PJHkorea