#nccl

1 blog post.

Blog posts

One box, eight GPUs, and the wires between them

Eight GPUs in one server behave like a small network. NVLink vs PCIe, reading nvidia-smi topo -m, NCCL transports, the ACS trap, and fitting a 70B model.

Related tags

#ai #ai-gateway #ai-tooling #akamai #anime #audit-logs #automation #aws