The operating system, the CPU and the GPU: who runs, where, and why GPUs are fast
A function call takes 0.4 ns, a system call 345 ns. The kernel, processes, threads and scheduling, drivers and devices, then CPUs and GPUs: two designs for two kinds of work, measured with the same matrix multiplication at four sizes.