Teraoctet per second (To/s)

The teraoctet per second is a unit of data transfer rate equal to a thousand gigaoctets per second, or eight terabits per second. Its symbol is To/s. It describes memory bandwidth inside the fastest processors and the aggregate throughput of large computing systems, rather than any link between separate machines.

Graphics and accelerator chips are the clearest example. A modern accelerator uses stacked memory placed alongside the processor on the same package, and the bandwidth between them reaches several teraoctets per second. That figure is what allows thousands of arithmetic units to be kept busy at once, and it is now the property that most often determines how fast a machine learning workload runs.

The reason bandwidth rather than arithmetic has become the limiting factor is worth stating. Processors have grown far faster at computing than memory has at supplying data, so a modern chip can perform tens of operations for every octet it reads. Any calculation that touches memory more often than that is limited by the memory, and most real calculations are.

Supercomputer interconnects reach this range in aggregate. The network joining thousands of nodes carries teraoctets per second across the whole machine, though no single link does. The design problem is to arrange the topology so that any node can reach any other quickly, which is why these networks are built as multi-dimensional meshes and trees rather than as simple stars.

To make the number concrete, one teraoctet per second would fill a large consumer hard drive in twenty seconds and transfer the entire text of every book in a national library within a minute. Nothing in ordinary use approaches it, and no external cable of any kind carries it.

The unit also appears in descriptions of storage arrays. A large parallel filesystem, spread across thousands of drives, can deliver a few teraoctets per second in aggregate to a supercomputer, and that figure is quoted as a headline specification because it determines how quickly a simulation can be written out and read back.

One teraoctet per second equals 1,000 gigaoctets per second, 8 terabits per second, or about 0.9095 tebioctets per second.

Teraoctet per second conversion table