in λout +500 waiting per sM/D/2
Envelopes: packets, the customers of this queueYellow tray: the waiting line; the head (next served) is on the rightTeal blocks: servers (links); the lamp is lit while a server is busyMeter: long-run utilisation, packets in line and waitA router's output port as a queueing system: packets arrive at rate λ, wait in a first-in, first-out line, and the 12 Mb/s link sends one 1,500-byte packet every 1 ms (μ = 1,000 per second). Utilisation ρ = λ ÷ (c × μ). Even arrivals at ρ = 0.6 never wait; random ones wait 0.75 ms on average, and 4.5 ms at ρ = 0.9 (M/D/1, Pollaczek-Khinchin). At λ = 1,500 the line grows by 500 packets a second until a second server makes ρ = 0.75. The 12 Mb/s link and the arrival rates of 600, 900 and 1,500 packets per second are illustrative round numbers; every packet is 1,500 bytes (the Ethernet MTU), so service takes exactly 1 ms.

The parts of a queue

  1. Every queue has arrivals, a waiting line and servers. At a router's output port the customers are packets. Here they arrive at λ (lambda) = 600 packets per second: on average one every 1.67 ms.

Randomness and load

More servers, and names

The arithmetic

;; step 1/9 · arrivals · arrive
;; arrivals → waiting line
a queueing system = arrivals + a waiting line + one or more servers
λ (lambda)  arrival rate        600 packets/s
1 / λ       mean gap            1,000 ms / 600 = 1.667 ms
customers can be packets, shoppers, web requests or phone calls

The animation shows one short stretch of arrivals; queue lengths in it come and go, while the meter gives long-run averages. The tray draws at most 8 envelopes.