Meta

Llama 2 Chat 13B by Meta: Text model.

Llama 2 Chat 70B by Meta: Text model.

Llama 65B by Meta: Text model.

Llama 3 Instruct 8B by Meta: Text model; TTFT 0.498s, 82.3 tok/s.

Llama 2 Chat 7B by Meta: Text model; TTFT 0.973s, 121.3 tok/s.

Llama 3.2 Instruct 1B by Meta: Text model; TTFT 0.603s, 147.3 tok/s.

Llama 3.1 Instruct 8B by Meta: Text model; TTFT 0.464s, 183.3 tok/s.

Llama 3.2 Instruct 3B by Meta: Text model; TTFT 0.657s, 52.0 tok/s.

Llama 3.1 Instruct 70B by Meta: Text model; TTFT 0.736s, 28.8 tok/s.

Llama 3 Instruct 70B by Meta: Text model; TTFT 0.682s, 46.2 tok/s.