@cf/meta/llama-3.1-70b-instruct
Streams a reply to a ~20-word prompt, capped at 100 tokens; latency is the full reply.
3.84s?
Last Update19.44 s ago
Success (24h)100.0%
Predicted~3.96 s
Streams a reply to a ~20-word prompt, capped at 100 tokens; latency is the full reply.