@cf/meta/llama-3.1-8b-instruct-fast
Streams a reply to a ~20-word prompt, capped at 100 tokens; latency is the full reply.
700ms?
Last Update48.25 s ago
Success (24h)100.0%
Predicted~896 ms
Streams a reply to a ~20-word prompt, capped at 100 tokens; latency is the full reply.