Inferock
An accountable LLM inference platform: routing through your own keys, managed serverless inference and quality metrics for every call.
Description
Inferock is an accountable LLM inference platform: it routes calls through your provider keys (Watch), managed serverless inference (Serve) or dedicated capacity (Dedicated). It independently measures the quality and cost of every call, traces failed responses and issues service credits for unusable results.
Key features
- Routing through your own keys
- Serverless and dedicated inference
- Quality metrics per call
- Failed response tracing
- Service credits for failures
