KeyringFrequently Asked Questions
What is YourBench?
YourBench is Keyring's automatic AI model benchmarking product. When a new model is released by OpenAI, Anthropic, Google, Mistral, or other providers, YourBench runs your prompts against it and emails you the results — including response quality, latency, token usage, and cost.
How does it work?
You write the prompts that matter to your work — code review, summarization, analysis, whatever you need. Choose which AI providers you want to track. When a new model drops, we automatically run your benchmarks and send you a detailed comparison report.
Which AI providers do you support?
We currently support models from OpenAI, Anthropic, Google, Meta, Mistral, and xAI. We're adding more providers regularly.
Is there a free plan?
Yes. The free plan includes 1 active prompt, 5 on-demand runs per month, auto-benchmarks on all 30+ models, and a weekly digest email. Plus ($8/mo) and Pro ($18/mo) offer more prompts, more runs, instant notifications, and detailed analytics.
What data do you collect?
We collect your email, the prompts you write, and the benchmark results generated from those prompts. We do not sell your data. Your prompts are sent to AI providers solely for benchmarking purposes. See our Privacy Policy for full details.
Are my prompts private?
Yes. Your prompts are only visible to you and are only sent to AI providers when running benchmarks. We use row-level security to ensure no other user can access your data.
How quickly do you benchmark new models?
We aim to benchmark new models within hours of their public API availability. You'll receive an email as soon as your results are ready.
Can I choose which notifications I receive?
Yes. You can configure notification preferences per provider — choose between instant notifications or weekly digests, and select summary or detailed report formats.
How do I cancel my subscription?
You can cancel anytime from your dashboard settings. Your access continues until the end of your current billing period.
Who is behind keyring.ai?
keyring.ai is operated by Mindforge Ltd, a company registered in England and Wales (Company Number: 13108592).
How do I get in touch?
Email us at team@keyring.ai for general queries, or privacy@keyring.ai for privacy-related requests.