Discussions

• 1 You must be logged in to vote

  💡

  Support gemini-embedding-001

  mart-xingweil started Nov 12, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  Consider failing the variant inference if DICL matches no examples after filtering

  GabrielBianconi started Nov 4, 2025 in Feature Requests

  

  

  1
• 1 You must be logged in to vote

  💡

  Allow users to resize the columns in UI tables

  GabrielBianconi started Nov 3, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  "Echo" mode for regular integration testing

  myypo started Nov 1, 2025 in Feature Requests

  

  

  1
• 1 You must be logged in to vote

  💡

  Support token inputs in embeddings endpoint

  GabrielBianconi started Oct 31, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  Changes for the upcoming /v1/inferences endpoint

  GabrielBianconi started Oct 29, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  Add extra_headers for embedding models for azure provider | Validate if it can be scaled to all providers as well

  chandan84 started Oct 28, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  Support Microsoft Entra (Bearer XXX) authentication for Azure model provider

  GabrielBianconi started Oct 28, 2025 in Feature Requests

  

  

  0
• 2 You must be logged in to vote

  💡

  Support Postgres as the primary database

  GabrielBianconi started Oct 24, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  Extend the OpenAI API spec to include reasoning content blocks in chat completion responses (OpenAI-compatible inference endpoint)

  d8rt8v started Sep 19, 2025 in Feature Requests

  

  

  

  

  2
• 2 You must be logged in to vote

  💡

  Add a zero data retention (ZDR) mode

  GabrielBianconi started Sep 29, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  Allow user to specify a free-form desired behavior or other context for evals

  GabrielBianconi started Sep 23, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  Improve the discoverability / usage of implicit_tool

  GabrielBianconi started Sep 23, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  Allow user to re-use LLM judges across different evaluations

  GabrielBianconi started Sep 23, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  blocking batch inference via regular LLM endpoints (not batch ones)

  ProblemFactory started Sep 12, 2025 in Feature Requests

  

  

  2
• 1 You must be logged in to vote

  💡

  Add an example that tackles tau-bench (τ-bench)

  python This issue involves Python.

  virajmehta started Oct 22, 2024 in Feature Requests

  

  

  

  

  2
• 2 You must be logged in to vote

  💡

  OpenAI-compatible interface doesn't properly propagate 429 responses

  ucirello started Sep 10, 2025 in Feature Requests

  

  

  3
• 1 You must be logged in to vote

  💡

  Bias Anthropic models towards escaping special characters in JSON

  GabrielBianconi started Jan 24, 2025 in Feature Requests

  

  

  2
• 1 You must be logged in to vote

  💡

  What is the best practice to use dataset api for end to end evaluation?

  contrun started Aug 28, 2025 in Feature Requests

  

  

  1
• 1 You must be logged in to vote

  💡

  Improving typing of the gateway in the Python SDK

  GabrielBianconi started Sep 2, 2025 in Feature Requests

  

  

  2
• 1 You must be logged in to vote

  💡

  Support http proxy

  contrun started Aug 8, 2025 in Feature Requests

  

  

  

  

  4
• 4 You must be logged in to vote

  💡

  Releasing the Rust client

  timonv started Aug 15, 2025 in Feature Requests

  

  

  3
• 1 You must be logged in to vote

  💡

  Add an evaluator for semantic similarity?

  GabrielBianconi started Aug 18, 2025 in Feature Requests

  

  

  0
• 1 You must be logged in to vote

  💡

  Add a Cohere model provider

  good-first-issue This issue is a good fit for new community contributors and team members. rust This issue involves Rust.

  GabrielBianconi started Dec 29, 2024 in Feature Requests

  

  

  

  

  26
• 1 You must be logged in to vote

  💡

  Specify all the options in configuration file with environment variables

  contrun started Aug 7, 2025 in Feature Requests

  

  

  8