Tags: tensorzero/tensorzero
Tags
Add dedicated Groq model provider (#1893) * Copy over openai example guide * Copy over src/inference/providers/openai.rs * Replace constants and types * Replace custom url * Rename functions * Copy over openai e2e test * Rename api key in e2e test * Rename provider name in e2e test * Expose new groq provider outside src/inference/providers * Update src/model.rs * Update github workflows * Update README * Missing shorthand prefix * Blind ui changes * Groq-specific models and variants * Add missing mod.rs entry * Add missing supports_batch_inference field to test providers * Remove openai tests * Use llama scout * Fix base url * Remove no-longer used imports * Handle specific error responses * Fix dynamic model * Add missing json_mode_off_inference field, no tests for now * Add dynamic_json variants * WIP response format * Remove groq-default * Adapt tests to use json_object with schema * Manually tested and it works. Now fixing remaining tests (WIP) * Handle extra headers * Groq doesn't support streaming in json mode * Add weather helper variants * Groq doesn't follow allowed_tools * Unnecessary comment in Groq's context * `tool_choice: "required"` not working as expected * Ensure test sends correct schema to the tool * Add model_name() and mappings * Groq doesn't support `tool_choice: specific` * Fix guide example * Fix clippy issues * Remove WrappedProvider implementation * Hardcode request url * Remove batch inference * Remove stale test * Remove embedding request * Formatting * Updated dependencies * Update dummy-env-file.env Update dummy env file * Be explicit about lowercase groq name * Revert "Copy over openai example guide" This reverts commit 30743c1. # Conflicts: # examples/guides/providers/groq/config/tensorzero.toml * Remove duplication * Disable tests for parallel tool calls and specific tool choice * Add comment about unreliable or missing functionality * wip * fixed issues with groq extra headers in streaming --------- Co-authored-by: Viraj Mehta <virajmehta@users.noreply.github.com> Co-authored-by: Viraj Mehta <viraj@tensorzero.com>
Add defaults to Optional fields so that the client doesn't crash in c… …ase there are missing optional fields at runtime (#2167) * added feature to ensure python client doesn't mistake notrequired for optional * Revert "added feature to ensure python client doesn't mistake notrequired for optional" This reverts commit 810f728. * Add default values for Optional fields in client to avoid crashing on missing values during parsing --------- Co-authored-by: Gabriel Bianconi <1275491+GabrielBianconi@users.noreply.github.com>
Fix datapoint type issues (#2160) * Fix datapoint type issues * Fix datapoint type issues * Update * changed datapoints to tagged enums and added appropriate tests * Update * Update * fixed evaluation tests * fixed clippies * Update * Update * Update --------- Co-authored-by: Gabriel Bianconi <GabrielBianconi@users.noreply.github.com> Co-authored-by: Viraj Mehta <viraj@tensorzero.com>
Handle Fireworks AI SFT API regression (#2154) * Handle Fireworks AI SFT API regression * Handle Fireworks AI SFT API regression * Handle Fireworks AI SFT API regression --------- Co-authored-by: Gabriel Bianconi <GabrielBianconi@users.noreply.github.com>
Remove openssl-sys dependency from git2 (#2083) This is breaking the PyO3 build on linux (since we don't have OpenSSL available, and would have difficulty getting it for musl) Fortunately, we don't actually need any of the 'git2' features (https, ssh) that use openssl
PreviousNext