skills.rest
ethan-rio
ethan-rioCOMMUNITY
Explore all skills by this author →
GitHub

arize-ai-provider-integration

Manage LLM provider credentials as Arize AI integrations via the ax CLI.

Updated May 5, 2026
Search Tags:#credential management#llm providers#arize#llm integrations#ax cli#provider credentials#evaluator setup
One-click install
npx skills add https://github.com/ethan-rio/skills --skill arize-ai-provider-integration
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: arize-ai-provider-integration
Source: https://github.com/ethan-rio/skills/tree/main/skills/arize/arize-ai-provider-integration
Command: npx skills add https://github.com/ethan-rio/skills --skill arize-ai-provider-integration

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill eliminates the manual, error-prone work of configuring and managing LLM provider credentials for Arize, ensuring evaluators and other Arize features can reliably access the LLM services you need.

Core Features & Use Cases

  • Full CRUD for LLM Integrations: Create, list, retrieve, update, and delete Arize AI integrations for any supported LLM provider (OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Vertex AI, Gemini, NVIDIA NIM, custom OpenAI-compatible endpoints).
  • Secure Credential Management: Store and manage LLM provider API keys, IAM roles, and service account credentials directly in Arize, avoiding hardcoded secrets in your code or environment files.
  • Use Case: If you are building LLM-as-judge evaluators for Arize experiments, use this Skill to quickly set up a Bedrock integration with your IAM role, then retrieve the integration ID to attach to your evaluator configuration.

Quick Start

Use the arize-ai-provider-integration skill to create a new OpenAI integration named 'Production Judge' with your OpenAI API key, then retrieve its integration ID for use in your Arize evaluator.

Frequently Asked Questions about arize-ai-provider-integration

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I manage LLM provider credentials in Arize for evaluator setup?▼

You can manage LLM provider credentials in Arize by using the ax CLI to create, retrieve, update, and delete integrations. This securely stores API keys and IAM roles, eliminating manual configuration errors for LLM-as-judge evaluator calls.

What LLM providers can I integrate with Arize for LLM-as-judge experiments?▼

Arize supports integrations with OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Vertex AI, Gemini, NVIDIA NIM, and custom OpenAI-compatible endpoints. You can register these providers to supply LLM access for experiments and feature calls.

How do I securely configure AWS Bedrock credentials in Arize without hardcoding secrets?▼

To configure AWS Bedrock credentials securely, use the ax CLI to create an Arize integration using your IAM role. This stores credentials directly in Arize, preventing hardcoded secrets in your environment files while enabling reliable evaluator access.

Can I update or delete an existing LLM integration in Arize?▼

Yes, you can update or delete existing Arize AI integrations using the ax CLI. This full lifecycle management allows you to modify API keys, adjust model access controls, and remove unused provider credentials as your requirements change.

Does Arize provider integration support scoped visibility and multiple authentication types?▼

Arize provider integration supports multiple authentication types, scoped visibility, and model access controls. This ensures secure, auditable credential management across different LLM providers for your organization's specific security requirements.

Related Skills

Explore More Data & Analytics Skills→
seldoseldo
5

arize-ai-provider-integration

Manage LLM provider credentials for Arize AI integrations via ax CLI.

Community
Advanced
ethan-rioethan-rio

arize-evaluator

Create, execute, and monitor LLM and code evaluators on Arize.

Community
Advanced
seldoseldo
5

arize-evaluator

Create and run LLM-as-judge evaluators on Arize using the ax CLI.

Community
Advanced
markmhendricksonmarkmhendrickson
27

sync-env-from-1password

Synchronize environment variables from 1Password to a local .env file.

Community
Advanced