agent-platform-inference

Automate inference operations with Google Cloud Agent Platform GenAI models.

17.1k|1.4k|Updated Mar 31, 2026
One-click install
npx skills add https://github.com/google/skills --skill agent-platform-inference-google
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: agent-platform-inference
Source: https://github.com/google/skills/tree/main/skills/cloud/agent-platform-inference
Command: npx skills add https://github.com/google/skills --skill agent-platform-inference-google

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires google-genai, openai, google-auth, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill helps automate inference operations with Google Cloud Agent Platform GenAI models, bridging the gap between data and insights by simplifying the process of executing model predictions on Google Cloud.

Core Features & Use Cases

  • Model Connectivity: Seamlessly connect to both First-Party Gemini models and Third-Party OpenMaaS models for inferencing.
  • Authentication Management: Automates authentication steps required for GenAI SDK, OpenAI SDK, or legacy Agent Platform SDK usage.
  • Endpoint Configuration: Offers the ability to configure base URLs and global/regional endpoints, enhancing flexibility.
  • Error Troubleshooting: Assists in diagnosing common errors like 429 Resource Exhausted and 404 Not Found.

Quick Start

To get started with this skill, ensure the environment is set up as outlined and execute a sample script. Example command: 'python3 scripts/gemini_genai_sdk.py'

Frequently Asked Questions about agent-platform-inference

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run inference on Google Cloud Agent Platform using the GenAI SDK?

To run model inference on Google Cloud Agent Platform, execute the provided Python sample scripts like 'gemini_genai_sdk.py' after configuring your environment for Google Cloud API authentication.

Can I connect to both first-party Gemini and third-party OpenMaaS models for inferencing?

Yes, you can connect to both first-party Gemini and third-party OpenMaaS models for inferencing by configuring the appropriate SDK and managing your Google Cloud API endpoints.

Why does my Google Cloud GenAI model inference return a 429 Resource Exhausted error?

A 429 Resource Exhausted error during GenAI model inferencing indicates you have hit a rate limit; this Skill assists in diagnosing this and other common errors like 404 Not Found.

Do I need to configure regional endpoints when using the OpenAI SDK with Agent Platform?

Yes, when using the OpenAI SDK or GenAI SDK with Agent Platform, you need to configure base URLs and manage global or regional endpoints to successfully execute model predictions.

What's the best way to automate authentication for Google Cloud GenAI inference?

Automate authentication for Google Cloud GenAI inference by utilizing the Google Auth dependency to manage credentials required by the GenAI SDK, OpenAI SDK, or Agent Platform SDKs.