What problem does it solve?
This Skill enables deploying and running AI/ML models and workflows on Modal's cloud platform, simplifying the process of serving models, scaling Python code, and scheduling jobs.
Core Features & Use Cases
- Deploy AI/ML Models: Serve and scale AI/ML models with serverless functions and GPUs.
- Serverless Compute: Run Python code serverlessly, with autoscaling and custom container images.
- Scheduled Jobs: Schedule and run jobs at regular intervals or based on specific criteria.
- Use Case: Deploy a model to serve predictions to a web endpoint and schedule a job to retrain the model at regular intervals.
Quick Start
Deploy a Python script to run on Modal and serve a model using the Modal Python SDK:
import modal
app = modal.App("my-app")
@app.function(gpu="H100")
def predict(text: str):
# Run model inference
return "Model prediction result"
modal deploy script.py