snowpipe-streaming-quickstart

What problem does it solve?

Automates the end-to-end setup and demonstration of Snowpipe Streaming HPA, turning a multi-step process into a reproducible, zero-to-live pipeline that provisions Snowflake objects, creates a demo user, generates RSA keys, and deploys a cloud-based dashboard for real-time monitoring.

Core Features & Use Cases

• Platform detection & context: detects OS, verifies Python 3.9+, and gathers Snowflake context to tailor the run.
• RSA key-pair generation: creates a fresh 2048-bit RSA key pair and registers the public key with Snowflake.
• Snowflake object provisioning: creates database, schema, landing table, demo user and role, and configures access.
• Local config & venv setup: writes profile.json, streaming_demo.py, and creates an isolated Python virtual environment with necessary dependencies.
• Real-time dashboard: deploys a Streamlit-based Snowflake dashboard to monitor data in real time.
• Demo execution & cleanup: streams fake data, summarizes results, and optionally cleans up Snowflake assets.

Quick Start

Run the Snowpipe Streaming Quickstart to automatically provision Snowflake objects, generate keys, configure a local environment, and run a live Streamlit dashboard.