dynamic-large-file-parquet-analysis
OfficialFast large Excel file analysis with automatic Parquet conversion.
AuthorOpenSenseNova
Version1.0.0
Installs0
System Documentation
What problem does it solve?
It addresses the challenge of efficiently analyzing very large Excel datasets, reducing processing time by automatically switching to Parquet format when data exceeds a specified size.
Core Features & Use Cases
- Adaptive Data Loading: Detects large files and converts them to Parquet for faster reading.
- Conditional Filtering & Grouping: Performs targeted data filtering based on user-defined criteria and generates summarized counts and percentages.
- Use Case: Quickly analyze a gigantic Excel report containing over 10,000 rows to identify the distribution of a specific risk level across different project categories.
Quick Start
Load a large Excel file named 'big_data.xlsx' and filter rows where 'Risk Level' contains '★★★★', then group by 'Project Type' and export the results.
Dependency Matrix
Required Modules
pandaspyarrow
Components
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: dynamic-large-file-parquet-analysis Download link: https://github.com/OpenSenseNova/SenseNova-Skills/archive/main.zip#dynamic-large-file-parquet-analysis Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.