skills.rest
bbartling
bbartlingCOMMUNITY
Explore all skills by this author →
GitHub

feather-local-storage

Store site time series data as timestamp-indexed feather files.

157|31|Updated May 27, 2020
Search Tags:#data management#local storage#timeseries#sensor data#feather
One-click install
npx skills add https://github.com/bbartling/open-fdd --skill feather-local-storage
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: feather-local-storage
Source: https://github.com/bbartling/open-fdd/tree/main/skills/feather-local-storage
Command: npx skills add https://github.com/bbartling/open-fdd --skill feather-local-storage

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyarrow, and includes scripts (resource) and references (resource) components.

What problem does it solve?

It addresses the need for efficient on-disk storage of site-specific timeseries data, enabling quick access and management of metrics without relying on external databases.

Core Features & Use Cases

  • Local Timeseries Storage: Stores site and source data as timestamp-indexed feather files for fast read/write operations.
  • Versatile Application: Suitable for handling CSV, weather, BACnet data, and more, directly on local storage.
  • Use Case: For example, storing hourly sensor data locally to facilitate quick retrieval and analysis during site troubleshooting.

Quick Start

Implement feather storage in your environment by setting OFDD_DESKTOP_DATA_DIR and organizing data under <data_dir>/feather_store/<source>/<site_id>/.

Frequently Asked Questions about feather-local-storage

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I store local timeseries sensor data without using an external database?▼

You can store local timeseries sensor data by writing site metrics to timestamp-indexed feather files on disk, enabling quick read and write operations without relying on an external database.

What is the best way to manage on-disk shard storage for environmental monitoring data?▼

Managing on-disk shard storage for environmental monitoring involves organizing data into feather files within a structured directory like <data_dir>/feather_store/<source>/<site_id>/ for fast local retrieval.

Do I need pyarrow to save site time series data as feather files?▼

Yes, you need the pyarrow library installed to handle the feather file format and ensure reliable on-disk shard management for your site time series data.

Can I use feather files to store CSV or BACnet data locally for troubleshooting?▼

Yes, feather files support versatile local storage for various data sources including CSV, weather, and BACnet data, facilitating quick retrieval and analysis during site troubleshooting.

How do I set up the directory structure for local feather storage?▼

To set up local feather storage, configure the OFDD_DESKTOP_DATA_DIR environment variable and organize your site time series data under the <data_dir>/feather_store/<source>/<site_id>/ directory path.

Why use feather file shards instead of a database for site sensor metrics?▼

Feather file shards provide efficient on-disk storage for site-specific timeseries data, enabling fast data access and management of environmental sensor metrics without the overhead of external database setup.

Related Skills

Explore More Data & Analytics Skills→
MakisuoMakisuo
1.6k

clickhousectl-local-dev

Install and configure a local ClickHouse environment with clickhousectl.

Community
Intermediate
bbartlingbbartling
157

timeseries-plots-and-cleaning

Plot time series data and remove unit suffixes from feather metrics.

Community
Basic
bbartlingbbartling
157

driver-csv-ingest

Ingest CSV and TSV files into local feather storage with encoding detection.

Community
Intermediate
zinohomezinohome
1

zustand-state-builder

Implement TypeScript Zustand stores with persistence, devtools, and modular slices.

Community
Intermediate