skills.rest
castlemilk
castlemilkCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

data-sync

Populate and synchronize ASIC short positions and stock prices in the Shorted platform.

3|Updated Jan 22, 2024
Search Tags:#automation#database#pipeline#enrichment#data-sync#shorts#asic
One-click install
npx skills add https://github.com/castlemilk/shorted.com.au --skill data-sync
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-sync
Source: https://github.com/castlemilk/shorted.com.au/tree/main/.claude/skills/data-sync
Command: npx skills add https://github.com/castlemilk/shorted.com.au --skill data-sync

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Populate and synchronize ASIC short positions and stock prices within the Shorted data platform.

Core Features & Use Cases

  • End-to-end data population and daily sync for shorts, stock prices, and metadata enrichment.
  • Quick population and full pipeline orchestration with validation checks and error handling.
  • Use Case: Onboarding new markets or diagnosing data discrepancies to ensure data integrity and up-to-date search indices.

Quick Start

Run the daily data-sync workflow to populate ASIC shorts and stock prices.

Frequently Asked Questions about data-sync

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate daily ASIC short position data sync?▼

You can automate daily ASIC short position data sync using Makefile targets that orchestrate end-to-end ingestion, validation checks, and stock price synchronization within the data pipeline.

What is the best way to backfill historical short positions and stock prices?▼

Historical backfills of short positions and stock prices are handled through full pipeline orchestration with data validation checks, ensuring data integrity across ingestion and enrichment workflows.

Can I use Makefile targets to troubleshoot data pipeline ingestion errors?▼

Yes, Makefile targets support troubleshooting across the data pipeline, allowing you to diagnose ingestion errors, metadata enrichment issues, and search indexing discrepancies.

Does this data pipeline integration support Algolia search indexing?▼

Yes, the data pipeline integrates natively with Algolia, synchronizing enriched short data and stock prices to ensure search indices remain up-to-date during daily operations and backfills.

How do I validate data integrity when onboarding new markets for short positions?▼

Data integrity during new market onboarding is validated using built-in data validation checks that verify ingestion accuracy, metadata enrichment, and search indexing across the pipeline.

Why are my ASIC short positions not appearing in the search index?▼

ASIC short positions may fail to appear if the data pipeline ingestion, metadata enrichment, or Algolia integration encountered errors, requiring troubleshooting via Makefile targets and validation checks.

Related Skills

Explore More Data & Analytics Skills→
yunqiqiliangyunqiqiliang
8

clickzetta-data-ingest-pipeline

Route data ingestion to ClickZetta Lakehouse pipelines based on source type, latency, and volume.

Community
Advanced
IhsanDanish25IhsanDanish25
2

market-environment-analysis

Analyze global financial markets and generate reports on trends, risk, and volatility.

Community
Advanced
jokken79jokken79
1

algolia-search

Integrate Algolia with React InstantSearch hooks and Next.js SSR.

Community
Advanced
AI-Foundry-CoreAI-Foundry-Core
4

ml-pipeline-workflow

Orchestrate end-to-end MLOps pipelines from data ingestion through deployment.

Official
Advanced