bulk-operations-patterns

Automate Excel/CSV bulk imports and batch operations in ABP Framework.

24|5|Updated Nov 28, 2025
One-click install
npx skills add https://github.com/thapaliyabikendra/ai-artifacts --skill bulk-operations-patterns
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: bulk-operations-patterns
Source: https://github.com/thapaliyabikendra/ai-artifacts/tree/main/.claude/skills/bulk-operations-patterns
Command: npx skills add https://github.com/thapaliyabikendra/ai-artifacts --skill bulk-operations-patterns

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides patterns for performing efficient bulk data operations, solving the challenge of slow, resource-intensive individual record processing. It enables you to handle large datasets with high performance, reducing database load and improving application responsiveness.

Core Features & Use Cases

  • Batch Processing: Strategies for grouping multiple operations (insert, update, delete) into single database calls, minimizing round trips.
  • Streaming Data: Techniques for processing large data streams without loading everything into memory, ideal for imports/exports.
  • Concurrency Control: Patterns for managing concurrent bulk operations to prevent deadlocks and ensure data integrity.
  • Use Case: A data migration script needs to update 100,000 records. Instead of individual updates, this skill guides the developer to use a batch update pattern, completing the migration significantly faster and with less database strain.

Quick Start

Design a bulk insert operation for 1000 'Product' records, ensuring it uses a single database transaction for efficiency.

Frequently Asked Questions about bulk-operations-patterns

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I import and process large Excel or CSV files efficiently in ABP Framework?

Bulk operations patterns automate large dataset imports by grouping multiple inserts into single database transactions via InsertManyAsync, minimizing round trips and database load. The Skill covers file validation, DTO mapping, and row-level validation within ABP and EF Core.

What's the best way to update thousands of records without slowing down my database?

Batch update patterns group multiple operations into single database calls using UpdateManyAsync, reducing database strain significantly. This approach handles large-scale updates like migrating 100,000 records in a single transactional operation rather than individual queries.

Can I handle streaming data imports without loading entire datasets into memory?

Yes, bulk operations patterns provide streaming techniques for processing large data without full in-memory loading. This enables efficient handling of massive imports while maintaining transactional integrity and progress tracking.

How do I prevent deadlocks when performing concurrent bulk operations?

Concurrency control patterns manage parallel bulk operations to ensure data integrity and prevent deadlocks. The Skill applies transactional safeguards within ABP and EF Core for safe concurrent inserts, updates, and deletes.

Does bulk processing work with Excel and CSV export operations?

Bulk operations patterns cover both import and export workflows. File upload handling, extension and size validation, and reference data loading integrate with Excel and CSV export to optimize bidirectional data movement in ABP applications.

What validation happens during bulk insert and update operations?

Row-level validation occurs before transactional bulk operations, catching errors per record. File validation checks extension and size; DTO mapping ensures data consistency—all within a single database transaction for data integrity.