rfp-ingest

Ingest RFP opportunities from SAM.gov, Maryland eMMA, RFPMart, and GovTribe into a canonical schema.

Updated May 31, 2025

Search Tags:#deduplication #ingest #sam.gov #rfp #data-normalization #rfpmart #emma

Ready to run

npx skills add https://github.com/Atemndobs/nebula-rfp --skill rfp-ingest

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: rfp-ingest
Source: https://github.com/Atemndobs/nebula-rfp/tree/main/.claude/skills/rfp-ingest
Command: npx skills add https://github.com/Atemndobs/nebula-rfp --skill rfp-ingest

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Ingests RFP opportunities from multiple data sources (SAM.gov, Maryland eMMA, RFPMart, GovTribe) and unifies them into a canonical schema with deduplication, enabling consistent evaluation and automation.

Core Features & Use Cases

Multi-source ingestion across SAM.gov, Maryland eMMA, RFPMart, and GovTribe with normalization.
Canonical schema alignment and deduplication to prevent duplicates and ensure data quality.
Supports both API-based and CSV-based data sources, with manual upload workflows and email-alert ingestion where applicable.

Quick Start

Instruct the ingestion engine to pull new RFP opportunities from all configured sources.

Frequently Asked Questions about rfp-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I normalize RFP data from SAM.gov and RFPMart into a single schema?▼

RFP data normalization from SAM.gov, RFPMart, and Maryland eMMA is achieved by ingesting all sources into a canonical schema with automated deduplication, ensuring consistent data quality across multiple platforms.

Can I ingest RFP opportunities from both API and CSV sources?▼

Yes, you can ingest RFP opportunities from both API-based and CSV-based data sources. The pipeline supports API connections, manual CSV uploads, and email-alert ingestion where applicable to unify data formats.

What is the best way to deduplicate RFP opportunities across multiple platforms?▼

The best way to deduplicate RFP opportunities across multiple platforms is to align data from SAM.gov, Maryland eMMA, and GovTribe into a canonical schema, using upsert logic to prevent duplicates and maintain data quality.

Does the RFP ingestion pipeline support scheduled runs and error handling?▼

Yes, the RFP ingestion pipeline supports both on-demand and scheduled runs with robust error handling. It implements logging to support reproducible ingestion, audit trails, and alerting for any ingestion issues encountered.

How do I handle upserts and audit trails when ingesting multi-source RFP data?▼

To handle upserts and audit trails during multi-source RFP data ingestion, the pipeline applies upsert logic and comprehensive logging, ensuring reproducible ingestion and tracking all data modifications for quality assurance.