Data sources & ingest console

FCC BDC is Tier 1 and runs strictly state by state with checkpointed resume. Credentials live in Cloud secrets and are never logged, persisted or exported.

source datacalculateduser-maintainedneeds reviewconflict
National BDC run0/0 states complete · 0 ZIP × carrier rows · 0 collapses · 0 rejects

Load the national ZCTA crosswalk before running states outside Delaware — blocks with no crosswalk match are parked in bdc_rejects rather than dropped.

StateStatusRows inZIP × carrierZCTAsCarriersCollapsesRejectsManifest
FCC BDC — fixed broadband availability (technology 50)
State
Filing period

Each invocation processes a bounded slice and checkpoints its offset, so the national dataset is never held in memory. block_geoid → ZCTA mapping and provider × ZCTA aggregation run in SQL.

2020 Census ZCTA5 → tabulation block crosswalk (0 blocks loaded)
Ingest jobs
TypeStateStatusRowsManifestCheckpoint
Source registry
SourceTypeCoverageAccessedNotes
Other ingest paths
  • FCC Form 477 (historical) Enrichment only — sets historical_presence / historical_last_seen. Never overwrites current BDC status and is never displayed as current availability.
  • State PUC / CLEC / ILEC registrations Loads into carrier_state_presence. State registration is never fanned out across every ZIP in the state.
  • NTIA Middle Mile / BEAD / CPF / state programs Sets middle_mile_operator; project geography (state, county, route, community, POP, project_id) is retained.
  • Municipal / co-op / public power / R&E / tribal networks Included even when they sell no retail internet.
  • Generic CSV upload Drop any list in and map it to columns.
Single-state validation
  • BDC reflects broadband availability, not wholesale dark fiber.
  • ZCTAs are not identical to USPS ZIP delivery areas.