Get roles like this, scored and matched, in your inbox.
Sign up free →Job Opening
Fundable - Senior Data Engineer
Silver Peak Systems · Remote · Posted 17 days ago
"Own the data platform end to end, turning provider APIs, webhooks, files, and scraped sources into trusted records by moving a serial container workflow to concurrent, event-driven orchestration."
About Fundable
Fundable is a startup data platform that helps investors and other teams discover and research companies. We bring together information on companies, investors, funding activity, and people to make that research easier.
Role overview
We’re looking for a senior data engineer to own Fundable’s data platform from architecture through production, reliably turning high volumes of data from provider APIs, webhooks, files, and web scraping into trusted records for our products.
Today, our enrichment and extraction workflows largely run serially inside a container. You’ll lead the move to a platform that supports concurrent processing, event-driven intake, and orchestrated batch workflows.
What you’ll own
- Multi-source intake: Build concurrent ingestion for provider APIs, webhooks, files, and scraping, with rate limits and failure handling.
- Batch and event-driven execution: Orchestrate scheduled workflows and historical backfills using tools such as Airflow, Dagster, or Prefect. Build event-driven intake with Pub/Sub or Cloud Tasks, including retries, dead-letter queues, and controlled replay of failed work.
- Raw-to-curated data: Preserve original payloads, including provider JSON, in Google Cloud Storage (GCS) before transforming them with dbt. Establish medallion layers for raw, standardized, and curated data.
- Correctness through recovery: Implement idempotent upserts and safe retries, replay, and historical backfills that avoid duplicate records or data corruption. Make data traceable to its source and safe to reprocess.
- Data quality and delivery: Define data contracts, build automated validation and pipeline tests, and monitor freshness and failures. Design and optimize PostgreSQL schemas, queries, and loading patterns so downstream products receive dependable data.
- Extraction and enrichment: Integrate provider enrichment and LLM-based structured extraction from text into the platform.
Must-have experience
…
This posting is sourced from Silver Peak Systems's own career site — applying takes you there directly.
Get roles like this, scored and matched, in your inbox.
Sign up free →Related roles
There are 39 open roles at Silver Peak Systems right now. This role is one of 47 Data Engineer openings in Remote and centers on Python, SQL, Postgresql, and Dbt.
Want roles like this found for you?
Set your Focus once. Career Engine screens every new opening every week.
A scored, explained shortlist — not a keyword match — delivered weekly. Free for one profile.