Senior Data Engineer
Apply by 19 Jan 2027
About the job
About the RoleJoin a data and infrastructure team building a platform that turns information from multiple sources into reliable, current company intelligence. You will own the platform across architecture, ingestion, and production operations, helping deliver trusted data for downstream products.
What You'll Do
- Design and build a multi-source data platform for concurrent ingestion, event-driven processing, and orchestrated batch workflows.
- Develop resilient intake from provider APIs, webhooks, files, and web scraping, including rate limits and failure handling.
- Orchestrate scheduled workflows and historical backfills using tools such as Airflow, Dagster, or Prefect.
- Build event-driven systems with messaging and task queues, including retries, dead-letter handling, and controlled replay.
- Store original payloads in cloud object storage and transform data with dbt into raw, standardized, and curated layers.
- Implement idempotent upserts, data contracts, automated validation, pipeline tests, and monitoring for freshness and failures.
- Design and optimize PostgreSQL schemas and loading patterns, and integrate enrichment and LLM-based structured extraction.
What We're Looking For
- At least 5 years building and operating production data platforms, with ownership from architecture through deployment and ongoing operations.
- Hands-on production experience with dbt and Google Cloud Platform, plus workflow orchestration such as Airflow, Dagster, Prefect, or Temporal.
- Experience with event-driven systems, messaging or task queues, asynchronous processing, retries, and failure recovery.
- Strong Python skills, including asynchronous HTTP and concurrent processing with tools such as asyncio, aiohttp, or HTTPX.
- Strong SQL and PostgreSQL skills, including data modeling, query optimization, and incremental loading.
- Experience with data contracts, raw and curated storage, retention policies, automated testing, and pipeline monitoring.
- Startup or small-team experience, with broad ownership and changing priorities; web scraping, entity resolution, and data enrichment experience are helpful.
Compensation & Benefits
Base salary: $80,000 to $120,000 annually. Visa sponsorship is not available.
Location
Remote within Latin America.
Compensation Range: $80K - $120K
Originally posted on Himalayas
Skills
Similar jobs
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors includ…
Kinyarwanda Language Specialist - AI Trainer
Are you a Kinyarwanda language expert eager to shape the future of AI? Large-scale language models are evolving from simple chatbots into powerful en…
IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is don…
Role Title: GPU Programmer Software Engineer Role Type: Contractor Location: Remote In this role, you will apply your expertise as a GPU programmer t…
Bioinformatics Scientist – Remote (Worldwide)
IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is don…
IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is don…