Senior Data Engineer

About the role

A data infrastructure and analytics team is looking for a Senior Data Engineer to build a platform that turns information from many sources into reliable, up-to-date company intelligence. You will own the platform end to end, from architecture and ingestion to production operations, so that downstream products can trust the data.

Key responsibilities

• Design and build a multi-source data platform for concurrent ingestion, event-driven processing and orchestrated batch workflows.
• Ingest data from provider APIs, webhooks, files and web scraping, with rate limits and robust failure handling.
• Orchestrate scheduled workflows and historical backfills with tools such as Airflow, Dagster or Prefect.
• Build event-driven systems with messaging or task queues, including retries, dead-letter queues and controlled replay.
• Store original payloads in Google Cloud Storage and transform data with dbt into raw, standardized and curated layers.
• Implement idempotent upserts, data contracts, validation, pipeline tests and monitoring for freshness and failures.
• Design and optimize PostgreSQL schemas and loading patterns, and integrate enrichment and LLM-based structured extraction.

Required profile

• At least 5 years building and operating production data platforms, integrating multiple sources from architecture through deployment and ongoing operations.
• Production experience with workflow orchestration, including dependencies, retries and failure recovery; Airflow experience preferred.
• Hands-on production experience with dbt and Google Cloud Platform.
• Experience with data contracts, raw and curated storage, retention policies, automated validation, pipeline testing and monitoring.
• Experience building platforms or substantial pipelines from scratch is valuable; web scraping, entity resolution, LLM-based extraction, BigQuery and Dataform experience are also useful.

Required skills

• Strong Python, including asynchronous HTTP and concurrent processing with asyncio, aiohttp or HTTPX.
• Strong SQL and PostgreSQL, including data modeling, query optimization and incremental loading.
• Event-driven systems, messaging or task queues, and asynchronous failure recovery.

What we offer

• Base salary of $100,000 to $140,000 USD annually.
• Visa sponsorship is not available.
• Remote work within Europe, including the United Kingdom, Norway, Switzerland, Iceland, Liechtenstein and Ukraine.