Data Engineer

Data Engineer – Data Ingestion & AWS10 Month Contract - High chance of ExtensionFully Remote€400-500 per day Sentinel is working with a global leader in technology, software, and services for the construction and engineering sector. The business is developing its marketing data platform and is looking for an experienced Data Engineer to build new ingestion pipelines and improve existing data flows across digital and marketing data sources. You’ll work within a modern AWS-based data environment, developing pipelines for external sources such as AppsFlyer, Didomi, and Google Search Console, while improving data quality, performance, and reliability. This is a hands-on role requiring strong Python and SQL skills, with exposure across data ingestion, transformation, modelling, orchestration, and quality. Key responsibilitiesDesign, build, and maintain scalable and reliable data ingestion pipelinesDevelop ingestion pipelines for external APIs, marketing platforms, and digital data sourcesModify and enhance existing Lambda functions, SQL queries, and data processing jobsRefactor existing pipelines to improve maintainability, scalability, and reliabilityDesign analytical data models across silver and gold data layersDevelop and optimise schemas using Apache Iceberg and modern data modelling principlesBuild automated data validation and quality checks across critical datasetsOptimise SQL queries and data processing workloads for performance and cost efficiencySupport pipeline orchestration, monitoring, failure recovery, and operational reliabilityApply engineering best practices around automated testing, CI/CD, and Infrastructure as CodeMaintain clear technical documentation covering transformations, code, and key engineering decisionsManage code through GitLab using appropriate version control and development practicesCollaborate with engineers, product teams, and data stakeholders to understand requirements and deliver effective solutions What we're looking forStrong professional experience as a Data Engineer or within a comparable data engineering roleProven experience designing and developing scalable, reliable, and maintainable data pipelinesStrong Python-based data engineering and development skillsStrong SQL skills, including complex queries, analytical data modelling, and performance optimisationStrong data modelling and schema design experienceExperience ingesting and processing data from external systems, APIs, or third-party platformsExperience working with cloud-based data platforms and modern data architecturesFamiliarity with pipeline orchestration tools such as Apache AirflowExperience with CI/CD, automated testing, and modern software engineering practicesGood understanding of data quality, validation, and pipeline reliabilityClear communication skills and the ability to work effectively with engineering, product, and data stakeholdersPragmatic approach with a strong sense of ownership Nice to haveHands-on AWS experience, particularly with Athena, Lambda, Glue, EventBridge, Aurora, and/or SageMakerExperience with Apache Iceberg and optimising Iceberg tablesExperience with dbt Core or dbt Cloud for SQL transformations, modelling, testing, and documentationExperience optimising Athena queries or Spark workloads for performance and costUnderstanding of data observability, monitoring, and automated failure recoveryExperience applying Test-Driven Development within data engineeringExposure to AI-assisted coding practicesPrevious experience working with marketing or digital data sources such as AppsFlyer, Didomi, or Google Search ConsoleExperience working within Agile/Scrum teams in a global organisation Please apply now for more details! Joel Hawkins - Directorjoel.hawkins@sentinelit.com+44 1892 484 345