Automation Test lead (Data Testing)

Automation Test LeadWork Location - Remote from EUB2B / Freelancing Contract (long term)

Requirements - Key Responsibilities: Test Automation Architecture & Strategy: Own a scalable, modular, metadata-driven framework covering data pipelines (batch/streaming), APIs/backend services, and end-to-end data product validation; enable plug-and-play components, parallel execution, environment isolation, deterministic runsData Testing Framework Engineering: SQL-based assertions/reconciliation, schema validation, data contracts, lineage/freshness validation, config-driven test definitions (YAML/JSON)Destructive Testing: Schema drift, backward incompatibility, late-arriving data, partial failures, duplicate/missing/out-of-order events, stress, concurrency, retries, DLQ handling, backpressureETL/Streaming Validation at Scale: Row/aggregate/hash-based reconciliation, incremental/backfill validation, delivery semantics validation, window/time-based correctnessData Quality & Observability: Integrate/extend Great Expectations or Soda; custom validations for accuracy, completeness, uniqueness, timeliness; quality dashboardsCI/CD & DataOps Enforcement: Pre-merge gates, release blockers, selective/parallel test execution, GitHub Actions/Jenkins integrationTest Data Management: Synthetic data generation, masking/anonymization, deterministic datasets, edge case simulationPerformance & Reliability Testing: Pipeline/query benchmarks, concurrency/stress testing, data skew analysis, cost/time optimizationSecurity & Compliance: PII/PHI exposure checks, encryption/access control, retention, audit requirements; support GxP/SOX/ISO frameworksCross-Functional Quality Leadership: Work with data engineers, platform teams, architects; mentor engineersIncident Analysis & Prevention: Root-cause analysis of production data issues, reduce flaky tests Mandatory Skills: Strong Python (test frameworks, libraries, CLI tools); advanced SQLHands-on DBT, Airflow, Snowflake or similar; ETL/ELT and data modelingGreat Expectations/Soda; lineage and catalog systemsKafka/Kinesis testing; delivery semanticsGit workflows; CI/CD (Jenkins, GitHub Actions)AWS; IaC (Terraform/CloudFormation)