Automation Test Lead – Data & Quality Engineering
Automation Test Lead – Data & Quality EngineeringWe’re looking for a hands-on Automation Test Lead to architect and scale enterprise-grade automation across data platforms, APIs, and cloud-native systems. You’ll own Quality Engineering standards, build frameworks adopted across teams, prevent production failures, and leverage AI-driven approaches to accelerate automation.Key ResponsibilitiesArchitect scalable, modular, metadata-driven automation frameworks for batch/streaming data pipelines, APIs, backend services, and end-to-end data products.Build Python-based data testing frameworks with SQL assertions/reconciliation, schema validation, data contracts, lineage/freshness checks, and YAML/JSON-driven tests.Test failure scenarios including schema drift, incompatibility, late/duplicate/missing/out-of-order data, partial failures, retries, DLQs, backpressure, concurrency, and stress.Validate ETL/streaming using row/aggregate/hash reconciliation, incremental/backfill validation, delivery semantics, and time/window correctness.Integrate Great Expectations/Soda for accuracy, completeness, uniqueness, timeliness, and quality dashboards.Embed automation into CI/CD & DataOps with pre-merge gates, release blockers, parallel/selective execution, Jenkins/GitHub Actions.Implement synthetic/test data, masking/anonymization, deterministic datasets, performance/reliability testing, and cost optimization.Ensure PII/PHI, encryption, access control, retention, audit compliance across GxP/SOX/ISO environments.Partner with data/platform/architecture teams, mentor engineers, perform RCA, and reduce flaky tests, false positives, incidents, and wasted compute.Mandatory Skills9+ years Automation/QE | 5+ years data-platform framework engineering | Strong Python | Advanced SQL | dbt | Airflow | Snowflake or equivalent | ETL/ELT | Data Modelling | Great Expectations/Soda | Lineage/Catalog | Kafka/Kinesis & delivery semantics | Git | Jenkins/GitHub Actions | AWS | Terraform/CloudFormationDesiredPACT/API contract testing | UI automation | Data Mesh/Data Products | Prometheus/Grafana | Healthcare/Life Sciences/FinanceIdeal candidate: An engineer who challenges architecture, builds frameworks teams actually adopt, and designs quality systems that make production bugs difficult to exist.