Data Platform Engineer

Requirements:5+ years of experience in DevOps, platform engineering, or site reliability engineering roles3+ years of hands-on experience with Microsoft Azure cloud services and Azure DevOpsStrong experience with Microsoft Fabric or related Microsoft data platforms (PowerBI, Azure Synapse Analytics, Azure Data Factory)Expertise in Infrastructure as Code tools(Terraform, Ansible, ARM templates, Cloud Formation)Proficiency in scripting and programming languages including Python, PowerShell, Bash, and SQLDeep understanding of CI/CD principles and tools (AzureDevOps, GitHub Actions)Experience with containerization and orchestration technologies (Docker, Kubernetes) and cloud services (AKS, EKS, GKE)Experience with cloud blob data services (Azure Storage, AWS S3, GCP Cloud Storage) and cloud managed relational databases (Azure SQL, Amazon RDS, GCP Cloud SQL)Strong knowledge of data warehousing, data lakes, lake house architectures, and ETL/ELT processesHands-on experience with monitoring and observability tools(Azure Monitor, Prometheus, Grafana, ELK Stack, Datadog)Understanding of storage ACLs, network security, encryption, identity management, and cloud security best practicesExperience deploying and managing Microsoft Fabric workspaces, capacities, and itemsKnowledge of One Lake architecture, shortcuts, mirroring, maintenance, and securityFamiliarity with Fabric REST APIs and SDK for automation and integrationExperience with Fabric Git integration and deployment pipelinesKnowledge of Power BI administration and deployment best practicesProficiency in designing scalable ETL/ELT architectures and data pipeline orchestration strategiesKnowledge of Delta Lake, Parquet for optimization techniques such as partitioning/clusteringDeep understanding of data lakehouse architecture, medallion patterns, and data mesh organizational frameworks Responsibilities:Platform Engineering & Architecture Design, build, and maintain the Microsoft Fabric data platform infrastructure, including OneLake, Data Warehouse, Lakehouse, Data Factory pipelines, Real-Time Intelligence, and Power BI environmentsImplement and manage platform architecture supporting data engineering, data science, analytics, and business intelligence workloads across the organizationDevelop and maintain Infrastructure as Code (IaC) solutions using Terraform, Azure Resource Manager templates, or similar tools for consistent, repeatable deploymentsArchitect multi-region, scalable solutions within Microsoft Fabric to support global humanitarian operationsDesign and implement OneLake storage structure, shortcuts, mirroring configurations, and data lake optimization strategies CI/CD & Deployment Automation Build and maintain comprehensive CI/CD pipelines for Microsoft Fabric workspaces using Azure DevOpsImplement automated deployment strategies utilizing Fabric REST APIs, Git integration, Fabric deployment pipelines, and fabric-cicd toolsManage source control integration with Microsoft Fabric workspaces, establishing branching strategies and deployment workflows across development, test, and production environmentsAutomate infrastructure provisioning, configuration management, and deployment processes for all Fabric componentsDevelop and maintain deployment rules, parameterization strategies, and environment-specific configurations Platform Maintenance & Operations Perform ongoing maintenance of Microsoft Fabric platform components including capacity management, workspace administration, and item lifecycle managementMonitor platform health, performance metrics, and resource utilization using Azure Monitor, Prometheus, Grafana, or integrated Fabric monitoring capabilitiesImplement comprehensive observability and alerting framework covering logs, metrics, and traces across the entire data platformConduct regular platform updates, patches, and upgrades while minimizing disruption to users and maintaining system stabilityManage disaster recovery procedures, backup strategies, and business continuity planning for critical data assetsOptimize platform performance through capacity planning, resource allocation, and cost management strategies Security, Governance & ComplianceImplement and enforce security controls using Microsoft Purview for data governance, classification, and protection across the Fabric ecosystemConfigure and maintain role-based access controls (RBAC), row-level security, column-level security, and OneLake folder/table-level permissionsEstablish and enforce data sensitivity labeling, information protection policies, and data loss prevention (DLP) measuresIntegrate Microsoft Entra authentication, manage service principals, and implement managed identities for secure platform accessEnsure compliance with global regulatory frameworks including GDPR, HIPAA, and ISO standards through automated controls and auditingImplement network security measures including conditional access, private endpoints, customer-managed encryption keys, and secure data sharing protocolsMonitor and respond to security incidents, conducting regular security assessments and vulnerability management Automation & ScriptingDevelop automation scripts using Python, PowerShell, Bash, and Azure CLI for routine operational tasks and platform managementCreate custom tooling and utilities to enhance platform capabilities and improve developer experienceAutomate data pipeline orchestration, monitoring, alerting, and incident response workflows