Freelance Data Engineer – Python | Airflow | Azure

We are looking for a hands-on Data Engineer to help build, modernize, and maintain scalable cloud-based data pipelines.

The ideal candidate is strong in Python, Apache Airflow, SQL, Docker, Azure, and modern data processing with Polars. A key part of this role will be modernizing existing data pipelines and migrating orchestration from Azure Synapse Analyticsto Apache Airflow-based frameworks.

We also encourage the use of Claude and Claude Code to improve engineering productivity and delivery.

• Design, develop, and maintain reliable and scalable data pipelines using Python, Polars, and Apache Airflow
• Modernize existing data pipelines and migrate workloads from Azure Synapse Analytics to Airflow-based orchestration
• Build and maintain Dockerized Airflow deployments
• Deploy and manage data solutions across Microsoft Azure
• Work with Azure services such as Azure Storage, Azure SQL, Data Factory, and Key Vault
• Optimize data pipeline performance, reliability, scalability, and cloud costs
• Implement data quality checks, monitoring, alerting, and validation
• Follow engineering best practices around Git, CI/CD, testing, and Infrastructure as Code
• Collaborate with Data Science, Analytics, and BI teams to deliver high-quality data
• Document data pipelines, architecture, and operational procedures
• Use Claude / Claude Code as part of the development and delivery workflow
• Hands-on Apache Airflow experience, especially workflow orchestration and DAG development
• Practical experience with Polars for data processing and transformation
• Experience working with Microsoft Azure
• Understanding of ETL/ELT, data modeling, schemas, and distributed data systems
• Strong Git and CI/CD experience
• Experience with modern data architecture and engineering practices
• Ability to use Claude / Claude Code effectively in software/data engineering workflows

Priority / Good-to-Have Skills

• Delta Lake / Medallion Architecture
• Data quality and observability