Design and optimize scalable data pipelines and analytics platforms using Snowflake, Airflow, and SQL. Ensure data quality and drive performance optimization.
We’re seeking a Data Engineer with strong Snowflake, Airflow, and SQL expertise to design, build, and optimize scalable data pipelines and analytics platforms. You will own end-to-end ELT/ETL workflows, ensure data quality and reliability, and drive continuous performance and cost optimization. Key Responsibilities Build and maintain ELT/ETL pipelines in Airflow (DAGs, scheduling, monitoring). Design and optimize Snowflake data models, warehouses, and transformations. Write high-quality SQL for complex transformations and analytics use cases. Implement data quality checks, observability, and SLAs/alerts. Optimize performance and cost (warehouses, micro-partitions, clustering, resource monitors). Collaborate with analytics, product, and platform teams; document and automate. Required Qualifications Advanced SQL (CTEs, window functions, performance tuning). Snowflake hands-on (virtual warehouses, stages, external tables, Snowpipe, Streams & Tasks, Time Travel, cloning, RBAC). Airflow 2.x (TaskFlow API, operators/sensors, retries, XComs, DAG best practices). Python for pipeline orchestration and Airflow development. Experience with at least one cloud (AWS, GCP, or Azure) object storage and IAM. CI/CD and version control (Git), code reviews, and environment management. Nice to Have dbt, Terraform/IaC, Docker/Kubernetes for Airflow. Streaming/CDC (Kafka, Kinesis, Pub/Sub, Fivetran, Debezium). Data observability (e.g., Great Expectations), lineage/governance, masking/row access policies. Cost governance and security best practices (PII handling, encryption, compliance).
Similar Jobs
Information Technology • Consulting
Design, build, and optimize scalable data pipelines and analytics solutions on Snowflake. Collaborate with teams for data products and enforce security and governance.
Top Skills:
SnowflakeSQL
Information Technology • Consulting
The role requires leading big data projects with hands-on experience in Azure Databricks, Pyspark coding, advanced SQL, and data warehouse management.
Top Skills:
Azure DatabricksPysparkPythonSQL
Information Technology • Consulting
Design and optimize data pipelines using Azure Databricks and Spark, ensuring data reliability and quality through ETL/ELT workflows and CI/CD automation.
Top Skills:
APIsAzure Data LakeAzure DatabricksPysparkScalaSparkSql DatabaseSynapse
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
