Design, build, and maintain scalable ETL/ELT pipelines and data warehouses using Snowflake, AWS Glue, Python, and SQL. Optimize performance, implement CI/CD with Azure DevOps, ensure data quality and governance, collaborate with analytics teams, and troubleshoot pipeline issues.
Job Description - Sr Data Engineer
Experience: 5 to 7 years
Preferred Locations: Delhi NCR, Gurgaon, Noida, Bangalore, Jaipur, Indore, Ahmedabad (please avoid Pune and Hyderabad)
Mandatory Skills: Strong hands-on experience in Snowflake, Python, SQL, and AWS Glue
Job Summary
We are looking for a highly skilled Data Engineer with strong expertise in Snowflake, Python, SQL, AWS Glue, and modern data engineering practices. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, ensuring data quality, and supporting business intelligence and analytics initiatives.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for processing large volumes of data.
- Build and optimize data models, data warehouses, and data lake solutions.
- Develop robust data integration workflows using AWS Glue and orchestration tools such as Apache Airflow.
- Manage and optimize Snowflake environments, including performance tuning, query optimization, and cost management.
- Write efficient and scalable SQL queries and Python scripts for data transformation and automation.
- Implement CI/CD practices and deployment automation using Azure DevOps.
- Collaborate with cross-functional teams including Data Analysts, Data Scientists, Product Managers, and Business Stakeholders.
- Ensure data quality, governance, security, and compliance across data platforms.
- Participate in Agile/Scrum ceremonies and contribute to continuous improvement initiatives.
- Troubleshoot and resolve data pipeline and performance-related issues.
Required Skills & Qualifications
- 5+ years of experience in Data Engineering or related roles.
- Strong proficiency in SQL and Python.
- Hands-on experience with Snowflake Data Warehouse architecture, administration, and performance optimization.
- Proven experience with AWS Glue for data integration and transformation.
- Experience with workflow orchestration tools such as Apache Airflow.
- Strong understanding of data modeling, data warehousing, and data lake concepts.
- Experience with Azure DevOps, including version control, CI/CD pipelines, and deployment automation.
- Familiarity with cloud-based data solutions and best practices.
- Experience working in Agile/Scrum environments.
- Excellent problem-solving, analytical, and communication skills.
Preferred Qualifications
- Experience with large-scale data migration and modernization projects.
- Exposure to AWS cloud services and ecosystem.
- Knowledge of data governance and security best practices.
- Relevant cloud or Snowflake certifications are a plus.
Similar Jobs
Database • Analytics
The Senior Data Engineer will enhance the data warehouse platform, develop reusable components, optimize data models, and contribute to team efforts in a fast-paced startup environment.
Top Skills:
AirflowAWSClickhouseDbtGithub ActionsPython
Blockchain • Hardware • Software • Energy • Cryptocurrency • Big Data Analytics
The Data Engineer will build and manage scalable data pipelines and databases, collaborate on architecture, and drive data systems towards real-time capabilities in a fast-paced, innovative environment.
Top Skills:
AirflowClickhouseDockerKafkaKubernetesPl/PgsqlPostgresPythonRedpandaTrino
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Python Developer, you will develop fullstack applications, manage backend systems, and collaborate to drive technical solutions that impact business results.
Top Skills:
C++DockerGoJavaJavaScriptKubernetesNext.JsPythonReactRust
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
