The Senior Software Engineer will design and implement scalable data solutions utilizing AWS services, develop data pipelines with Databricks and Snowflake, and manage ETL/ELT processes. Responsibilities include optimizing queries, ensuring data quality, and using CI/CD tools for deployment automation.
Position : Sr Data Engineer.
Location : Bangalore/Hyderabad/Noida.
Immediate joiners preferred.
Required:
- Extensive experience in data engineering with a strong focus on designing and implementing complex and scalable data solutions using AWS services like MWAA and Lambda, RDS (7+ years).
- Proficient in Databricks (5+ years) using pyspark, Delta tables, Unity catalog, SQL Warehouse for optimizing data pipelines, ensuring high performance, managing big data processing tasks in an optimized manner, and writing reusable framework.
- Proficient in Snowflake (4+ years) and Snowpark for optimizing queries, schemas, and implementing security layers.
- Strong architectural knowledge coupled with RBAC concepts
- Strong SQL skills with the ability to write, optimize, and troubleshoot complex queries.
- Demonstrated problem-solving skills with the ability to analyze, diagnose, and resolve technical issues efficiently.
- Experience in developing and maintaining ETL/ELT processes to ensure data is accurately and efficiently loaded into data warehouses and data lakes.
- Knowledge of data quality frameworks, exception handling and adherence to common standards and compliance.
- Experience using CI/CD tools such as CDK, CloudFormation, and Terraform to automate deployments both IaaC and DAGs across environments.
Top Skills
AWS
Pyspark
Snowflake
SQL
Similar Jobs
Be an Early Applicant
As a Senior Lead Software Engineer, you will tackle complex technical problems, promote tech standards, improve engineering culture, guide architecture discussions, and foster stakeholder collaboration. You will engage in recruitment, technology events, and develop innovative solutions while leading projects through their lifecycle.
Be an Early Applicant
As a Lead Software Engineer, you will design and develop scalable systems, build microservices, collaborate with teams across regions, and improve product delivery. You will maintain high-quality software through testing and debugging while leading efforts in technology solutions.
Be an Early Applicant
The Senior Lead Software Engineer will enhance, build, and deliver technology products while providing technical guidance and reviewing code. They will tackle challenges across multiple technologies, drive product design decisions, and contribute to a diverse team culture.
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
