Design, build, and maintain scalable data pipelines and ETL/ELT solutions using Microsoft Azure Fabric, Databricks, and Azure data services. Translate business requirements into technical solutions, optimize data workflows for performance and cost, troubleshoot production issues, and collaborate with architects, analysts, developers, and global stakeholders. Use AI-assisted development and automation to improve engineering productivity while owning delivery quality, timelines, and outcomes.
This role is for one of Weekday’s clients
Min Experience: 5+ years
Location: India
JobType: full-time
This is a full-time Remote role for an experienced Data Engineer who enjoys solving complex data problems and takes ownership from design through delivery. You can work from home (anywhere in INDIA, job location is in India).
This role is ideal for someone who can build scalable data pipelines on Microsoft Azure Fabric, leverage AI to improve engineering productivity, and work closely with business and technical stakeholders.
Requirements
Qualifications:
- 5+ years of hands-on experience as a Data Engineer.
- Strong experience with Microsoft Azure Fabric, Databricks and Azure data services.
- Solid knowledge of SQL and data modeling concepts.
- Experience building enterprise-grade data pipelines and data integration solutions.
- Proficiency in Python, Spark, or similar technologies is preferred.
- Experience working with cloud-based data platforms in production environments.
Key Skills:
- Design, develop, and maintain scalable data pipelines using Microsoft Azure Fabric.
- Build reliable ETL/ELT processes for structured and unstructured data.
- Work with business teams to understand data requirements and translate them into technical solutions.
- Optimize data processing workflows for performance, scalability, and cost.
- Apply AI-assisted development tools and modern engineering practices to improve delivery speed and solution quality.
- Troubleshoot production issues and proactively identify improvements.
- Collaborate with architects, analysts, and developers throughout the project lifecycle.
- Owns their work. Take responsibility for quality, timelines, and outcomes without constant follow-up.
- Thinks beyond the obvious. Actively use AI and automation to solve problems, improve engineering productivity, and deliver better solutions.
- Communicates proactively. Raise risks early, ask questions when something isn't clear, and keep stakeholders informed.
- Adapts quickly. Requirements evolve, and you're comfortable adjusting priorities while maintaining delivery commitments.
- Works collaboratively. Available to engage with global teams and can overlap with the U.S. East Coast during critical discussions (up to 1:00 PM ET, as needed).
Must-have skills
Databricks, Fabric, Data Engineering
Similar Jobs
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Big Data Analytics • Automation
Designs and optimizes scalable data ingestion pipelines for product telemetry and enterprise business data. Builds automated pipelines using Fivetran, Python, APIs, S3 lakehouse architectures, Kafka, Spark, and Snowflake. Applies advanced SQL, incremental loading, CDC, micro-batching, and rate-limit handling to support reliable, analytics-ready datasets. Implements CI/CD and DevOps practices, monitors pipeline performance, and partners with analysts and platform teams to rapidly deliver data solutions.
Top Skills:
Amazon S3SparkBulk ApisCdcCi/CdDevOpsFivetranKafkaPythonSnowflakeSQLVersion Control
HR Tech • Productivity • Professional Services • Software
Design, build, and maintain scalable cloud-based data pipelines, models, workflows, and transformations. Own pipeline architecture, orchestration, monitoring, reliability, performance, and data quality. Manage PostgreSQL, Redshift, Airflow, and Terraform-based infrastructure while applying software-engineering practices such as testing, code review, observability, and documentation. Collaborate with globally distributed technical and business teams to improve data literacy and deliver trusted information.
Top Skills:
Amazon RedshiftApache AirflowAWSDockerPostgresPythonSQLTerraform
Information Technology
Designs, builds, deploys, and supports secure, scalable cloud data solutions and pipelines for enterprise clients. Translates business requirements into data architectures, integration patterns, and models; ensures performance, reliability, governance, and documentation. Provides technical leadership during reviews and workshops, collaborates with engineering and analytics teams, contributes reusable accelerators and best practices, mentors colleagues, and manages client engagements through delivery.
Top Skills:
AdlsAirflowAWSAws Data Migration ServiceAws Managed AirflowAzureAzure Data FactoryCassandraDatabricksDbtElasticsearchFivetranGCPGcsGoogle DataprocHadoopHdfsInformatica Intelligent Cloud ServicesKafkaKuduLuigiMatillionNifiPythonS3ScalaSnowflakeSolrSparkSpark StreamingSQLStreamsets
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
