Top Data Engineer Jobs in Delhi

Principal Data Engineer responsible for developing and supporting Databricks pipelines, integrating heterogeneous healthcare data sources, modeling unified data products, and ensuring data quality and availability. The role partners with business stakeholders, product teams, data engineers, and clinical leaders to gather requirements, create datasets, support ad hoc analytics, enable machine learning and AI use cases, and assist with acquisition integrations. Extensive healthcare data, cloud, SQL, PySpark, and Python experience is required.

Designs and operates GCP or AWS infrastructure for AI, geospatial, and data-intensive workloads. Builds CI/CD pipelines, manages Docker and Kubernetes environments, supports ML training and inference, optimizes cloud costs, and maintains data pipeline infrastructure. Establishes monitoring, logging, alerting, IAM, secrets management, vulnerability scanning, and network controls. Supports API platforms and collaborates with AI, geospatial, and product teams to resolve deployment, scaling, and reliability issues.

Build and support fund accounting data solutions for asset management, including integrations, transformations, reconciliations, controls, and finance reporting products. Develop large-scale data pipelines using Databricks, Python, PySpark, and SQL; work with investment data, NAV calculations, accruals, corporate actions, fees, and general ledger information. Support cloud-based delivery, data quality, orchestration, CI/CD, and direct collaboration with US stakeholders.

Operate and improve production data infrastructure across large-scale distributed cloud systems. Monitor performance, manage alerts, respond to incidents, perform root cause analysis, automate repetitive tasks, support CI/CD pipelines, document runbooks, and assist with capacity planning. The role requires participation in an on-call rotation and collaboration with Engineering to maintain reliability, efficiency, and uptime.

Provides first-line production support for enterprise applications by monitoring Splunk and New Relic dashboards, investigating alerts, triaging incidents, managing tickets, documenting evidence, escalating issues, and supporting maintenance and deployment windows. The role requires monitoring knowledge, incident management skills, clear communication, and the ability to handle multiple production incidents. Familiarity with AWS data platforms and Python, SQL, Scala, or Shell is preferred.

Leads data engineering initiatives involving ETL/ELT pipelines, database optimization, orchestration, big data technologies, data modeling, BI performance, and data quality monitoring. Requires strong Scala, Python, SQL, and shell scripting skills, plus payments-domain expertise covering transaction processing, settlements, disputes, reconciliation, gateways, acquiring, issuing, and PCI-DSS compliance. The role also involves cross-functional communication, planning, facilitation, negotiation, and collaboration with senior stakeholders and clients.

The Senior Data Engineer is responsible for developing Python applications, optimizing data pipelines, integrating APIs, and collaborating with teams to deliver data solutions.

Design, build, and maintain enterprise ETL/ELT pipelines in Microsoft Fabric; ingest and transform data from diverse sources into dimensional star schemas; optimize performance and cost; implement data quality checks and monitoring; document architecture and pipelines; collaborate with analysts, stakeholders, and global engineering teams to deliver Power BI-ready analytics datasets.

Design and build scalable data and AI infrastructure for production LLM applications. Responsibilities include developing RAG systems, embedding and vector retrieval pipelines, AI agents, LLM evaluation and observability frameworks, and batch or streaming data platforms using Databricks, Spark, Snowflake, Delta Lake, and Airflow. The role also involves optimizing distributed workloads, establishing data governance and quality practices, and partnering with engineering and product teams to productionize AI capabilities.

As a Senior Data Engineer, you will develop and maintain data pipelines for healthcare data, ensuring data quality, reliability, and adherence to enterprise standards while collaborating with architects and stakeholders.

The Senior Data Engineer will develop data ingestion, transformation, and enrichment pipelines, ensuring data quality and reliability. Responsibilities include creating Bronze and Silver data layers, using SQL and dbt for implementation, and collaborating with architects and stakeholders to align data solutions with enterprise standards.

Designs and maintains enterprise data architecture, including conceptual, logical, and physical data models. Establishes data standards, metadata conventions, governance policies, security frameworks, and data dictionaries. Leads Master Data Management initiatives to improve consistency and integrity across platforms. Collaborates with business, analytics, application, and engineering teams, while supporting database, data warehouse, integration, and ETL pipeline efforts aligned with business, regulatory, security, and performance requirements.

Build, optimize, and maintain scalable AWS-based data pipelines and data lakes (Snowflake/Databricks). Implement streaming ingestion (Kinesis/Kafka), CDC, automated data quality checks, and ML-ready feature stores. Collaborate with Product, ML, and Analytics teams, own pipeline QA, observability, and participate in on-call rotations to resolve production data issues.

Build, monitor, optimize, and maintain ETL/ELT pipelines using Google Cloud technologies. Develop complex SQL transformations, design dimensional data models, improve query performance and cloud cost efficiency, and ensure data integrity. Collaborate with analysts and stakeholders to translate SaaS and insurance metrics into technical solutions. Participate in code reviews, documentation, troubleshooting, and data warehouse lifecycle management while supporting US business hours.

Deploy, configure, and operate Rhombus Power's AI platform across cloud, on-premises, and edge environments. Install and validate hardware, networking, and compute infrastructure; support AWS, Docker, containerized applications, CI/CD, monitoring, and troubleshooting. Perform site readiness, rack mounting, backups, UAT, and disaster recovery. Act as on-site technical liaison, maintain deployment documentation, escalate issues, and provide ongoing operational support for defense customers.

Design, build, and maintain scalable ETL pipelines and medallion-schema data architectures. Ensure data quality, perform cleaning and migration, integrate varied sources, and support reporting and analytics in collaboration with stakeholders.

Design, build, and optimize scalable GCP data pipelines and BigQuery data warehouses. Develop ETL/ELT workflows, implement data modeling, ensure data quality, optimize query performance and costs, maintain orchestration with Cloud Composer/Dataflow/Pub‑Sub, and automate deployments with CI/CD while enforcing security and governance.

Develop and maintain reliable data pipelines, ELT processes, workflow orchestration, custom data connectors, and CI/CD pipelines using Airflow, Python, PySpark, Hive/Trino, SQL, and Snowflake. Collaborate with cross-functional teams, monitor and troubleshoot data workflows, validate and test data, document technical processes, and support data governance.

Leads end-to-end data products from ingestion and transformation through semantic modeling, Power BI reporting, documentation, governance, and user adoption. Builds Microsoft Fabric pipelines, Lakehouse or Warehouse architectures, dimensional models, and secure, optimized Power BI solutions. Analyzes data, supports advanced analytics and AI-assisted reporting, establishes quality and CI/CD practices, collaborates with cross-functional stakeholders, and manages data engineers through objectives, reviews, and development.

Design, build, and operate reliable batch and streaming data pipelines, Airflow workflows, dbt models, and analytical data infrastructure. Own ClickHouse architecture, performance, ingestion, and scalability, while supporting BigQuery and NoSQL databases. Implement data quality, observability, monitoring, incident response, backfills, schema evolution, containerization, and CI/CD. Collaborate with analytics, data science, product, and engineering teams to deliver scalable, cost-efficient data platforms.

Design, build, and maintain scalable ETL/data pipelines and data management blueprints. Ingest, transform, and curate large complex datasets for analytics, support cloud (AWS) implementations, enable downstream consumers, and provide technical leadership and operational support to ensure data governance, quality, and automation.

Design and develop scalable data-driven solutions and pipelines using Python and SQL. Leverage Azure data services to build secure, high-performance architectures, ensuring data integrity, governance, and overall success of data projects.

Design and build scalable data pipelines and architectures on Azure using ADF, Databricks, and Synapse. Implement Kimball/Data Vault modeling, write ETL in Python and T-SQL, ensure data governance (Azure Purview), automate tests, troubleshoot issues, document processes, and collaborate across teams.

Design and develop data-driven solutions and scalable data pipelines using Python and SQL. Leverage Azure data products to build robust, secure architectures, ensuring data integrity, performance, and governance while supporting data-centric client projects.

As a hands-on data engineer, you'll build and enhance scalable data platforms, develop data pipelines, and collaborate with various teams to improve data solutions and system performance.