AgileEngine Logo

AgileEngine

Data Engineer ID89384

Reposted Yesterday
Be an Early Applicant
In-Office
New Delhi, Delhi, IND
Senior level
In-Office
New Delhi, Delhi, IND
Senior level
Design, develop, optimize, and productionize scalable ETL/ELT pipelines using Databricks, PySpark, SQL, GCP, BigQuery, and Delta Lake. Build agentic workflows for data engineering automation, implement data quality and monitoring controls, optimize workloads, and support testing, deployment, troubleshooting, and production operations. Collaborate with business, data engineering, and platform teams to identify automation opportunities.
The summary above was generated by AI
We are looking for a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.

The mandatory requirements are 5+ years of hands-on experience with Databricks and PySpark, advanced SQL, GCP, Delta Lake, modern lakehouse architectures, and an upper-intermediate English level.

RECRUITMENT PROCESS
1. Application — Share a few details about your experience and background.
2. Coding Challenge — If applicable, complete it in the coding language you are most comfortable with.
3. Video Interview — Record a short video introduction in English.
4. Technical Interview or Hiring Manager Interview — Discuss your experience and fit for the role.
5. Offer — If it’s a match, you’ll receive an offer.

WHAT YOU’LL GAIN
• Remote work — Work from where you feel most productive.
• Local presence in India — Work in a structured and compliant environment aligned with Indian regulations.
• Competitive compensation in INR — Receive compensation in INR, plus support for learning, education, and wellness.
• Exciting projects — Work with modern technologies for global clients and fast-growing companies.

WHAT YOU WILL DO
• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and operational processes such as data validation, issue identification, troubleshooting, and workflow execution.
• Integrate agentic capabilities with existing Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines and reusable frameworks and components to support new business requirements and datasets across multiple use cases.
• Implement data quality checks, monitoring, validation, exception handling, and production controls.
• Optimize PySpark and SQL workloads for performance, reliability, and scalability.
• Support testing, deployment, productionization, troubleshooting, and ongoing enhancement of data and agentic solutions.
• Collaborate with business, data engineering, and platform teams to identify further automation opportunities.

MUST HAVES
• 5+ years of strong hands-on experience with Databricks and PySpark .
• Advanced SQL and data-processing skills.
• Hands-on experience with GCP , particularly BigQuery .
• Experience with Delta Lake and modern data lake/lakehouse architectures.
• Strong understanding of ETL/ELT, data pipeline design, performance optimization, and data quality.
• Experience building reliable, scalable, production-grade data solutions.
• Strong analytical and troubleshooting skills.
• Understanding of software engineering practices, including testing, version control, deployment, monitoring, and production support.
• Upper-intermediate English level.

NICE TO HAVES
• Experience developing or integrating AI/agentic workflows, AI agents, or workflow automation solutions.
• Experience applying AI to automate data engineering, validation, troubleshooting, or operational processes.
• Familiarity with orchestration and automation frameworks.
• Experience developing reusable data engineering frameworks and platform components.
• Exposure to productionizing AI-enabled solutions with appropriate validation, monitoring, and human oversight.

Similar Jobs

Yesterday
Remote or Hybrid
India
Mid level
Mid level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Develop and execute embedded software verification plans and test cases for core platform components. Perform requirement- and scenario-based testing, change impact analysis, issue resolution, and technical audits. Collaborate with stakeholders, guide junior engineers, support continuous improvement, and ensure quality, cost, and schedule objectives. The role requires C/C++, RTOS, emulator and debugger, and verification-tool experience in an aerospace environment.
Top Skills: As9100BitbucketCC++DeosDoors NgIcdJIRALauterbachLdraLinuxRtosVectorcast/Cover
Yesterday
Remote or Hybrid
India
Mid level
Mid level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Develops and executes verification plans and test cases for embedded platform software. Performs requirements- and scenario-based testing, change impact analysis, technical issue resolution, audit support, and continuous improvement. The role collaborates with stakeholders, guides junior engineers, and uses embedded C/C++, RTOS platforms, emulators, debuggers, and verification tools.
Top Skills: As9100BitbucketCC++DeosDoors NgIcdJIRALauterbachLdraLinuxRtosVectorcast/Cover
Yesterday
Remote or Hybrid
India
Mid level
Mid level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Develops and executes verification plans and test cases for embedded core platform software. Performs requirements- and scenario-based testing, change impact analysis, issue resolution, and technical audits. The role requires embedded C/C++ and RTOS expertise, emulator and debugger experience, testing tools, stakeholder management, and collaboration across engineering teams. Responsibilities also include guiding junior engineers, driving technical improvements, and supporting quality, cost, and schedule objectives.
Top Skills: BitbucketCC++DeosDoors NgIcdJIRALauterbachLdraLinuxRtosVectorcast/Cover

What you need to know about the Delhi Tech Scene

Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account