Design and build scalable batch and real-time data pipelines using Databricks, PySpark, Structured Streaming, Delta Lake, and Medallion Architecture. Develop reusable ingestion and data quality frameworks, implement ABAC and RBAC security, and build agentic AI workflows using MCP and serverless computing. Create RAG pipelines with vector database integration, while managing governance, lineage, access controls, CI/CD, and LLM evaluation frameworks through Unity Catalog.
Senior Data engineer Key Responsibilities • 7 to 10 years of experience in data engineering and minimum of 3+ years of experience working in Databricks • 4+ years Working in leveraging Pyspark for building reusable Data ingestion and Data quality frameworks • Lakehouse & Data Engineering: Design scalable batch and real-time ETL pipelines using PySpark, Structured Streaming, and Delta Lake built on a Medallion Architecture (Bronze, Silver, Gold). • ABAC and RBAC Security - Experience in setting up ABAC and RBAC security for Agentic AI Journey use cases • Agentic AI & Orchestration: Build autonomous, multi-agent workflows and reasoning loops using MCP Protocol and Serverless compute . • RAG & Vector Integration: Develop end-to-end Retrieval-Augmented Generation (RAG) pipelines and integrate vector databases for semantic retrieval. • Governance & Operations: Manage data lineage, access controls, and security using Unity Catalog alongside CI/CD workflows and LLM evaluation frameworks
Hexaware Technologies Noida, Uttar Pradesh, IND Office
1st Floor, Building No.7, M/s. Seaview Developers Pvt. Ltd., IT/ITES SEZ, Plot No. 20 & 21, Sector - 135, Noida, Noida, India, 201 304
Similar Jobs
Information Technology • Consulting
Design and implement enterprise-scale data platforms, strategies, and modern cloud data architectures. Define architecture standards, build scalable and secure data platforms, and architect end-to-end solutions spanning data ingestion, transformation, storage, governance, analytics, and consumption. The role requires strong hands-on expertise with dbt and Snowflake, along with broad knowledge of the modern data ecosystem.
Top Skills:
Cloud-Native TechnologiesData LakesData WarehousingDbtSnowflake
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Designs and implements multi-cloud security controls, policy-as-code guardrails, IAM and network protections, container and Kubernetes security, vulnerability remediation, and incident response tooling. Partners with engineering, IT, compliance, and risk teams on audits and control validation. The role also mentors security engineers, supports root-cause analysis, improves response runbooks, and participates in on-call rotations.
Top Skills:
AWSAzureBashCi/CdContainer SecurityEdrGCPIamInfrastructure As CodeJavaScriptKubernetesNaclsOrganizations/ScpsPythonVpcVulnerability Scanning
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Supports cloud, application, infrastructure, container, and Kubernetes security engineering. Contributes to multi-cloud controls, IAM policies, policy-as-code guardrails, vulnerability triage, compliance evidence gathering, security automation, and secure AI system monitoring. The role also involves scripting, documentation, root-cause analysis, and collaboration with Engineering, IT, Compliance, and senior security engineers.
Top Skills:
AWSAzureBashCi/CdContainer SecurityFedrampGCPIamInfrastructure As CodeIso 27001JavaScriptKubernetesNetwork AclsOrganizations/ScpsPci-DssPolicy As CodePythonSecurity GroupsSoc 2VpcVulnerability Scanning
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
