Blend360 Jobs

Databricks Engineer - Senior/ Lead

Blend360

Databricks Engineer - Senior/ Lead

Posted 8 Days Ago

Be an Early Applicant

In-Office or Remote

Hiring Remotely in Hyderabad, Telangana

Senior level

In-Office or Remote

Hiring Remotely in Hyderabad, Telangana

Senior level

Design, build, and optimize scalable data pipelines and ETL/ELT workflows using Azure Databricks, Python, SQL, PySpark, and Spark. Manage Delta Lake tables and integrate Azure Data Lake Storage. Work with structured and semi-structured data, optimize performance and cost, ensure data quality and governance, and support analytics and machine learning use cases. Collaborate with data scientists, analysts, and stakeholders while applying security, access control, monitoring, and modern data engineering practices.

The summary above was generated by AI

Company Description

Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com.

Job Description

We are looking for an experienced Azure Databricks Engineer with strong hands-on expertise in Python, SQL, and Apache Spark to design, build, and optimize scalable data pipelines and analytics solutions on the Azure cloud platform. The ideal candidate should have experience working with large datasets, distributed data processing, and modern data engineering practices.

Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Databricks

Implement ETL/ELT workflows using PySpark, Spark SQL, and Python

Optimize Spark jobs for performance, cost, and scalability

Work with structured and semi-structured data (Parquet, Delta, JSON, CSV)

Build and manage Delta Lake tables (ACID, time travel, schema evolution)

Integrate Databricks with Azure Data Lake Storage (ADLS Gen2)

Develop complex queries and transformations using SQL

Collaborate with data scientists, analysts, and stakeholders to support analytics and ML use cases

Ensure data quality, validation, and monitoring

Follow best practices for security, access control, and governance in Azure

Qualifications

6+ years of experience in Data Engineering

Strong hands-on experience with Azure Databricks

Proficiency in Python for data processing

Strong knowledge of SQL (joins, window functions, performance tuning)

Hands-on experience with Apache Spark / PySpark

Experience working with Delta Lake

Knowledge of Azure Data Lake Storage (ADLS Gen2)

Understanding of distributed computing concepts

Experience with Git version control

Additional Information

Experience with Azure Data Factory

Exposure to CI/CD pipelines (Azure DevOps, GitHub Actions)

Basic understanding of data modeling

Familiarity with cloud security and RBAC in Azure

Exposure to streaming data (Spark Structured Streaming, Event Hub, Kafka)

Similar Jobs

CDW

Product Designer

Yesterday

Remote or Hybrid

India

Entry level

Information Technology

Design end-to-end digital product experiences through user research, interaction design, wireframing, prototyping, visual design, and design systems. Collaborate with product, engineering, and business stakeholders to create accessible, responsive web and mobile interfaces. Conduct usability testing, incorporate feedback and analytics, present design concepts, and support accurate implementation across multiple initiatives.

Top Skills: A/B TestingAdobe Creative SuiteComponent LibrariesCSSDesign SystemsFigjamFigmaHTMLProduct AnalyticsWcag

CDW

Consultant

Yesterday

Remote or Hybrid

India

Senior level

Information Technology

Lead the design and development of scalable full-stack applications powered by Generative AI and LLMs. Build RAG pipelines, agentic workflows, and AI applications using React, Node.js, LangChain, and LangGraph. Integrate LLMs with APIs, databases, and enterprise systems while ensuring security, reliability, and production readiness. Provide architecture guidance, conduct code reviews, mentor developers, troubleshoot issues, and lead solutions from design through deployment and support.

Top Skills: AnthropicAzure OpenaiEmbeddingsGenerative AiJavaScriptLangchainLanggraphLarge Language Models (Llms)MicroservicesNode.jsOpenaiPythonRagReactRest ApisSemantic SearchTypescriptVector Databases

Motive

Operations Manager

Yesterday

Easy Apply

Remote

India

Easy Apply

Senior level

Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation

Manage end-to-end digital marketing campaign development and execution, including email builds, audience segmentation, testing, deployment, automation, and performance optimization. Administer the marketing automation stack, support lead lifecycle and nurturing processes, maintain marketing data quality, track campaign KPIs, and coordinate with cross-functional stakeholders. The role also develops campaign processes, documentation, templates, and best-practice enablement while managing multiple initiatives.

Top Skills: 6SenseAi Automation ToolsMarketoPendoSalesforceZuddl

What you need to know about the Delhi Tech Scene

Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.