Lead end-to-end big data development on Azure Databricks using PySpark and SQL. Build and operationalize data ingestion, preparation, integration pipelines across data lakes, data warehouses and marts. Own coding, testing, debugging, and deployment while collaborating with stakeholders and communicating technical designs.
Overall 6.5 - 10 yrs of IT experience preferably in cloud· Min 5 years in Azure Databricks on development projects· Should be 100% hands on in Pyspark coding· Should have strong SQL expertise in writing advanced/complex SQL queries· DWH experience is a must for this role· Experience in programming using Python is an advantage · Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements· Should be able to understand system architecture which involves Data Lakes, Data Warehouses and Data Marts· Experience to own end-to-end development, including coding, testing, debugging and deploymentExcellent communication is required for this role
Similar Jobs
Information Technology • Consulting
Lead end-to-end big data development on Azure Databricks: design/implement data ingestion, preparation, integration and operationalization. Hands-on PySpark coding, advanced SQL, DWH and data architecture knowledge; own coding, testing, debugging and deployment. Strong communication required.
Top Skills:
AzureAzure DatabricksData LakeData MartData WarehousePysparkPythonSQL
Information Technology • Consulting
Design and model Neo4j graph database solutions, define graph schemas, and optimize Cypher queries. Integrate Neo4j with Java, develop backend services using Java 8+ and Spring Boot, build REST APIs, and implement CI/CD on Azure (Azure DevOps). Use Git, Maven/Gradle, and application monitoring.
Top Skills:
Application MonitoringAzure App ServicesAzure DevopsAzure SqlAzure StorageAzure VmsCi/CdCypherGitGradleJavaMavenNeo4JNeo4J DriverRest ApisSpring Boot
Information Technology • Consulting
Design, build, and optimize end-to-end ELT/ETL pipelines into Snowflake, model data for analytics, enforce governance and security, ensure observability and cost controls, and automate deployments via CI/CD and infrastructure-as-code while partnering with analytics, data science, and product teams.
Top Skills:
AdlsCi/CdClusteringData SharingData VaultDimensional ModelingElt/EtlExternal TablesGcsInfrastructure-As-CodeMicro-PartitioningRbacRow-Level SecurityS3SnowflakeSnowpipeSQLStreamsTasksTime TravelVirtual WarehousesZero-Copy Cloning
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
