As a Sr. Data Engineer, you'll design and build data systems for analysis and machine learning, focusing on data ingestion, pipelines, and visualization. You'll work with cloud-based solutions, optimize data storage, and perform transformations using ETL/ELT processes.
As a Sr. Data Engineer, you’ll design, build, optimize and operate systems on cloud to collect, store, process, package and visualize data to extract insights and make it useable for advanced analytics and machine learning. You’ll design data pipelines for batch and streaming data, use big data tools and techniques for processing large amounts of data, and create purpose-built solutions for working with structured, semi-structured, and unstructured data to support analytics and machine learning workloads.
- Identify data sources, data formats, and design for data ingestion using batch and real-time techniques
- Design and build secure, scalable data repositories to store the data, optimizing for cost, compression, scalability, and integration with data processing tools
- Architect pipelines for data processing and transformation using ETL/ELT, SQL, Apache Spark, and other tools to handle high volume and high-velocity data
- Design server-less systems for ad-hoc data analysis
- Use visualization tools on processed data to create meaningful charts, and dashboards based on user-defined metrics
Requirements
- Python programming.
- Concepts of big data.
- Hadoop SQL and relational databases.
- Data warehousing concepts
- Experience Minimum 2 years of experience with AWS in development or operations role
- AWS Solutions Architect Associate certification is mandatory AWS Data Analytics Specialty certification is preferred
Benefits
We do not unfairly discriminate on any ground, including race, caste, religion, color, ancestry, marital status, gender, sexual orientation, age, nationality, ethnic origin, disability or any other category protected by applicable law.
Competitive Salary
Better Growth
Work Life Balance
Similar Jobs
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Build and deploy AI-powered solutions for enterprise and campus customers. Scope environments, prototype agentic AI applications, design secure multi-tenant and hybrid architectures, and harden successful prototypes into production. Own identity, encryption, networking, CI/CD, observability, and production support within customer environments. Collaborate with product, AI, data, and program teams to standardize repeatable solutions. The role is highly customer-facing and requires regular domestic and occasional international travel.
Top Skills:
Api GatewaysAWSAws PrivatelinkCi/CdDockerDuckdbEncryptionFastmcpIamJavaKafkaKey ManagementKubernetesLangchainLanggraphMcpMtlsObservabilityPgvectorPostgresPythonRagTypescriptVpc Peering
Financial Services
Develops secure, scalable full-stack software for JPMorgan Chase’s Asset and Wealth Management Data and Analytics team. Responsibilities include coding with Java, React, TypeScript, Python, and AWS; designing, testing, debugging, and troubleshooting applications; analyzing data; supporting operational stability; and applying agile, CI/CD, security, resiliency, and AI-assisted development practices.
Top Skills:
AgileAi-Assisted Development ToolsAWSCi/CdJavaPythonReactSpring BootSpring JpaTypescript
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Leads a first-line compliance function for liquidity regulatory reporting. Responsibilities include designing compliance test cases, managing testers, executing and analyzing testing, identifying regulatory or policy non-compliance, coordinating remediation with Finance Change and Reporting Operations, and communicating outcomes to senior stakeholders. The role requires expertise in LCR, NSFR, maturity ladders, banking products, regulatory requirements, SQL, ETL transformations, and complex data analysis.
Top Skills:
Cloud PlatformETLRadarSQL
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
