The Bigdata Engineer will design and develop ETL/Hadoop and analytics components, ensuring performance optimization and adherence to architectural standards, while managing distributed computing tasks and data ingestion workflows.
This is a remote position.
Responsibilities:
- As a developer, possess excellent Knowledge of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reduce, H base, HIVE, Impala) and related technologies.
- Technical Design and development of ETL/Hadoop and Analytics services /components
- Contribute in end to end architecture and process flow
- Understand Business requirement and publish reusable designs
- Result oriented approach with ability to provide apt solutions.
- Proficient in performance improvement & fine-tuning ETL and Hadoop implementations
- Conduct code reviews across projects. Takes responsibility for ensuring that build and code adhere to architectural and quality standards and policies.
- Can work independently with minimum supervision.
- Strong analytical and problem solving skills
- Experience/Exposure to SQL, advanced SQL skills
Requirements
Skills Set:
- Strong understanding of distributed computing architecture, core hadoop component (HDFS, Spark, Yarn, Map-Reuduce, H base, HIVE, Impala) and related technologies.
- Hands on experience with batch data ingestion (Sqoop)
- Expert level understanding of relational data structure and RDBMS as well as NoSQL databases (Cassandra, MongoDB, Elasticsearch)
- Experience with automation/Scheduling of workflows/jobs (via shell-scripting, Tivoli)
- Solid Grasp of data storage formats (Parquet, Avro, HBase, Cassandra)
- Understanding of Agile methodologies as well as SDLC life-cycles and processes.
- Strong Understanding of Data warehousing and lakes
Similar Jobs
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
As a Product Management Director, you will lead the strategy for Coupa's Contract Management solution, solving customer problems, aligning with engineering, and driving market adoption.
Top Skills:
AIData AnalyticsSaaS
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Support regulatory reporting and modelling activities: gather and cleanse model inputs, prepare datasets and run models, validate regulatory/financial data and outputs, translate regulatory rules into data, controls and reports, document requirements, work with testing/tooling for traceability and automation, and support ESG risk quantification, climate scenario design and capital/liquidity resilience analysis.
Cloud • Information Technology • Security • Software • Cybersecurity
Lead strategic, multi-threaded pursuit efforts for major digital transformation deals in cloud security. Shape sales strategy, align cross-functional teams, build proposals and roadmaps, engage C-suite stakeholders and partners, and drive high-impact deal closures and long-term partnerships.
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
