Build and automate data validation and reconciliation tests for ETL pipelines and data warehouses. Write and optimize complex SQL, investigate data discrepancies, design ETL test strategies, and implement automated testing frameworks to ensure data integrity.
We are seeking a highly skilled and detail-oriented Software Development Engineer in Test (SDET) to join our team with a focus on data reconciliation, complex SQL, and ETL testing. The ideal candidate will have a unique blend of skills in software development, quality assurance, and data engineering. You will be responsible for ensuring data accuracy, validating ETL processes, and building automation frameworks for data-related testing processes. This is a key role to ensure the integrity and quality of our data infrastructure and analytics platforms.
Key Responsibilities:
- Complex SQL Queries:
- Write and optimize complex SQL queries to validate data pipelines, transformations, and reporting accuracy.
- Perform root cause analysis of data discrepancies and provide insights into data quality issues.
- Develop automated SQL scripts to streamline data validation and reconciliation processes.
- ETL Testing:
- Validate ETL processes by designing comprehensive test strategies to ensure data accuracy and completeness.
- Test and verify ETL pipelines from various data sources (structured and unstructured) into data warehouses, ensuring data conforms to business rules and logic.
- Implement automated ETL testing frameworks and continuously improve them to optimize the data validation process.
- Data Reconciliation:
- Develop, implement, and automate test scripts to validate data integrity between source and target systems.
- Identify and resolve data inconsistencies, mismatches, and errors in large datasets.
- Design and execute reconciliation processes to ensure accurate data migration and transformation.
Nice to have:
- Experience with HiveQL for Hive Database
- Experience with Python as a scripting language
Similar Jobs
.jpeg)
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Responsible for lab equipment maintenance, calibration, troubleshooting, and team leadership while ensuring compliance with regulations and conducting failure analysis.
Top Skills:
3D X-RayBend TesterCsamFibFtirHast ChamberIso/Iec 17025LinuxReflow OvenSemShock TesterSoak ChamberTemp CycleTemperature ChamberTesterThbWindowsX-Section
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Responsible for setup, maintenance, calibration, and troubleshooting of lab equipment. Lead technician team and ensure compliance with safety and quality standards.
Top Skills:
3D X-RayBend TesterCsamFibFtirHast ChamberIso/Iec 17025LinuxReflow OvenSemShock TesterSoak ChamberTemp CycleTemperature ChamberTesterThbWindowsX-Section
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Manage US sales and use tax compliance across jurisdictions, including preparing and filing returns, tax data extraction and reconciliations, month-end accruals and GL reconciliations, supporting state and local tax audits, improving tax processes and automation, and partnering with Tax, Accounting, IT, and business teams on tax treatment and reporting.
Top Skills:
AlteryxAvalaraClaudeExcelOnesourceOraclePower BISAPVertex
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
