Perceptive Logo

Perceptive

Senior Data Engineer

Posted 9 Hours Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in Hyderabad, Telangana
Senior level
In-Office or Remote
Hiring Remotely in Hyderabad, Telangana
Senior level
Design, build, and optimize scalable cloud-native data platforms and pipelines for batch and streaming workloads supporting analytics and AI/ML in clinical research. Implement ETL/ELT, data modelling, metadata, governance, quality checks, observability, and security to ensure compliant, high-performance data flows. Enable data scientists with feature stores and curated datasets, integrate MLOps, mentor engineers, and drive platform decisions and continuous improvement.
The summary above was generated by AI

We’re on a mission to change the future of
clinical research. At Perceptive, we help the
biopharmaceutical industry bring medical
treatments to the market, faster.
Our mission is to change the world
but to do this, we need people like you.

Apart from job satisfaction, we can offer you:

HEALTH:

- Medical plan for you and your dependents.

- Personal Accident Insurance

- Life Insurance

- Critical illness cover

WEALTH:

- Salary structure and Flexi basket

- Provident fund of 12%

- Gratuity scheme

YOURSELF: Internal growth and development programs & trainings

Job Summary:

As a Senior Data Engineer, Medical Imaging you will design, build, and optimize scalable, secure, and compliant data platforms that support advanced analytics, operational reporting, and AI/ML workloads. You will specialise in data ingestion, transformation, modelling, and orchestration, enabling high quality data flows across the organisation. In this role, you will contribute to modern cloud data architectures, metadata management, and real time/streaming data operations. Your expertise will drive innovation in data engineering capabilities while ensuring performance, reliability, and regulatory compliance.

Key Responsibilities

Cloud-Native Data Architecture & Pipeline Engineering

  • Build scalable, cloud-native data pipelines for batch and streaming workloads.
  • Design ELT/ETL workflows using modern orchestration tools.
  • Implement data ingestion frameworks for structured, semi-structured, and unstructured data.
  • Develop APIs and integration services for data exchange between internal systems.
  • Support platform scalability and reliability across global operations.

Data Modelling & Storage Design

  • Design high‑performance data models including dimensional, canonical, and domain-driven structures.
  • Implement database and storage solutions across relational, NoSQL, and data lake systems.
  • Develop metadata-driven ingestion and transformation frameworks.
  • Ensure data schemas support analytics, AI/ML, and business applications.

Data Transformation, Quality & Governance

  • Implement data quality frameworks, validation rules, and automated checks.
  • Build reusable transformation components to standardise data processing.
  • Implement data lineage, cataloguing, and governance capabilities.
  • Ensure data privacy, protection, and compliance with regulatory requirements.

Data Platform Development & Optimization

  • Develop high-throughput data processing solutions using distributed systems.
  • Optimize data pipelines for performance, cost efficiency, and resilience.
  • Implement observability and monitoring for pipeline health, data drift, and SLA compliance.
  • Build caching, partitioning, and indexing strategies to improve query performance.

Analytics & AI/ML Enablement

  • Enable data scientists with curated datasets and feature pipelines.
  • Develop real-time or batch-oriented feature stores.
  • Integrate data workflows with ML operations (MLOps) and model deployment systems.
  • Build visualisation-ready datasets for BI tools and dashboards.

Security, Compliance & Risk Management

  • Implement role-based access control, encryption, and secure data-sharing patterns.
  • Support compliance with FDA/GxP, GDPR, HIPAA, and other applicable regulations.
  • Develop audit trails, data retention, and disaster recovery solutions.

Technical Leadership & Collaboration

  • Contribute to technology stack decisions for data engineering and analytics workloads.
  • Participate in code reviews and enforce engineering best practices.
  • Collaborate in architecture reviews and system design decisions.
  • Mentor junior engineers and share knowledge across teams.

Innovation

  • Stay current with emerging data engineering, AI, and cloud technologies.
  • Evaluate new tools and frameworks to improve platform capabilities.
  • Share insights and drive continuous improvement across data engineering practices.

Other

  • Carryout any other reasonable duties as requested.

Functional Competencies (Technical knowledge/Skills)

  • Strong knowledge of cloud-native data platforms and serverless architectures (Azure, AWS)
  • Expertise in data pipeline orchestration (e.g., Airflow, Prefect, Dagster)
  • Strong knowledge of data modelling in Python
  • Familiarity with API development in .Net/Java
  • Knowledge of streaming platforms (Kafka, Kinesis, Pub/Sub, Event Hubs)
  • Strong SQL and data modelling capabilities
  • Experience with scalable data processing frameworks (Spark, Flink, Beam, Databricks)
  • Understanding of healthcare or clinical trial data workflows (preferred)
  • Knowledge of data governance, metadata management, and lineage frameworks
  • Strong communication skills with ability to work across technical and business teams
  • Ability to balance technical solutions with business objectives.

Behaviour Competencies

  • Accountability
  • Adaptability
  • Customer focus
  • Robust
  • Decision Making
  • Business Acumen
  • Results orientation
  • Time Management
  • Willingness to learn
  • Team collaboration

Experience, Education and Certifications

  • Significant experience delivering large-scale data engineering solutions.
  • Experience developing cloud-native data platforms (Azure, AWS, or GCP).
  • Experience with modern ELT/ETL tools and distributed data processing.
  • Experience working in regulated industries (healthcare, clinical trials, finance) preferred.
  • Proficiency in Python, SQL, and optionally Java/Scala.
  • Experience with CI/CD pipelines and DevOps for data workflows.
  • Experience with modern data warehousing and lakehouse platforms.
  • Experience with analytics tools (Power BI, Tableau, Looker) beneficial.
  • Bachelor's Degree in Computer Science, Data Engineering, Software Engineering, or related discipline.
  • Advanced degrees or cloud certifications preferred.
  • English: Fluent.

Come as you are.

We're proud to be a Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

Similar Jobs

4 Days Ago
Remote
India
Senior level
Senior level
Artificial Intelligence • Insurance • Software • Automation
Design and own end-to-end data platform architecture, build ingestion and transformation pipelines, model multi-tenant datasets, optimize Postgres and ClickHouse performance/cost, implement orchestration and observability, define data quality and reconciliation standards, and mentor data/product engineers.
Top Skills: AirflowClickhouseDagsterPostgresPythonSQLTemporal
6 Days Ago
Remote
India
Senior level
Senior level
Artificial Intelligence • HR Tech • Professional Services • Software
Design, build, and maintain scalable ETL pipelines and Python data workflows. Perform statistical analysis, optimize queries and pipelines, clean and validate large datasets, troubleshoot failures, document solutions, and collaborate with cross-functional teams to deliver reliable data solutions and insights.
Top Skills: AWSAzureETLGCPPythonRelational DatabasesSASSQL
12 Days Ago
Remote or Hybrid
India
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain scalable cloud-native data pipelines for trade lifecycle processing. Ingest, transform, and normalize high-volume financial data (DTCC, ISO15022), implement MQ/API-based ingestion, optimize SQL Server performance, maintain UTR schemas and trade exception databases, ensure data quality, lineage and governance, and collaborate with reconciliation, settlements, and operations stakeholders.
Top Skills: Aws EksAws RdsAws S3DockerDtcc RttmDtcc Settlement WebEtl/Elt FrameworksFixFxmlIbm MqIso 15022KafkaKubernetesRest ApisSQL ServerUnified Trade Record (Utr)

What you need to know about the Delhi Tech Scene

Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account