Evaluate generative AI systems, RAG pipelines, and agents using Python-based frameworks and evaluation platforms. Responsibilities include model and agent quality assessment, Responsible AI validation, RAI metrics reporting, golden and synthetic dataset creation, and establishing AI observability and tracing with OpenTelemetry.
• Strong understanding of GenAI system architecture (RAG / Agents) • Implement python-based AI Evaluation frameworks like Ragas, DeepEval, etc • Perform Model & Agent quality evaluation using tools like Arize, LangFuse, ConfidentAI, etc • Perform Responsible AI validation & report RAI metrics • Golden dataset curation & Synthetic dataset generation • Ability to instrument & establish AI Observability / Tracing using OTEL libraries Expert in Python
Hexaware Technologies Noida, Uttar Pradesh, IND Office
1st Floor, Building No.7, M/s. Seaview Developers Pvt. Ltd., IT/ITES SEZ, Plot No. 20 & 21, Sector - 135, Noida, Noida, India, 201 304
Similar Jobs
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Provides technical leadership for display graphics and platform services software. Responsibilities include architecture, design, embedded C++ implementation, graphics performance optimization, integration and field-issue investigation, testing, design reviews, technical decision-making, stakeholder collaboration, and mentoring junior engineers. The role supports mission-critical programs and may involve firmware, driver, multithreading, and multicore development.
Top Skills:
C++CpuDevice DriversDo-178CEmbedded C++FirmwareGpuLean/AgileMulticore ProcessingMultithreading
Events • Food • Travel • Hospitality • Hotels & Resorts
Provides friendly and efficient food and beverage service in hotel dining outlets. Welcomes guests, takes orders, serves food and drinks, maintains outlet cleanliness and readiness, supports revenue through menu promotions, follows food safety procedures, handles feedback, and collaborates with kitchen and service teams. Requires strong communication, hospitality focus, flexibility for shifts and holidays, and the ability to stand for extended periods.
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Lead architectural design and innovation for aerospace tooling solutions within the ANTHEM platform. Collaborate with business and technology leaders to align architecture with strategic goals, ensuring scalable, secure, compliant, and reliable solutions. Guide software development, system integration, validation, and engineering productivity initiatives. Build and support a strong technical team through recruiting, talent development, succession planning, retention, and inclusive leadership.
Top Skills:
.NetAvionics Communication ProtocolsBambooC#C++Ci/CdCloud ComputingGenerative AiGrafana LokiLaunchdarklyMicroservicesOctopusOpenshiftPythonService-Oriented Architecture (Soa)
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
