Design difficult open-web research problems for benchmarking frontier AI browsing agents. Responsibilities include constructing multi-step questions, validating clues through government and institutional sources, tracing evidence across archives and PDFs, documenting auditable citations, testing search difficulty, eliminating ambiguity, and delivering reproducible research documentation.
About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role overview
Our client is building advanced evaluation benchmarks for frontier AI browsing agents.
We are looking for highly skilled investigative researchers who can design research problems that remain difficult even for state-of-the-art AI systems with full web access. This is not a traditional subject-matter or content-writing role. The work is centered on open-web investigation, evidence tracing, source validation, and benchmark construction.
You will begin from a verifiable fact, work backwards to construct a difficult research question, and document a complete, auditable evidence trail showing how the answer can be independently verified.
CONTRACT: Short-term freelance/contractor assignment, 8 weeka
COMMITMENT: 40 hours per week, at least 4 hours per day, including 4 hours overlap with PST
LOCATIONS: Remote, GLOBAL
Responsibilities- Design challenging open-web research problems for evaluating advanced AI browsing agents.
- Start from objectively verifiable facts and construct questions that make those facts difficult to discover.
- Build multi-step clue structures involving dates, people, places, organizations, works, events, records, and quantities.
- Ensure every clue is independently verifiable and subject to clear constraints.
- Research across government databases, institutional sources, archives, registries, and PDF documents.
- Produce complete evidence trails citing exact pages, tables, sections, or records.
- Record validation searches and document what obvious search approaches return.
- Test whether research questions remain difficult across multiple search attempts.
- Refine questions to eliminate ambiguity while preserving difficulty.
- Deliver structured, reproducible research documentation.
Requirements
- Background in reference librarianship, archives, or special collections.
- Experience in investigative journalism or professional fact-checking.
- Experience with OSINT, due diligence, KYC, or investigative research.
- Background in patent, prior-art, or legal-discovery research.
- Experience with genealogy or historical records research.
- Experience with competitive quizzing, puzzle design, or puzzle-hunt construction.
- Familiarity with JSON or structured data formats.
Similar Jobs
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Lead end-to-end OSS/BSS enterprise architecture for large, multi-country transformation programs across hybrid-cloud and on-premises environments. Define integration designs, governance standards, reusable architecture patterns, and strategic bid solutions. Engage senior customer and technology leaders, assess delivery risks, oversee architecture across active programs, and mentor architects. The role requires extensive telecommunications and IT architecture experience, strong integration expertise, TOGAF or equivalent certification, industry standardization experience, and comfort with global travel.
Top Skills:
Hybrid CloudOn-Premises EnvironmentsOss/BssTm ForumTogaf
Artificial Intelligence • Cloud • Information Technology • Consulting
Serves as the primary post-sales technical contact for customers, coordinating service delivery, escalations, SLA reviews, risk mitigation, network health checks, configuration and design reviews, upgrades, and deployment planning. Advises customers on network performance, reliability, security, and topology improvements while partnering with support, professional services, engineering, and account teams. Requires advanced IP/MPLS and data center networking expertise, customer-facing experience, fluent French, and the ability to work independently.
Top Skills:
BgpData Center SwitchingEvpnHpe JuniperIpsecIpv6ItilMpls VpnMulticastNatOspfQosSd-WanSegment RoutingStpTcp/IpTraffic EngineeringVlanVrrpVxlanWireless Networking
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Leads owned and earned digital ecosystem strategy across websites, social media, direct messaging, apps, influencer marketing, and content campaigns. Develops personalized content frameworks, manages agencies, enables GenAI and DAM adoption, and tracks performance through analytics, SEO, social listening, and consumer insights. Partners with Brand, CX, Media, Data, and Insights teams to optimize consumer journeys, content effectiveness, and brand relevance.
Top Skills:
Digital Asset Management (Dam)Generative AiMarketing Analytics ToolsSeoSocial Listening ToolsSocial Media PlatformsTagging And Tracking Tools
What you need to know about the Delhi Tech Scene
Delhi, India's capital city, is a place where tradition and progress co-exist. While Old Delhi is known for its rich history and bustling markets, New Delhi is defined by its modern architecture. It's clear the region places a strong emphasis on preserving its cultural heritage while embracing technological advancements, particularly in artificial intelligence, which plays a central role in shaping the city's tech landscape, fueled by investments in research and development.
