History Domain Expert – AI Evaluation – Kolkata, India

Bring historical expertise to the way AI understands the past. Fusion CX is hiring a History Domain Expert in Kolkata, India for a contractual opportunity focused on evaluating and improving Large Language Models (LLMs). If your expertise spans ancient, medieval, or modern history, political or military history, archaeology, or historiography, this opportunity allows you to apply your subject knowledge to challenging AI evaluation work where factual accuracy, reasoning, completeness, and nuance matter.

You will create challenging history prompts, evaluate AI-generated responses, identify hallucinations, inconsistencies, outdated information, and edge cases, and provide evidence-based feedback to help improve AI model performance.

Job Description:

Role Overview

As a History Domain Expert, you will evaluate and improve Large Language Models by applying your expertise across ancient, medieval, modern, political, and military history, as well as archaeology and historiography. You will design challenging prompts, assess AI-generated responses, identify knowledge gaps and reasoning issues, and contribute to benchmark datasets and adversarial test cases.

Key Responsibilities

• Create advanced prompts covering ancient, medieval, modern, political, military, archaeology, and historiography.
• Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• Develop benchmark datasets and adversarial test cases.
• Provide evidence-based feedback with reliable references.
• Collaborate with AI researchers to improve model performance.
• Maintain high annotation quality and documentation.

Day-to-Day Tasks

• Write domain-specific prompts of varying difficulty.
• Compare multiple AI responses and rank them.
• Explain why a response is correct or incorrect using authoritative references.
• Identify ambiguous questions and propose improved prompts.

Job Requirements:

Minimum Qualifications

• Master’s degree or higher in a discipline related to History.
• 3+ years of professional, research, or teaching experience.
• Excellent written English and analytical skills.
• Strong attention to detail.

Preferred Qualifications

• Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
• Published research, industry recognition, or teaching experience is a plus.
• Ability to work independently and provide objective, evidence-backed reviews.

Work Details

Location: Kolkata, India

Employment Type: Contractual

Work Mode: WFH

Leave Benefits: This contractual engagement does not include paid medical leave or other paid leave benefits.

Work Schedule: Full-time, 40 hours per week, with at least 4 hours of PST overlap.

Start Date: Immediate

Why Join Fusion CX?

History is built on evidence, context, chronology, and competing interpretations—making expert judgment particularly important when evaluating AI-generated answers. A response can sound convincing while still containing a factual error, anachronism, incomplete context, or flawed interpretation.

As a History Domain Expert, you’ll apply your knowledge and critical judgment to challenging AI evaluation tasks, helping identify where AI systems fall short and providing evidence-based feedback that can contribute to better model performance.

What You Will Gain

• Apply your history expertise to Large Language Model evaluation.
• Gain practical exposure to Generative AI, prompt evaluation, and AI research workflows.
• Work with challenging prompts spanning ancient, medieval, modern, political, and military history, archaeology, and historiography.
• Develop experience comparing and ranking AI-generated responses.
• Strengthen your ability to evaluate factual accuracy, reasoning quality, completeness, and nuance.
• Build experience creating benchmark datasets and adversarial test cases.
• Develop expertise in providing evidence-based feedback using reliable references.
• Expand your experience at the intersection of history, AI evaluation, LLMs, and Generative AI.

Apply Today

If you’re searching for History Domain Expert jobs in Kolkata, history jobs, history research jobs, archaeology jobs, AI evaluation jobs, LLM evaluation jobs, Generative AI jobs, AI research jobs, or contract AI opportunities, apply today and bring your historical expertise to the evaluation and improvement of advanced AI systems.