RemoteJobsOne logo

Intelligence Analyst – Remote (Worldwide)

RemoteJobsOne
On-site
Posted about 18 hours ago
Intelligence-Analyst

AI summary

As an Intelligence Analyst, you will evaluate and advance artificial intelligence capabilities, developing test cases and assessing AI-generated responses while collaborating on analytic standards.

Eligible from: Worldwide

Job Description

IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is done. If you do not see it, check your spam folder.

This is a fully remote position, open to candidates based in 55 countries, including Brazil, United States, United Kingdom, Canada, Germany, India, France, Netherlands.

Pay: $80–$170/hr

Role Title: Intelligence Analyst

Role Type: Contractor

Location: Remote

We are engaging Intelligence Analysts to contribute to a customer-facing project focused on evaluating and advancing artificial intelligence capabilities. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work

  1. Develop and map analytic cases to defined taxonomies across multiple evaluation areas, ensuring comprehensive coverage of relevant intelligence scenarios.
  2. Author complex test cases designed to evaluate model performance on source handling, analytic rigor, and nuanced uncertainty expression.
  3. Assess and grade AI-generated responses based on criteria such as reasoning, source use, recognition of limitations, and practical utility.
  4. Identify and flag instances where legitimate analytic exploration is over-refused by the model, providing clear documentation and feedback.
  5. Document edge cases and analytic disagreements, supporting continuous improvement of evaluation methodologies.
  6. Collaborate with project leads to refine procedures for source evaluation and confidence-level assignment.
  7. Contribute insights to help calibrate analytic standards and enhance the overall quality of AI system benchmarks.

Preferred Qualifications

  1. Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline, ideally with a civilian-IC background.
  2. Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards.
  3. Experience in teaching, mentoring, or leading analytic reviews, with a record of fostering analytic rigor.
  4. Exceptional written and verbal communication skills, with a focus on clarity and precision.
  5. Ability to identify and articulate nuanced model limitations and over-refusal scenarios.
  6. Familiarity with structured analytic techniques and intelligence tradecraft standards.
  7. Previous participation in AI evaluation or model assessment initiatives is a plus.

Learn More About Our Government & Defense Work

with us, we work with government and defense experts to evaluate how advanced AI models perform on real-world tasks.

Our MissionReport benchmark assesses AI-generated military and government reports, highlighting the importance of expert judgment, accuracy, and operational understanding.

Learn more: hiring platform/benchmark/mission-report

How to apply

Apply here with your profile. We will then email you a link to complete yourapplication on the hiring platform — your application is only considered oncethat final step is done.

Originally posted on Himalayas

Ready to Apply?

Take the next step in your career journey

Apply Now

About the job

Posted on
Nov 20, 2026
Job type
Contract
Location
BrazilOn-site

Keep looking

Related roles you might like

Explore more

Browse more jobs like this

Disclaimer: Real Jobs From Anywhere is an independent platform dedicated to providing information about job openings. We are not affiliated with, nor do we represent, any company, agency, or agent mentioned in the job listings. Please refer to our Terms of Services for further details.