Intelligence Analyst – Remote (Worldwide)
RemoteJobsOneAI summary
As an Intelligence Analyst, you will evaluate and advance artificial intelligence capabilities, developing test cases and assessing AI-generated responses while collaborating on analytic standards.
Job Description
IMPORTANT: after you apply, please check your email. We sendyou a link to complete your application — it is not considered until that laststep is done. If you do not see it, check your spam folder.
This is a fully remote position, open to candidates based in 55 countries, including Brazil, United States, United Kingdom, Canada, Germany, India, France, Netherlands.
Pay: $80–$170/hr
Role Title: Intelligence Analyst
Role Type: Contractor
Location: Remote
We are engaging Intelligence Analysts to contribute to a customer-facing project focused on evaluating and advancing artificial intelligence capabilities. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
- Develop and map analytic cases to defined taxonomies across multiple evaluation areas, ensuring comprehensive coverage of relevant intelligence scenarios.
- Author complex test cases designed to evaluate model performance on source handling, analytic rigor, and nuanced uncertainty expression.
- Assess and grade AI-generated responses based on criteria such as reasoning, source use, recognition of limitations, and practical utility.
- Identify and flag instances where legitimate analytic exploration is over-refused by the model, providing clear documentation and feedback.
- Document edge cases and analytic disagreements, supporting continuous improvement of evaluation methodologies.
- Collaborate with project leads to refine procedures for source evaluation and confidence-level assignment.
- Contribute insights to help calibrate analytic standards and enhance the overall quality of AI system benchmarks.
Preferred Qualifications
- Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline, ideally with a civilian-IC background.
- Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards.
- Experience in teaching, mentoring, or leading analytic reviews, with a record of fostering analytic rigor.
- Exceptional written and verbal communication skills, with a focus on clarity and precision.
- Ability to identify and articulate nuanced model limitations and over-refusal scenarios.
- Familiarity with structured analytic techniques and intelligence tradecraft standards.
- Previous participation in AI evaluation or model assessment initiatives is a plus.
Learn More About Our Government & Defense Work
with us, we work with government and defense experts to evaluate how advanced AI models perform on real-world tasks.
Our MissionReport benchmark assesses AI-generated military and government reports, highlighting the importance of expert judgment, accuracy, and operational understanding.
Learn more: hiring platform/benchmark/mission-report
How to apply
Apply here with your profile. We will then email you a link to complete yourapplication on the hiring platform — your application is only considered oncethat final step is done.
Originally posted on Himalayas
About the job
- Posted on
- Nov 20, 2026
- Job type
- Contract
- Location
- BrazilOn-site
Keep looking
Related roles you might like
Aviation Subject Matter Expert - Commercial Pilot / Flight Ops – Remote (Worldwi
RemoteJobsOne
AI Safety & Evaluation Specialist – Remote (US)
RemoteJobsOne
Corporate Finance & Financial Modeling Expert – Remote (Worldwide)
RemoteJobsOne
Professional Shopper – Remote (Worldwide)
RemoteJobsOne
Senior DoD Staff Writing SME – Remote (US)
RemoteJobsOne
Rust Architect / Backend Developer – Remote (Worldwide)
RemoteJobsOne
Member of Technical Staff, Model Training (infra & platform) – Remote (Worldwide
RemoteJobsOne
Gaming/Gambling Regulatory Attorney – Remote (Worldwide)
RemoteJobsOne
French Language Expert (Canada) – Remote (France, Belgium, Switzerland & Canada)
RemoteJobsOne
Photography and Cinematography Expert – Remote (Worldwide)
RemoteJobsOne
Senior Intelligence Analyst – National Security – Remote (Worldwide)
RemoteJobsOne
Senior Specialty Inspection Expert, Crop, Auction and Rental – Remote (Worldwide
RemoteJobsOne
Independent Professional & Solopreneur (Domain Expert) – Remote (Worldwide)
RemoteJobsOne
Quantitative Rates Researcher – Remote (Worldwide)
RemoteJobsOne
Explore more
Browse more jobs like this
Disclaimer: Real Jobs From Anywhere is an independent platform dedicated to providing information about job openings. We are not affiliated with, nor do we represent, any company, agency, or agent mentioned in the job listings. Please refer to our Terms of Services for further details.
