AI summary
Design cryptography tasks for AI evaluation by creating challenges from real work experiences, develop reference solutions in Python or SageMath, and ensure the tasks are realistic and solvable.
Job Description
Headquarters:
Overview
A fast-growing AI evaluation company is building expert-level benchmarks that test how well AI agents handle real professional work in the terminal. We are hiring cryptography experts to turn real, paid tasks from their own work into end-to-end challenges for AI agents, each with a working solution and a check that proves the result is correct.
***THIS IS A TASK BASED COMPENSATION MODEL. PLEASE CHECK THE APPLICATION QUESTIONS FOR MORE DETAILS.***
Responsibilities
• Design expert-level Terminal-Bench cryptography tasks by turning real, paid work from your own experience into challenges that an AI agent must solve end to end.
• Define the task environment, including files, systems, ciphertexts and data, so the challenge is realistic, self-contained and reproducible in a Linux command-line setup.
• Write a working reference solution in Python or SageMath that proves the task is solvable, for example by recovering a key or decrypting a secret.
• Build automated checks and tests that objectively verify the final result is correct, and explain how a mistake or a partial answer would be detected.
• Calibrate task difficulty so a typical expert needs about 60-75 minutes to solve it, keeping it hard for AI agents while still fair and unambiguous.
• Package each task with Docker and Git where applicable, document instructions clearly, and revise based on reviewer feedback until it meets the required quality bar.
Skills/Experience
• 3+ years of hands-on cryptanalysis or applied cryptography; GRC, audit-only, policy, sales or management roles do not count, nor does coursework only
• Did the work in the last 3 years and can name the systems, tools, data and rules used
• Uses the low-level tools of the subfield, such as SageMath and Python, and works comfortably on the Linux command line
• Can show how a finding is proven, such as a decrypted secret or a recovered key, and explain how a mistake would be caught
• Technical fluency with files, CSV/JSON, APIs or databases
• Available to start around November 2026
Nice-to-have
• Published write-ups or research on cryptanalysis
• Strong CTF results, especially in crypto categories
• CVEs discovered in cryptographic implementations
• Experience with Docker, Git and writing automated tests
• Proficiency in C for low-level cryptographic work
Process
• Task vetting: complete a vetting task instead of a live interview
• Work is paid per task, with each task taking roughly 60-75 minutes
• Expected start around early November 2026
To apply: https://weworkremotely.com/remote-jobs/toptal-cryptography-specialist-for-ai-lab
About the job
- Posted on
- Nov 5, 2026
- Job type
- Full-time
- Location
- Anywhere in the WorldWorldwide
Keep looking
Related roles you might like
Practice Director, Cloud Services - US-Based
Toptal
Operations Expert with Python for AI Supply Chain Task Design
Toptal
ML Inference Engineer â Terminal-Bench Task Designer (vLLM / SGLang / TensorRT-LLM)
Toptal
ML Inference Engineer – Terminal-Bench Task Designer
Toptal
Operations Expert with Python for AI Supply Chain Task Design
Toptal
General Manager, Industrial Products & Services - US Based
Toptal
Explore more
Browse more jobs like this
Disclaimer: Real Jobs From Anywhere is an independent platform dedicated to providing information about job openings. We are not affiliated with, nor do we represent, any company, agency, or agent mentioned in the job listings. Please refer to our Terms of Services for further details.
