Note: The job is a remote job and is open to candidates in USA. CNTXT AI is focused on building artificial intelligence products and data solutions. They are seeking a Financial AI Evaluator to evaluate AI-generated financial content and improve the accuracy and reliability of AI models in handling financial information.
Responsibilities
- Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles
- Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing
- Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records
- Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks
- Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt
Skills
- Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field
- Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management
- Ability to explain complex financial concepts clearly and accurately in writing
- Full professional English proficiency
- Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow
- Prior experience with AI data training, annotation, or model evaluation
- Familiarity with multimodal AI tools or LLM evaluation workflows
Company Overview
Data powers AI. We make sure yours is ready for it. It was founded in 2023, and is headquartered in Abu Dhabi, AE, with a workforce of 51-200 employees. Its website is https://www.cntxt.tech/.