A bachelor's, master's, or PhD in computer science, data science, computational linguistics, statistics, or a related field is ideal; shipped QA for ML/AI……
Deep hands-on expertise with AI content tools (Claude, ChatGPT, Gemini, or similar), including prompt engineering and training AI models on brand voice and……
Continuously develop technical and QA-related skills. Ability to clearly document findings and communicate with both technical and non-technical stakeholders.…
Your role will involve providing advanced technical support on diverse engineering ship design projects, both as an individual contributor and as part of a……
Bachelor's degree in related field AND Five (5) years of experience in Information Technology testing, quality assurance and the performance of change……
Experience driving process improvements and standardizing workflows. Ensure timely communication and resolution of defects with both business and technical……
Participate in field quality control or safety audits and review analysis and results. Coordinate with on-site contractors for the installation of equipment……
This position is available for independent contractors. Excellent communication skills , both written and verbal, to collaborate effectively across technical……
This position is available for independent contractors. Design, develop, and maintain automated test suites using industry-standard automation tools and……
This position is not available for independent contractors. Data analysis and technical troubleshooting. Developing and maintaining automated suites of tests to……
This position is not available for independent contractors. Hands on experience with Java , Javascript, Cucumber, Cypress, SQL, Aptitude towards data analysis/……
Create, design, develop, and document test Strategy/plan/Test Design/Test cases based on technical requirements. Hands on Experience in Test Script Development.…
This position is not available for independent contractors. 5+ years of quality engineering experience with complex enterprise web applications and APIs,……
This position is not available for independent contractors. Ensure all documentation is accessible and up to date, and that the handover checklist is signed off……
This position is available for independent contractors. Proven experience with test automation with creating and maintaining test scripts and customed designed……
This position is not available for independent contractors. Design, develop, and maintain robust automated test scripts and frameworks using industry-standard……
This position is available for independent contractors. Experience with Continuous Integration/Continuous Deployment (CI/CD) tools to integrate testing……
This position is not available for independent contractors. Develop and Maintain Automated Tests: Design, develop, and execute automated test scripts for web……
This position is not available for independent contractors. Data analysis and technical troubleshooting. Developing and maintaining automated suites of tests to……
This position is not available for independent contractors. You will focus on evaluating the performance of autonomous agents, ensuring they follow logical……
This position is not available for independent contractors. Data analysis and technical troubleshooting. Developing and maintaining automated suites of tests to……
This position is not available for independent contractors. You will focus on evaluating the performance of autonomous agents, ensuring they follow logical……
This position is available for independent contractors. The Senior Software Development Engineer – DevOps, Quality & Automation will lead the design,……
This position is not available for independent contractors. Data analysis and technical troubleshooting. Developing and maintaining automated suites of tests to……
Training or certification in test automation, software quality engineering, or continuous testing. Advanced degree in Engineering, Software Quality, or related……
Minimum BS degree in CS or a related field. Review product requirements and design documents to understand how the feature works on the PlayStation console and……
As a Software Development Engineer in Test Contractor, you’ll work hands-on with our peripherals, independently own and drive automated test coverage for……
Bachelor’s degree in computer science, engineering, or related field. Utilizing test automation tools and frameworks to streamline regression and functional……
Manage internal customers, vendors and contractors to complete assigned projects on schedule and in budget. Life insurance and 401(k) matching with immediate……
AI QA Trainer - LLM Evaluation - Freelance Project
Remote
$6.00 - $65.00 Per Hour (Employer provided)
Is your resume a good match?
Use AI to find out how well the skills on your resume fit this job description.
Are you an AI QA expert eager to shape the future of AI? Large-scale language models are evolving from clever chatbots into enterprise-grade platforms. With rigorous evaluation data, tomorrow's AI can democratize world-class education, keep pace with cutting-edge research, and streamline workflows for teams everywhere. That quality begins with you—we need your expertise to harden model reasoning and reliability.
We're looking for AI QA trainers who live and breathe model evaluation, LLM safety, prompt robustness, data quality assurance, multilingual and domain-specific testing, grounding verification, and compliance/readiness checks. You'll challenge advanced language models on tasks like hallucination detection, factual consistency, prompt-injection and jailbreak resistance, bias/fairness audits, chain-of-reasoning reliability, tool-use correctness, retrieval-augmentation fidelity, and end-to-end workflow validation—documenting every failure mode so we can raise the bar.
On a typical day, you will converse with the model on real-world scenarios and evaluation prompts, verify factual accuracy and logical soundness, design and run test plans and regression suites, build clear rubrics and pass/fail criteria, capture reproducible error traces with root-cause hypotheses, and suggest improvements to prompt engineering, guardrails, and evaluation metrics (e.g., precision/recall, faithfulness, toxicity, and latency SLOs). You'll also partner on adversarial red-teaming, automation (Python/SQL), and dashboarding to track quality deltas over time.
A bachelor's, master's, or PhD in computer science, data science, computational linguistics, statistics, or a related field is ideal; shipped QA for ML/AI systems, safety/red-team experience, test automation frameworks (e.g., PyTest), and hands-on work with LLM eval tooling (e.g., OpenAI Evals, RAG evaluators, W&B) signal fit. Skills that stand out include: evaluation rubric design, adversarial testing/red-teaming, regression testing at scale, bias/fairness auditing, grounding verification, prompt and system-prompt engineering, test automation (Python/SQL), and high-signal bug reporting. Clear, metacognitive communication—"showing your work"—is essential.
Ready to turn your QA expertise into the quality backbone for tomorrow's AI? Apply today and start teaching the model that will teach the world.
We offer a pay range of $6-to- $65 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you'll supply a secure computer and high-speed internet; company-sponsored benefits such as health insurance and PTO do not apply.
The minimum salary is $6.00 and the max salary is $65.00.
$6.00 – $65.00/hr (Employer provided)
$35.50
/hr Median
Remote
If an employer includes a salary or salary range on their job, we display it as "Employer Provided". If a job has no salary data, Glassdoor displays a "Glassdoor Estimate" if available. To learn more about "Glassdoor Estimates," see our FAQ page.
Working here doesn’t have to be a secret
Sign in to browse authentic reviews, anonymous ratings and salary data before you apply.