AI QA Analyst

We are seeking a highly detail-oriented QA Analyst to join our AI and automation team. This role focuses on quality assurance of data-driven and AI-based systems, ensuring that model outputs, data pipelines, and automation processes meet the highest standards of accuracy and reliability. The ideal candidate combines analytical rigor with curiosity and an ability to challenge assumptions through evidence-based evaluation.

Who we are:

Buyers Edge Platform stands at the forefront of revolutionizing the food service industry through technology, purchasing power and partnerships. We are dedicated to empowering stakeholders across the entire food service ecosystem (operators, distributors, manufacturers) with efficiency and unprecedented visibility. With a diverse portfolio of over a dozen brands, our mission is clear: to reduce costs, streamline the foodservice supply chain, and propel the industry from manual to automated.   

Today, we are one of the largest players in food service, with over 200K operator locations across North America and over $50 billion of aggregated spend volume. Our commitment to food service excellence is proven in four distinct areas of value: Digital Procurement Network, Fresh Solutions, Supply Chain Management, and Software. Buyers Edge Platform is not just a provider – we are a strategic partner on the journey towards a more efficient, connected, and automated future for the foodservice industry. 

This position is remotely based. We are unable to offer work sponsorship for this role.

Your impact:

• Conduct QA and validation on outputs from AI models, data pipelines, and automation workflows.
• Identify and document errors, inconsistencies, and anomalies in largescale datasets or model-generated outputs.
• Collaborate with data scientists, engineers, and product teams to triage and investigate data quality issues.
• Develop and maintain SQL-based validation scripts and reports to track data integrity across systems.
• Perform manual and exploratory testing of AI features, classification systems, and automation logic.
• Create clear documentation and QA reports that describe findings, reproducible test cases, and impact assessments.
• Support continuous improvement of model evaluation frameworks and QA processes.
• Participate in cross-functional reviews to ensure AI systems meet quality and performance standards prior to deployment. 

About you:

• 2+ years of experience in QA, data analytics, or testing roles focused on data quality or AI output validation.
• Strong ability to analyze and interpret large datasets or AI-generated outputs to identify issues and trends.
• Proficiency in SQL for investigating data integrity, creating reports, and validating data logic.
• Hands-on experience with manual and exploratory testing in data-centric or model-driven environments.
• Excellent analytical, classification, and documentation skills—able to articulate nuanced findings beyond pass/fail results.
• Highly organized with the ability to manage multiple concurrent QA cycles.
• Naturally curious and detail-oriented, with the confidence to question assumptions and surface data-driven insights. 

Nice to Have:

• Experience validating or curating training datasets, tagging systems, or model classification outputs.
• Familiarity with evaluation metrics such as precision, recall, accuracy, and confidence scores.
• Exposure to model auditing, structured output validation, or annotation workflows.
• Understanding of RESTful APIs and structured response formats (e.g., JSON, YAML).
• Basic scripting experience (Python, shell, etc.) for test automation or data manipulation.
• Experience working in Agile or rapid iteration product environments.

Not sure you meet every qualification? Studies show that diverse applicants often hesitate to apply unless they check every box. At Buyers Edge Platform, we value authenticity and inclusion—if you're excited about the role, we encourage you to apply. You might be exactly who we’re looking for!

What's in this for you:

• Great benefits from day one. We offer medical, dental, vision, FSA, company-paid life insurance, and more—plus a 401(k) with company match.
• Grow with us. Enjoy strong training, development, and competitive pay.
• Work-life balance. Our flexible PTO policy lets you take time when you need it—no accrual required.