8,031 AI Testing jobs in the United States

Job Summary: We are seeking a highly skilled Senior QA Automation Engineer with 6+ years of experience in Software Functional Testing and 4-7 years of expertise in Selenium. The ideal candidate will lead system integration testing, ensure adherence to quality standards, and develop AI-specific automated testing frameworks. This role requires expertise in Agile methodologies, test automation tools, and AI model evaluation using LLMs and RAG architectures. Key Responsibilities: Conduct system integration testing for new and enhanced applications. Develop and execute automated tests using Selenium and other industry-standard tools. Collaborate with project teams to establish plans, standards, and procedures that optimize testing efforts. Ensure on-time delivery by monitoring dependencies, progress, and milestones. Educate business and development teams on the testing methodology, with a focus on end-to-end quality assurance. Lead project and quality management initiatives, including issue tracking and communication. Optimize resource utilization by assisting the Testing Manager in reviewing forecasting reports. Ensure compliance with Agile methodologies, maintaining detailed process documentation. Perform AI-specific testing, including validation of LLMs and RAG architectures using vector databases. Implement automated testing frameworks for Gen AI applications, such as DeepEval and RAGAs. Develop custom validation scripts for evaluating AI model accuracy, relevance, and faithfulness. Test prompt engineering techniques to refine AI-generated responses. Execute SQL queries in Snowflake to validate database integrity and application responses. Essential Skills & Experience: 6+ years of experience in Software Functional Testing with automation expertise in Selenium. Experience with Jira and ALM for test and issue tracking. Strong proficiency in Python, with experience in AI testing frameworks such as LangChain, Pytest, and PyTorch. Hands-on expertise in LLM & RAG architecture testing using vector databases. Familiarity with Snowflake, SQL querying, and data validation techniques. Excellent communication and leadership skills to engage with stakeholders.

The leading pure-play mobile game software development company in the iGame space is hiring a Senior Software Engineer for building test automation tools driven by AI for their Las Vegas office. Create award-winning mobile online games played in over 40 countries and consistently ranked in the top 10 in the biggest markets in the world.
The Senior software engineer is a leader in the QA community driving process and innovation while also working as an embedded QA engineer in a high performance cross-functional game development team. The engineer contributes to quality as well as usability, playability and even creative direction especially as it impacts performance and customer experience. This role has significant growth opportunities as the organization builds a leading edge test automation capability that will give you the opportunity to drive truly innovative mobile testing techniques.

Responsibilities :

• Engineer (design and code) testing tools and solutions from scratch
• Lead, design and create test scenarios, test cases, suites, and test plans for deliverables
• Identify, promote, and sponsor innovation and best practices for cross team performance improvement
• Test browser based games on mobile and online platforms on a wide variety of hardware
• Write automated tests in TypeScript using Visual Code
• Test using Webdriver IO with Selenium and automated browser testing tools
• Conduct automated and manual testing as tasks require.
• Lead in setting up the project task tracking / test schedule.
• Creates / manages documentation associated to QA processes.
• Keeps up to date on new hardware, browser news and relevant technologies.

• Must hate bugs - we want people who are passionate about quality
• Takes pride in finding errors that developers swear are not there
• Desire to learn with a natural curiosity that leads to new ways to identify bugs
• Wants to grow and innovate technically
• Passion for gaming and game development
• Willing to relocate if not already within commuting distance to work location

• Experienced, confident and proficient at software engineering (TypeScript or C# preferred) and able to pick up programming languages as needed
• An aptitude for quickly adopting and improving new technology and technical frameworks
• A track record of mentorship, direction setting, innovation and leading by example
• Effective influencer within an agile development cell responsible for product quality with the ability to assist with project scheduling.
• Proficient in SQL Scripts and SQL Server Manager.
• Experienced with testing on iOS, Android, Windows and MacOS
• Knowledgeable in performance analysis and performance data capture (start-up and runtime performance).
• History of success working on multiple projects simultaneously under tight deadlines.
• Ability to work with others in a demanding and fast paced environment.
• Excellent verbal and written communication skills.

• Minimum of 5 years of work experience in software quality assurance and/or software development.
• Candidates must have 2 or more years of mobile app or cross-platform web application testing experience
• Candidates must have over 4 years of formal software quality assurance with progressive growth and assumption of responsibilities

• Experience with custom application development that uses AI
• Test script automation using the standard TypeScript test runner syntax
• Knowledge of automated browser testing tools: Selenium, Appium, Cypress, Puppeteer or Playwright, etc is desired.
• Skilled in SQL Stored Procedures and Data Extraction.
• Proficient in Data Analysis.
• Can design / create tools to help improve internal processes
• Experienced testing / developing slot games.
• Experienced testing / developing web-based games

• All benefits begin and are vested immediately.
• Health care coverage
• Company H.S.A. contribution
• 4% 401k match
• Eligible for up to 25% bonus paid quarterly based on personal and game team performance

• This role is based is in Las Vegas, NV
• It is in-office 5 days per week
• Relocation expenses are paid

The leading pure-play mobile game software development company in the iGame space is hiring a Senior Software Engineer for building test automation tools driven by AI for their Boca Raton office. Create award-winning mobile online games played in over 40 countries and consistently ranked in the top 10 in the biggest markets in the world.
The Senior software engineer is a leader in the QA community driving process and innovation while also working as an embedded QA engineer in a high performance cross-functional game development team. The engineer contributes to quality as well as usability, playability and even creative direction especially as it impacts performance and customer experience. This role has significant growth opportunities as the organization builds a leading edge test automation capability that will give you the opportunity to drive truly innovative mobile testing techniques.

Responsibilities :

• Engineer (design and code) testing tools and solutions from scratch
• Lead, design and create test scenarios, test cases, suites, and test plans for deliverables
• Identify, promote, and sponsor innovation and best practices for cross team performance improvement
• Test browser based games on mobile and online platforms on a wide variety of hardware
• Write automated tests in TypeScript using Visual Code
• Test using Webdriver IO with Selenium and automated browser testing tools
• Conduct automated and manual testing as tasks require.
• Lead in setting up the project task tracking / test schedule.
• Creates / manages documentation associated to QA processes.
• Keeps up to date on new hardware, browser news and relevant technologies.

• Must hate bugs - we want people who are passionate about quality
• Takes pride in finding errors that developers swear are not there
• Desire to learn with a natural curiosity that leads to new ways to identify bugs
• Wants to grow and innovate technically
• Passion for gaming and game development
• Willing to relocate if not already within commuting distance to work location

• Experienced, confident and proficient at software engineering (TypeScript or C# preferred) and able to pick up programming languages as needed
• An aptitude for quickly adopting and improving new technology and technical frameworks
• A track record of mentorship, direction setting, innovation and leading by example
• Effective influencer within an agile development cell responsible for product quality with the ability to assist with project scheduling.
• Proficient in SQL Scripts and SQL Server Manager.
• Experienced with testing on iOS, Android, Windows and MacOS
• Knowledgeable in performance analysis and performance data capture (start-up and runtime performance).
• History of success working on multiple projects simultaneously under tight deadlines.
• Ability to work with others in a demanding and fast paced environment.
• Excellent verbal and written communication skills.

• Minimum of 5 years of work experience in software quality assurance and/or software development.
• Candidates must have 2 or more years of mobile app or cross-platform web application testing experience
• Candidates must have over 4 years of formal software quality assurance with progressive growth and assumption of responsibilities

• Experience with custom application development that uses AI
• Test script automation using the standard TypeScript test runner syntax
• Knowledge of automated browser testing tools: Selenium, Appium, Cypress, Puppeteer or Playwright, etc is desired.
• Skilled in SQL Stored Procedures and Data Extraction.
• Proficient in Data Analysis.
• Can design / create tools to help improve internal processes
• Experienced testing / developing slot games.
• Experienced testing / developing web-based games

• All benefits begin and are vested immediately.
• Health care coverage
• Company H.S.A. contribution
• 4% 401k match
• Eligible for up to 25% bonus paid quarterly based on personal and game team performance

• This role is based is in Boca Raton, FL
• It is in-office 5 days per week
• Relocation expenses are paid

Job Type:

Position Description

RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda. As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of frontier AI models.

You will be responsible for managing significant research budgets and personnel, overseeing complex technical research and policy analysis projects, and leading multidisciplinary teams of policy researchers, engineers, and scientists. Your team will build systems to evaluate how AI models perform across the full attack lifecycle, including resource development, initial access, discovery, lateral movement, and defense evasion.

Your projects may include developing benchmarks for fully autonomous operations using scaffolding and tools, as well as uplift of both novice and expert humans. Such benchmarks may involve environments like CTF challenges, frameworks for assessing ability to reason over attack graphs and conduct multi-stage operations, assessment of stealth and defense evasion capabilities, and benchmarks for ability to conduct time-sensitive operations at machine speed.

Many of your evaluations will be commissioned directly by relevant government agencies, and the results of your evaluations will drive responsible AI policy across the world. Your team will communicate findings through detailed technical analyses, evaluation frameworks, and quick-turnaround policy briefs. Your work will shape recommendations for the White House, regulatory agencies, the intelligence community, other national governments, and industry leaders.

This position is structured as a focused two-year appointment to create the urgency needed to drive ambitious change in this rapidly evolving field. Every day of your tenure will count toward achieving ambitious projects in AI security. The appointment may be renewed for an additional year, with options for longer-term employment at RAND thereafter.

RAND's reputation for excellence is built on our commitment to high-quality, rigorous analysis and objectivity. As a Research Lead - AI Cyber Testing & Evaluation, you'll have access to RAND's leading researchers, extensive government and industry connections, and world-class analytical resources.

Qualifications

All research positions at RAND require excellent analytic skills; the ability to communicate clearly and effectively, both orally and in writing; the ability to work effectively as a member of a multi-disciplinary team; and a strong commitment to RAND's core values of quality and objectivity.

Required:

• 6+ years of technical experience in security engineering, software engineering, firmware engineering, hardware engineering, or related fields

• 6+ years of technical management experience, including leading cross-functional teams, managing project budgets, and mentoring and developing team members

• Demonstrated ability to successfully lead complex projects to completion

• Proficiency in Python, Java, C/C++, or other popular programming languages

• Experience with red team operations or offensive cyber capabilities development

• Ability to develop rigorous and comprehensive threat models and identify potential system vulnerabilities

• Strong ability to communicate effectively in English, both verbally and in writing

• Ability to work effectively in a collaborative, multidisciplinary environment

• Fluency with MS Office suite

Preferred:

• Graduate of the Computer Network Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT), Future Operator Readiness Growth and Enrichment (FORGE), or equivalent experience

• Understanding of advanced persistent threat (APT) tactics, techniques, and procedures (TTPs) and experience with defending against them

• Ability to think creatively about offensive and/or defensive techniques and strategies, beyond compliance with existing regulations

• Experience working on AI research, ML model training, or model deployment

Education Requirements

RAND is hiring a Research Lead at either the specialist or expert level of experience. Minimum education requirements at the specialist level include:

A PhD in Computer Science, Computer Engineering, Electrical Engineering, Cybersecurity, Information Security, Information Technology, Mathematics, Applied Mathematics, Physics, Applied Physics, Engineering Physics, Artificial Intelligence, Machine Learning, Engineering and Public Policy, Technology and Policy, National Security Policy, Policy Analysis, Political Science, International Relations, or similar with at least 3 years of relevant professional experience is required.

OR

A Master's degree in the fields listed above with at least 6 years of relevant professional experience, is required.

OR

A Bachelor's degree in the fields listed above with at least 8 years of relevant professional experience, is required.

Master's or PhD preferred.

Security Clearance

Ability to obtain and maintain a U.S. government clearance is preferred but not required.

Location

We are hiring for this position in San Francisco, CA; Washington, DC; Santa Monica, CA; Pittsburgh, PA; and Boston, MA. We offer a hybrid work arrangement, combining work from home and on-site options. Fully remote work will also be considered.

Writing or Code Sample

Either a writing sample or a code sample is required for this position. This sample can use a recent, previously written paper or technical report (e.g., journal article, master's thesis or paper written for coursework, research project, technical analysis, briefings), or source code showing technical expertise in relevant domains.

Term

This position is a 2-year term appointment with a possibility of renewal for up to 3 years, alongside options for longer term employment.

Salary Range: $137,000 - $46,600

Visiting Technical Specialist = 137,000 - 209,000

Visiting Technical Expert = 157,800 - 246,600

RAND considers a variety of factors when formulating an offer, including but not limited to, the specific role and associated responsibilities; a candidate's work experience, education/training, skills, expertise; and internal equity.Successful candidates will be offered employment in a specific title, as determined by the candidate's education and experience. The salary range includes base pay plus RAND's sabbatic pay (which provides additional compensation above base pay when vacation is taken). In addition, RAND provides strong benefits including health insurance coverage, life and disability insurance, savings plan, paid time-off and more.

Equal Opportunity Employer

QA Analyst - Conversational AI / Chatbot Testing

Anywhere

Type: Contract

Category: Quality Assurance (QA)

Industry: Education

Workplace Type: Remote

Reference ID: JN -082025-103284

Date Posted: 08/15/2025

Shortcut:

• Description

• Recommended Jobs

Description:

Higher Education leader providing virtual 4-year degree and Masters Degree programs

We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

Rate: $40 - $0 / hr. w2

Responsibilities:

• Define functional and non-functional test strategies for the conversational AI platform.

• Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.

• Conduct rigorous testing of conversational AI models, including:

• Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI-generated responses.

• Performance testing to evaluate response times, system load, and resource utilization.

• Usability testing to assess the user experience and identify areas for improvement.

• Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.

• Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back-end systems.

• Coordinate with cross-functional quality assurance resources to conduct end to end testing between other systems/platforms.

• Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.

• Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.

• Track and manage bug resolution and feature enhancements.

• Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.

• Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.

• Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.

• Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.

• Research and explore new testing methodologies and tools to enhance the QA process.

Experience Requirements:

• At least 5 years of experience in software testing and quality assurance methodologies.

• Knowledge of AI and machine learning concepts, particularly in natural language processing.

• Expertise in testing conversational AI or chatbot systems.

• Excellent analytical and problem-solving abilities.

• Strong communication and collaboration skills.

• Experience in testing Chatbots such as Microsoft Bot and Kore AI platform.

• Certifications in software testing or AI (e.g., ISTQB, AI Testing certification).

Education Requirements:

• Bachelor's degree in computer science, information technology, or related field.

Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.

W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.

Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact

About Eliassen Group:

Eliassen Group is a leading strategic consulting company for human-powered solutions. For over 30 years, Eliassen has helped thousands of companies reach further and achieve more with their technology solutions, financial, risk & compliance, and advisory solutions, and clinical solutions. With offices from coast to coast and throughout Europe, Eliassen provides a local community presence, balanced with international reach. Eliassen Group strives to positively impact the lives of their employees, clients, consultants, and the communities in which they operate.

Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Don't miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a 1,000 referral check!

QA Analyst - Conversational AI / Chatbot Testing

Anywhere

Type: Contract

Category: Quality Assurance (QA)

Industry: Education

Workplace Type: Remote

Reference ID: JN -082025-103284

Date Posted: 08/15/2025

Shortcut:

• Description

• Recommended Jobs

Description:

Higher Education leader providing virtual 4-year degree and Masters Degree programs

We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

Rate: $40 - $0 / hr. w2

Responsibilities:

• Define functional and non-functional test strategies for the conversational AI platform.

• Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.

• Conduct rigorous testing of conversational AI models, including:

• Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI-generated responses.

• Performance testing to evaluate response times, system load, and resource utilization.

• Usability testing to assess the user experience and identify areas for improvement.

• Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.

• Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back-end systems.

• Coordinate with cross-functional quality assurance resources to conduct end to end testing between other systems/platforms.

• Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.

• Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.

• Track and manage bug resolution and feature enhancements.

• Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.

• Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.

• Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.

• Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.

• Research and explore new testing methodologies and tools to enhance the QA process.

Experience Requirements:

• At least 5 years of experience in software testing and quality assurance methodologies.

• Knowledge of AI and machine learning concepts, particularly in natural language processing.

• Expertise in testing conversational AI or chatbot systems.

• Excellent analytical and problem-solving abilities.

• Strong communication and collaboration skills.

• Experience in testing Chatbots such as Microsoft Bot and Kore AI platform.

• Certifications in software testing or AI (e.g., ISTQB, AI Testing certification).

Education Requirements:

• Bachelor's degree in computer science, information technology, or related field.

Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.

W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.

Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact

About Eliassen Group:

Eliassen Group is a leading strategic consulting company for human-powered solutions. For over 30 years, Eliassen has helped thousands of companies reach further and achieve more with their technology solutions, financial, risk & compliance, and advisory solutions, and clinical solutions. With offices from coast to coast and throughout Europe, Eliassen provides a local community presence, balanced with international reach. Eliassen Group strives to positively impact the lives of their employees, clients, consultants, and the communities in which they operate.

Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Don't miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a 1,000 referral check!

QA Analyst - Conversational AI / Chatbot Testing

Anywhere

Type: Contract

Category: Quality Assurance (QA)

Industry: Education

Workplace Type: Remote

Reference ID: JN -082025-103284

Date Posted: 08/15/2025

Shortcut:

• Description

• Recommended Jobs

Description:

Higher Education leader providing virtual 4-year degree and Masters Degree programs

We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

Rate: $40 - $0 / hr. w2

Responsibilities:

• Define functional and non-functional test strategies for the conversational AI platform.

• Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.

• Conduct rigorous testing of conversational AI models, including:

• Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI-generated responses.

• Performance testing to evaluate response times, system load, and resource utilization.

• Usability testing to assess the user experience and identify areas for improvement.

• Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.

• Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back-end systems.

• Coordinate with cross-functional quality assurance resources to conduct end to end testing between other systems/platforms.

• Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.

• Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.

• Track and manage bug resolution and feature enhancements.

• Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.

• Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.

• Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.

• Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.

• Research and explore new testing methodologies and tools to enhance the QA process.

Experience Requirements:

• At least 5 years of experience in software testing and quality assurance methodologies.

• Knowledge of AI and machine learning concepts, particularly in natural language processing.

• Expertise in testing conversational AI or chatbot systems.

• Excellent analytical and problem-solving abilities.

• Strong communication and collaboration skills.

• Experience in testing Chatbots such as Microsoft Bot and Kore AI platform.

• Certifications in software testing or AI (e.g., ISTQB, AI Testing certification).

Education Requirements:

• Bachelor's degree in computer science, information technology, or related field.

Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.

W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.

Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact

About Eliassen Group:

Eliassen Group is a leading strategic consulting company for human-powered solutions. For over 30 years, Eliassen has helped thousands of companies reach further and achieve more with their technology solutions, financial, risk & compliance, and advisory solutions, and clinical solutions. With offices from coast to coast and throughout Europe, Eliassen provides a local community presence, balanced with international reach. Eliassen Group strives to positively impact the lives of their employees, clients, consultants, and the communities in which they operate.

Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Don't miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a 1,000 referral check!

QA Analyst - Conversational AI / Chatbot Testing

Anywhere

Type: Contract

Category: Quality Assurance (QA)

Industry: Education

Workplace Type: Remote

Reference ID: JN -082025-103284

Date Posted: 08/15/2025

Shortcut:

• Description

• Recommended Jobs

Description:

Higher Education leader providing virtual 4-year degree and Masters Degree programs

We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

Rate: $40 - $0 / hr. w2

Responsibilities:

• Define functional and non-functional test strategies for the conversational AI platform.

• Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.

• Conduct rigorous testing of conversational AI models, including:

• Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI-generated responses.

• Performance testing to evaluate response times, system load, and resource utilization.

• Usability testing to assess the user experience and identify areas for improvement.

• Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.

• Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back-end systems.

• Coordinate with cross-functional quality assurance resources to conduct end to end testing between other systems/platforms.

• Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.

• Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.

• Track and manage bug resolution and feature enhancements.

• Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.

• Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.

• Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.

• Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.

• Research and explore new testing methodologies and tools to enhance the QA process.

Experience Requirements:

• At least 5 years of experience in software testing and quality assurance methodologies.

• Knowledge of AI and machine learning concepts, particularly in natural language processing.

• Expertise in testing conversational AI or chatbot systems.

• Excellent analytical and problem-solving abilities.

• Strong communication and collaboration skills.

• Experience in testing Chatbots such as Microsoft Bot and Kore AI platform.

• Certifications in software testing or AI (e.g., ISTQB, AI Testing certification).

Education Requirements:

• Bachelor's degree in computer science, information technology, or related field.

Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.

W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.

Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact

About Eliassen Group:

Eliassen Group is a leading strategic consulting company for human-powered solutions. For over 30 years, Eliassen has helped thousands of companies reach further and achieve more with their technology solutions, financial, risk & compliance, and advisory solutions, and clinical solutions. With offices from coast to coast and throughout Europe, Eliassen provides a local community presence, balanced with international reach. Eliassen Group strives to positively impact the lives of their employees, clients, consultants, and the communities in which they operate.

Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Don't miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a 1,000 referral check!

QA Analyst - Conversational AI / Chatbot Testing

Anywhere

Type: Contract

Category: Quality Assurance (QA)

Industry: Education

Workplace Type: Remote

Reference ID: JN -082025-103284

Date Posted: 08/15/2025

Shortcut:

• Description

• Recommended Jobs

Description:

Higher Education leader providing virtual 4-year degree and Masters Degree programs

We can facilitate w2 and corp-to-corp consultants. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.

Rate: $40 - $0 / hr. w2

Responsibilities:

• Define functional and non-functional test strategies for the conversational AI platform.

• Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.

• Conduct rigorous testing of conversational AI models, including:

• Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI-generated responses.

• Performance testing to evaluate response times, system load, and resource utilization.

• Usability testing to assess the user experience and identify areas for improvement.

• Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.

• Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back-end systems.

• Coordinate with cross-functional quality assurance resources to conduct end to end testing between other systems/platforms.

• Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.

• Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.

• Track and manage bug resolution and feature enhancements.

• Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.

• Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.

• Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.

• Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.

• Research and explore new testing methodologies and tools to enhance the QA process.

Experience Requirements:

• At least 5 years of experience in software testing and quality assurance methodologies.

• Knowledge of AI and machine learning concepts, particularly in natural language processing.

• Expertise in testing conversational AI or chatbot systems.

• Excellent analytical and problem-solving abilities.

• Strong communication and collaboration skills.

• Experience in testing Chatbots such as Microsoft Bot and Kore AI platform.

• Certifications in software testing or AI (e.g., ISTQB, AI Testing certification).

Education Requirements:

• Bachelor's degree in computer science, information technology, or related field.

Skills, experience, and other compensable factors will be considered when determining pay rate. The pay range provided in this posting reflects a W2 hourly rate; other employment options may be available that may result in pay outside of the provided range.

W2 employees of Eliassen Group who are regularly scheduled to work 30 or more hours per week are eligible for the following benefits: medical (choice of 3 plans), dental, vision, pre-tax accounts, other voluntary benefits including life and disability insurance, 401(k) with match, and sick time if required by law in the worked-in state/locality.

Please be advised- If anyone reaches out to you about an open position connected with Eliassen Group, please confirm that they have an Eliassen.com email address and never provide personal or financial information to anyone who is not clearly associated with Eliassen Group. If you have any indication of fraudulent activity, please contact

About Eliassen Group:

Eliassen Group is a leading strategic consulting company for human-powered solutions. For over 30 years, Eliassen has helped thousands of companies reach further and achieve more with their technology solutions, financial, risk & compliance, and advisory solutions, and clinical solutions. With offices from coast to coast and throughout Europe, Eliassen provides a local community presence, balanced with international reach. Eliassen Group strives to positively impact the lives of their employees, clients, consultants, and the communities in which they operate.

Eliassen Group is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Don't miss out on our referral program! If we hire a candidate that you refer us to then you can be eligible for a 1,000 referral check!