Remote_QA tester-AI Agentic Job at Themesoft Inc, Denver, CO

VGxpVGRBclVhdnhjVzQvZis5SHJ5WlFoeUE9PQ==
  • Themesoft Inc
  • Denver, CO

Job Description

Hello,

Our client is seeking an experienced professional with the skill set outlined below. If you are interested in this opportunity, please review the job description and share your updated resume along with your contact details.

Role: AI Agentic Tester

Location: Denver, CO

Skills: QA/Test Engineering experience

Must have- Experience testing Generative AI, LLM, or AI-based applications.

Keyword:

Skills: Modern Functional Quality Engineering Experience Required: 2-4 Years

PFB the responsibilities and skills needed:

Functional Testing

• Validate AI agent workflows against business requirements.

• Test end-to-end AI use cases, including multi-agent interactions.

• Verify task completion accuracy and output quality.

• Test agent orchestration, tool calling, and workflow execution.

• AI Model Validation

• Evaluate LLM responses for accuracy, relevance, and consistency.

• Test prompt engineering effectiveness and response quality.

• Validate Retrieval-Augmented Generation (RAG) outputs.

• Measure hallucination rates and response reliability.

Required Skills

• 3-8 years of QA/Test Engineering experience.

• Experience testing Generative AI, LLM, or AI-based applications.

• Knowledge of AI Agents, Agentic AI, RAG, and prompt engineering.

• Hands-on experience with API testing (Postman, Swagger, REST APIs).

• Experience with automation frameworks (Selenium, Playwright, PyTest).

• Proficiency in Python.

• Understanding of AI evaluation metrics and testing methodologies Knowledge of Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms

Email me for prompt response.

Thanks & Regards,

__________________

Rupesh Mourya

rupesh@themesoft.com

Job Tags

Remote work

Similar Jobs

RoadSafe Traffic Systems

Traffic Control Technician II Job at RoadSafe Traffic Systems

Traffic Control Technician II Title: Traffic Control Technician II Classification: Non-Exempt About the Organization RoadSafe Traffic Systems is the largest national provider of traffic safety products and services in the United States. RoadSafe serves ...

Radiation Billing Solutions Inc

Physician Liaison Job at Radiation Billing Solutions Inc

 ...continues to expand, we are seeking a highly motivated Physician Liaison to drive strategic business development efforts, strengthen...  ...management. Promote awareness of Mission Oncology Partners clinical expertise, technology, treatment capabilities, and patient-centered... 

Alaska Dialysis

Administrative Assistant - Dialysis Clinic Job at Alaska Dialysis

We are seeking an energetic, dedicated person to fill an Administrative Assistant position at our dialysis clinic in Anchorage, AK. The Administrative Assistant has regular contact with clinical staff and patients requiring the use of tact and discretion. This position...

Thorp Controls Automation Solutions

Automation Solutions Engineer - Process Automation Job at Thorp Controls Automation Solutions

 ...Our industry edge is supplying automation products that require engineering assistance for proper selection and installation. However, as...  ...Strong analytical skills and the ability to quickly learn new software and technologies and apply them in industrial automation... 

Truck with Jed Logistics

Class A Truck Driver / Dedicated Job at Truck with Jed Logistics

 ...Great dedicated lane for driver who wants to be home multiple times weekly. This position is a combination of local and overnight runs for one...  ..., TX, OK, NM, and MS Driver moves freight to end of the truck and customer unloads freight Job Summary: ~3 months T/...