Senior QA AI Engineer

knowmad mood·Madrid, Spain

What they ask for

  • Have the right to work in Spain

    knowmad mood doesn't mention sponsorship in the ad.

  • Work in English

    English is required, per the ad.

  • Work on-site in Madrid

    No relocation package mentioned.

  • Have 3+ years of experience

    Senior-level role.

Pulled from the advert automatically — the full ad is what counts.

This job was published 4 months ago

Read the full advert

About the role

The AI Software QA Engineer is responsible for testing, validating, and ensuring the quality and reliability of applications, APIs, and AI-enabled systems within the TP.ai ecosystem, focusing on validating backend APIs, heuristic models, and AI-driven systems using modern automation tools and AI-aware testing techniques in an API-first environment. The candidate should be self-driven, proactive, and passionate about learning emerging AI technologies, with the ability to quickly adapt in a fast-evolving AI landscape.

What you'll do

• Design, execute, and maintain manual and automated test cases for APIs, web applications, and AI components

• Conduct regression, system, and performance testing prior to production releases

• Perform API testing using Postman and Newman

• Validate JSON responses, API contracts, and schema compliance

• Test AI/ML and rule-based systems for accuracy and consistency

• Validate outputs using pattern-based, range-based, and semantic validation

• Perform prompt-based testing including edge cases and adversarial inputs

• Use tools such as Promptfoo and DeepEval for validation.

• Develop and maintain automation scripts using Playwright (JS/TS/Python) or Selenium

• Use AI-assisted tools such as GitHub Copilot and ChatGPT

• Perform SQL-based validation

• Validate data across API, processing, and output layers

• Execute automated tests in CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions)

• Support regression and release validation

• Identify, document, and track defects using Jira and TestRail

• Support debugging and root cause analysis

• Work closely with developers, product owners, and AI engineers during agile sprints

• Contribute to sprint planning and UAT activities

What you'll get

👩 💻Career Plan: All our professionals have access to processes specifically designed for their roles within the company: competency model, evaluations, training and certification plans, projects and events.

✈Vacation: 22 working days + 2 personal days + December 24 and 31 (company closure)

✨ Training: You will have options to train in the latest technologies and in ENGLISH! In addition, you can count on our official certification program and Udemy Business licenses.

🎁Surprises: You will receive surprises on special occasions such as work anniversaries, birthdays and the birth of your babies👼.

🎈Friend Plan: You can be an Ambassador of our brand through our Friend Plan and receive a reward 🤑.

🌱Quokka: activity program to promote emotional well-being, physical activity, and healthy nutrition

🏆Advantage Club: Benefits and discounts program (leisure, technology, well-being and health...)

🤍Kudos: Initiative to foster a culture of feedback and recognition.

Events are our thing! We have two major conferences as well as webinars and training sessions

Oh! We forgot to tell you that the Three Wise Men also stop by knowmad mood...🫅🪄

To stay up to date with our news, follow us here --> knowmad mood

How you'll work

remote

About the company & team

We are knowmad mood!

We are a leading digital transformation company, constantly evolving and at the forefront of technology. We were born to drive real change through innovation and sustainable development, with the mission of bringing value to clients and boosting our talent.

Made up of more than 3,000 creative, digital, and innovative people connected to a purpose and capable of generating connections with people around the world. A responsible, flexible team with a high capacity to adapt to the needs of our clients and the market, while providing value, vision, creativity, expertise, professionalism, and passion for technology in every project.

The values that set our course and guide us toward excellence are collaboration, innovation, commitment, fun, and trust.

QA & Testing Community

What do we value?

Quality Assurance & Testing

API Testing

AI & Heuristic Model Testing

• Hands-on experience in Responsible AI, LLM testing, and model evaluation with strong understanding of bias, safety, and hallucination testing.

Automation

Data Validation

CI/CD Integration

Defect Management

Collaboration

Experience

• 3-6 years in QA / Software Testing

• Experience in API and backend testing

• Exposure to AI systems preferred

Technical Skills

• API Testing: Postman, Newman

• Automation: Playwright / Selenium

• Programming: Basic Python / JavaScript

• SQL: Intermediate to advanced

• CI/CD: Azure DevOps / Jenkins

• Tools: Jira, TestRail

AI & Modern Tools

• Promptfoo

• DeepEval

• Azure AI Foundry / Azure OpenAI

• Awareness of LangChain / LangGraph

Additional information

We are committed to equal opportunities and respect for diversity. We apply our Equality Plan and the principle of non-discrimination in all our selection processes

This job was automatically translated to English, .

About the company

knowmad mood

knowmad mood

IT Consulting

View company profile
Spanish company
2500 employees