Senior QA AI Engineer
knowmad mood·Madrid, Spain
What they ask for
Have the right to work in Spain
knowmad mood doesn't mention sponsorship in the ad.
Work in English
English is required, per the ad.
Work on-site in Madrid
No relocation package mentioned.
Have 3+ years of experience
Senior-level role.
Pulled from the advert automatically — the full ad is what counts.
This job was published 4 months ago
About the role
The AI Software QA Engineer is responsible for testing, validating, and ensuring the quality and reliability of applications, APIs, and AI-enabled systems within the TP.ai ecosystem, focusing on validating backend APIs, heuristic models, and AI-driven systems using modern automation tools and AI-aware testing techniques in an API-first environment. The candidate should be self-driven, proactive, and passionate about learning emerging AI technologies, with the ability to quickly adapt in a fast-evolving AI landscape.
What you'll do
• Design, execute, and maintain manual and automated test cases for APIs, web applications, and AI components
• Conduct regression, system, and performance testing prior to production releases
• Perform API testing using Postman and Newman
• Validate JSON responses, API contracts, and schema compliance
• Test AI/ML and rule-based systems for accuracy and consistency
• Validate outputs using pattern-based, range-based, and semantic validation
• Perform prompt-based testing including edge cases and adversarial inputs
• Use tools such as Promptfoo and DeepEval for validation.
• Develop and maintain automation scripts using Playwright (JS/TS/Python) or Selenium
• Use AI-assisted tools such as GitHub Copilot and ChatGPT
• Perform SQL-based validation
• Validate data across API, processing, and output layers
• Execute automated tests in CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions)
• Support regression and release validation
• Identify, document, and track defects using Jira and TestRail
• Support debugging and root cause analysis
• Work closely with developers, product owners, and AI engineers during agile sprints
• Contribute to sprint planning and UAT activities
What you'll get
👩 💻Career Plan: All our professionals have access to processes specifically designed for their roles within the company: competency model, evaluations, training and certification plans, projects and events.
✈Vacation: 22 working days + 2 personal days + December 24 and 31 (company closure)
✨ Training: You will have options to train in the latest technologies and in ENGLISH! In addition, you can count on our official certification program and Udemy Business licenses.
🎁Surprises: You will receive surprises on special occasions such as work anniversaries, birthdays and the birth of your babies👼.
🎈Friend Plan: You can be an Ambassador of our brand through our Friend Plan and receive a reward 🤑.
🌱Quokka: activity program to promote emotional well-being, physical activity, and healthy nutrition
🏆Advantage Club: Benefits and discounts program (leisure, technology, well-being and health...)
🤍Kudos: Initiative to foster a culture of feedback and recognition.
Events are our thing! We have two major conferences as well as webinars and training sessions
Oh! We forgot to tell you that the Three Wise Men also stop by knowmad mood...🫅🪄
To stay up to date with our news, follow us here --> knowmad mood
How you'll work
remote
About the company & team
We are knowmad mood!
We are a leading digital transformation company, constantly evolving and at the forefront of technology. We were born to drive real change through innovation and sustainable development, with the mission of bringing value to clients and boosting our talent.
Made up of more than 3,000 creative, digital, and innovative people connected to a purpose and capable of generating connections with people around the world. A responsible, flexible team with a high capacity to adapt to the needs of our clients and the market, while providing value, vision, creativity, expertise, professionalism, and passion for technology in every project.
The values that set our course and guide us toward excellence are collaboration, innovation, commitment, fun, and trust.
QA & Testing Community
What do we value?
Quality Assurance & Testing
API Testing
AI & Heuristic Model Testing
• Hands-on experience in Responsible AI, LLM testing, and model evaluation with strong understanding of bias, safety, and hallucination testing.
Automation
Data Validation
CI/CD Integration
Defect Management
Collaboration
Experience
• 3-6 years in QA / Software Testing
• Experience in API and backend testing
• Exposure to AI systems preferred
Technical Skills
• API Testing: Postman, Newman
• Automation: Playwright / Selenium
• Programming: Basic Python / JavaScript
• SQL: Intermediate to advanced
• CI/CD: Azure DevOps / Jenkins
• Tools: Jira, TestRail
AI & Modern Tools
• Promptfoo
• DeepEval
• Azure AI Foundry / Azure OpenAI
• Awareness of LangChain / LangGraph
Additional information
We are committed to equal opportunities and respect for diversity. We apply our Equality Plan and the principle of non-discrimination in all our selection processes
About the role
The AI Software QA Engineer is responsible for testing, validating, and ensuring the quality and reliability of applications, APIs, and AI-enabled systems within the TP.ai ecosystem, focusing on validating backend APIs, heuristic models, and AI-driven systems using modern automation tools and AI-aware testing techniques in an API-first environment. The candidate should be self-driven, proactive, and passionate about learning emerging AI technologies, with the ability to quickly adapt in a fast-evolving AI landscape.
What you'll do
• Design, execute, and maintain manual and automated test cases for APIs, web applications, and AI components
• Conduct regression, system, and performance testing prior to production releases
• Perform API testing using Postman and Newman
• Validate JSON responses, API contracts, and schema compliance
• Test AI/ML and rule-based systems for accuracy and consistency
• Validate outputs using pattern-based, range-based, and semantic validation
• Perform prompt-based testing including edge cases and adversarial inputs
• Use tools such as Promptfoo and DeepEval for validation.
• Develop and maintain automation scripts using Playwright (JS/TS/Python) or Selenium
• Use AI-assisted tools such as GitHub Copilot and ChatGPT
• Perform SQL-based validation
• Validate data across API, processing, and output layers
• Execute automated tests in CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions)
• Support regression and release validation
• Identify, document, and track defects using Jira and TestRail
• Support debugging and root cause analysis
• Work closely with developers, product owners, and AI engineers during agile sprints
• Contribute to sprint planning and UAT activities
What you'll get
👩 💻Plan de Carrera: Todos nuestros profesionales tienen a su disposición procesos diseñados específicamente para sus funciones dentro de la compañía: modelo de competencias, evaluaciones, planes de formación y certificación, proyectos y eventos.
✈Vacaciones: 22 días laborables + 2 días de libre disposición + 24 y 31 de diciembre (cierre empresa)
✨ Formación: Tendrás opciones para formarte en las últimas tecnologías y en INGLES! Además, podrás contar con nuestro programa de certificaciones oficiales y las licencias de Udemy Business.
🎁Sorpresas: Recibirás sorpresas en momentos especiales como en aniversarios con nosotros, en tus cumples y nacimientos de vuestros bebés👼.
🎈Plan Amigo: Puedes ser Embajador de nuestra marca a través de nuestro Plan Amigo y recibir una recompensa 🤑.
🌱Quokka: programa de actividades para promover el bienestar emocional, la actividad física, y la nutrición saludable
🏆Club de ventajas: Programa de beneficios y descuentos (ocio, tecnología, bienestar y salud...)
🤍Kudos: Iniciativa para fomentar una cultura de feedback y reconocimiento.
¡Los eventos son lo nuestro! Tenemos dos grandes congresos además de webinars y formaciones
¡Ah! Se nos olvidaba decirte que Los Reyes Magos también se pasan por knowmad mood...🫅🪄
Para estar al corriente de nuestras novedades síguenos aquí --> knowmad mood
How you'll work
remote
About the company & team
We are knowmad mood!
Somos una compañía líder en transformación digital, en constante evolución y a la vanguardia de la tecnología. Nacimos para provocar un cambio real a través de la innovación y el desarrollo sostenible, con la misión de aportar valor a los clientes e impulsar nuestro talento.
Formado por más de 3.000 personas creativas, digitales e innovadoras conectadas a un propósito y capaces de generar conexiones con personas de todo el mundo. Un equipo responsable, flexible y con alta capacidad de adaptación a las necesidades de nuestros clientes y del mercado, a la vez que proporciona valor, visión, creatividad, expertise, profesionalidad y pasión por la tecnología en cada proyecto.
Los valores que marcan nuestro rumbo y nos guían hacia la excelencia son la colaboración, la innovación, el compromiso, la diversión y la confianza.
Comunidad QA & Testing
¿Qué es lo que valoramos?
Quality Assurance & Testing
API Testing
AI & Heuristic Model Testing
• Hands-on experience in Responsible AI, LLM testing, and model evaluation with strong understanding of bias, safety, and hallucination testing.
Automation
Data Validation
CI/CD Integration
Defect Management
Collaboration
Experience
• 3-6 years in QA / Software Testing
• Experience in API and backend testing
• Exposure to AI systems preferred
Technical Skills
• API Testing: Postman, Newman
• Automation: Playwright / Selenium
• Programming: Basic Python / JavaScript
• SQL: Intermediate to advanced
• CI/CD: Azure DevOps / Jenkins
• Tools: Jira, TestRail
AI & Modern Tools
• Promptfoo
• DeepEval
• Azure AI Foundry / Azure OpenAI
• Awareness of LangChain / LangGraph
Additional information
Nos comprometemos con la igualdad de oportunidades y el respeto a la diversidad. Aplicamos nuestro Plan de Igualdad y el principio de no discriminación en todos nuestros procesos de selección
This job was automatically translated to English, .
About the company
knowmad mood
IT Consulting