The English-language job board for Spain

Senior AI Test Automation Engineer

Hybrid in Madrid·Full-time·Added 6 days ago (last checked 7 Oct)

UST

137 open roles

Overview

Payments
12 or 14 salary payments a year
Work mode
Hybrid, Madrid
Contract
Full-time
Experience
Senior level
Benefits
Flexible pay plan, gym access

Visa options

  • The ad doesn’t mention sponsorship

    Not a refusal, but not a yes. Worth asking in your first message.

Find jobs with visa support

Skills

Nice to have

Requirements

What we're looking for

  • Strong experience in Python-based test automation (Playwright, pytest, BDD frameworks)
  • Proven ability to design and own test frameworks, not just test scripts
  • Experience integrating automation into CI/CD pipelines (GitLab preferred)
  • Knowledge of parallel execution, reporting tools, and flaky test management
  • Solid understanding of Git, clean code, and code review practices
  • Experience with Docker and basic knowledge of Kubernetes
  • Exposure to AI/ML testing (LLMs, RAG, non-deterministic systems) or strong motivation to learn
  • Understanding of APIs, microservices, event-driven architectures
  • Familiarity with SAFe, Agile, and DevOps principles
  • Experience with Jira and test management tools (Xray, Agile Hive, etc.)
  • Strong analytical mindset with end-to-end system understanding
  • Awareness of data privacy, security, and compliance in regulated environments

Pay & benefits

What you'll get

23 days of Annual Leave plus the 24th and 31st of December as discretionary days!

Numerous benefits (Health Care Plan, teleworking compensation, Life and Accident Insurances).

`Retribución Flexible´ Program: (Meals, Kinder Garden, Transport, online English lessons, Health Care Plan...)

Free access to several training platforms

Professional stability and career plans

UST also, compensates referrals from which you could benefit when you refer professionals.

The option to pick between 12 or 14 payments along the year.

Real Work Life Balance measures (flexibility, WFH or remote work policy, compacted hours during summertime...)

UST Club Platform discounts and gym Access discounts

The role

We are looking for the very Top Talent... and we would be delighted if you were to join our team!

We are looking for a Senior AI Test Automation Engineer to join the ML & AI ART, owning the end-to-end test automation strategy for an advanced AI/MLOps platform. This platform powers business-critical AI capabilities such as LLM-based assistants, RAG systems, agentic workflows, and ML pipelines.

What you'll do

  • Define and evolve the test automation architecture aligned with the Bank's Test Strategy
  • Design scalable, reusable automation frameworks and patterns across teams
  • Analyse requirements and ensure testability during Agile ceremonies (PI Planning, Backlog Refinement, etc.)
  • Design and automate test cases (functional & non-functional) based on risk and coverage
  • Implement automation using Python frameworks (Playwright, pytest, Behave/BDD)
  • Develop AI/ML-specific testing approaches (LLM evaluation, non-deterministic behaviour, RAG workflows)
  • Build and maintain API contract tests and microservices validation
  • Integrate and run automated tests in CI/CD pipelines (GitLab)
  • Use Docker/Kubernetes for reproducible test environments
  • Manage test execution across environments (DEV, INT, UAT, pre-PROD)
  • Monitor test health, handle flaky tests, and ensure reliable reporting
  • Report defects in Jira with proper traceability and evidence
  • Produce audit-ready test artefacts and ensure compliance with governance standards
  • Collaborate with cross-functional teams (POs, Engineers, MLOps, Data Engineers)
  • Act as Test Automation Ambassador within the ART
  • Ensure end-to-end traceability across requirements, tests, and results
  • Maintain and evolve test suites as systems (APIs, models, prompts) change

How you'll work

Work Location
Hybrid position in Madrid (3 days at client´s office, Sol area, next to the underground).

Business hours (40 hours weekly with 1 hour for lunch).

Hiring process

3 steps3 interviews1–2 weeks in all
  1. Learning about who you are

    With recruitment team

    Conversation about your background and experience; for some roles, a sense of your technical proficiency.

  2. Understanding what makes you tick

    What motivates you, your working style and personality, and whether you would thrive in UST and client team dynamics.

  3. Final interview

    With future peers, sometimes leadership or the client

    Informal chat with your future peers about team fit; depending on the role, members of the leadership team or the client may join.

  • UST replies within 24 hours of the final interview.
  • Timing depends on everyone's availability.

Hiring process

If you would like to know more, don't hesitate to apply and we'll get in touch to fill you in detail. We are waiting for you!

About UST

UST is a global digital transformation and IT services company headquartered in Aliso Viejo, California, USA. With over 30,000 employees worldwide, UST partners with major corporations across industries such as banking, healthcare, retail, and manufacturing to deliver technology solutions, including cloud, data analytics, and application development. The company has a strong global footprint with delivery centers across North America, Europe, Asia, and Latin America.

In Spain, UST has a significant presence in Málaga, where it operates a technology and innovation hub. The Málaga office is a key delivery center for European clients, offering roles in software engineering, data, and digital services. UST is known for its collaborative culture and investment in employee development, making it an attractive option for international professionals seeking to work in Spain's growing tech ecosystem.

Industry
Technology
Founded
1999
Employees
30,000
Headquarters
Alameda, USA
In Spain
Málaga
Website
ust.com

Good to know if you are moving

  • UST's Málaga office is part of a growing tech hub in southern Spain, offering a Mediterranean lifestyle with lower cost of living compared to Madrid or Barcelona.
  • The company provides visa and relocation support for international hires, as part of its global mobility programs.
  • UST emphasizes continuous learning and offers certifications and training in cloud, data, and engineering.
  • Málaga has a growing international community and is well-connected by air to major European cities, making it easy for expats to travel.
  • UST has a diverse workforce with employees from many nationalities, and English is commonly used in the Málaga office.

In their own words

About the company & team

More in detail, UST is a multinational company based in North America, certified as a Top Employer and Great Place to Work, with over 35,000 employees worldwide and presence in more than 35 countries. We are leaders in digital technology services, delivering large-scale technological solutions to top-tier companies.

Additional information

In UST we are committed to equal opportunities in our selection processes and do not discriminate based on race, gender, disability, age, religion, sexual orientation or nationality. We have a special commitment to Disability & Inclusion, so we are interested in hiring people with disability certificate.

All open roles at UST
WhatsApp

Scrum Master

UST6d ago
Hybrid in MadridNo Spanish needed
Hybrid in MadridNo Spanish needed

Senior DevOps Engineer

UST6d ago4 openings
Remote, MadridNo Spanish needed
Hybrid in MadridNo Spanish needed

DevOps Engineer

UST4d ago3 openings
Hybrid in MadridNo Spanish needed
Hybrid in MadridNo Spanish needed
Hybrid in MadridNo Spanish needed
Hybrid in MadridNo Spanish needed
Hybrid in MadridNo Spanish needed
Remote, MadridNo Spanish needed
See all 137 jobs