Senior AI Platform Engineer – LLM Gateway

• 6 or more years of experience in Platform Engineering, Cloud Engineering, distributed systems integration, API Management, or similar areas.

• At least 1 year of demonstrable experience with AI Gateways.

• Experience implementing and operating APIs, shared platforms, or cross-functional services in enterprise environments.

• Experience integrating inference APIs and generative AI models in production, including streaming, concurrency, latency, tokens, and error management.

• Solid knowledge of API Gateways, access policies, quotas, rate limiting, and observability.

• Experience in API security: OAuth2, OIDC, JWT, secrets management, scopes, and audiences.

• Practical experience with AWS, especially IAM, secrets management, networking, observability, and infrastructure as code.

• Knowledge of networking and cloud security: VPC, proxy, DNS, TLS, certificates, and controlled egress.

• Experience with observability, metrics, logs, traces, alerts, and SRE practices.

• Development and automation with Python, including APIs, integrations, middlewares, or platform components.

• Experience with Terraform, CloudFormation, or CDK, CI/CD, and versioned configuration.

• Autonomy to diagnose and resolve complex technical incidents.

• AWS AgentCore Gateway, Amazon Bedrock, or other generative AI solutions on AWS.

• Implementation of LLM Gateways and governed access platforms for foundational models.

• Integration with OpenAI and other providers, including OpenAI-compatible APIs.

• Multi-model architectures, intelligent routing, and fallback mechanisms.

• Guardrails, protection against prompt injection, DLP, and data classification.

• FinOps applied to generative AI and token consumption optimization.

• Kubernetes/EKS, service mesh, and advanced SRE practices.

• Experience in banking or sectors with high security, audit, and regulatory compliance requirements.

🏢 Client: BBVA
🤝 Consultancy: Minsait
💰 Salary: €45,000 gross per year
🏡 Modality: 100% remote
🎯 Priority: High

We are looking for a Senior AI Platform Engineer to participate in the implementation and evolution of a corporate LLM Gateway platform for BBVA.

The objective is to provide common, secure, governed, and observable access to generative AI models, facilitating their integration with the Group's applications, services, and AI agents.

We are looking for a technical profile with practical experience in cloud platforms, API integration, security, automation, and operation in enterprise environments. This is not an exclusively functional position, nor is it focused solely on consuming AI APIs.

• Implement and evolve the technical components of the LLM Gateway following corporate architecture and standards.

• Integrate applications, services, and agents with corporate inference endpoints.

• Configure authentication and authorization mechanisms using OAuth2, OIDC, and JWT.

• Manage secrets, credentials, permissions, and access controls following security and least-privilege criteria.

• Implement API Gateway policies: rate limiting, quotas, routing, guardrails, and traceability.

• Configure secure connectivity with model providers: DNS, proxy, TLS, certificates, and network egress control.

• Develop resilience capabilities, including timeouts, retries, circuit breaking, fallback, and load testing.

• Implement observability through metrics, structured logs, distributed traces, alerts, and dashboards.

• Automate deployments, configurations, and testing using Terraform or other IaC tools and CI/CD pipelines.

• Facilitate the measurement and optimization of costs per application, agent, project, and model.

• Collaborate with Architecture, IAM, Cybersecurity, Networking, Cloud, SRE, and development teams.