Vista previa de la oferta
Senior AI Platform Engineer - Global Markets Data & AI Lab
senior · Technology / Software Development
Job Title: Senior AI Platform Engineer
Department: Front Office Support
About Business line/Function: Global markets – Data & AI Lab
Position Purpose:
As part of the Global Markets Quantitative Research team, you will play a pivotal role in the lifecycle and support of our Machine Learning models. This is a high-impact role sitting at the intersection of DevOps automation, large-scale Data Engineering, and modern Observability.
You will be responsible for building robust CI/CD pipelines, optimizing massive PySpark workloads, and ensuring the reliability of our global ML platform through advanced monitoring and Application Performance Management (APM). Furthermore, you will leverage LLM-based coding assistants (e.g., Claude Code, Qwen Code....) to accelerate development, refactor legacy code, and drive engineering excellence.
Responsibilities
DevOps & Infrastructure Automation
- Design and implement end-to-end CI/CD pipelines using Jenkins to optimize the time-to-market for ML and Web projects.
- Orchestrate containerized environments using Docker and Kubernetes for scalable, reproducible deployments.
- Automate infrastructure delivery and configuration management using Ansible and shell scripting.
- Integrate automated code quality gates (e.g., SonarQube) and automated testing into the deployment lifecycle.
2. Data Engineering & Spark Optimization
- Configure Spark/PySpark environments — cluster provisioning, session setup, and resource tuning (memory, cores, dynamic allocation, shuffle).
- Design and build high-performance batch and near-real-time pipelines, owning setup from environment bootstrap to production.
- Perform deep performance tuning of Apache Spark jobs (caching, partitioning, join strategies) to handle datasets exceeding 1TB.
- Wire Spark into storage, orchestration, and resource managers (S3/HDFS, YARN/Kubernetes).
- Refactor legacy Python codebases to improve execution speed, memory efficiency, and resource utilization.
3. Observability & Application Performance Management (APM)
- Enhance platform visibility by implementing comprehensive monitoring solutions using Grafana and Prometheus.
- Drive full-stack observability by utilizing APM tools (such as Dynatrace) to monitor application health, distributed traces, and end-to-end system performance.
- Build and maintain dashboards to track Spark throughput, latency, failure rates, and infrastructure utilization.
- Participate in troubleshooting and production support, using telemetry and logs to proactively identify and resolve system bottlenecks.
4. AI-Augmented Engineering
- Leverage LLM-based tools (e.g., Claude Code) to accelerate the development of unit tests, documentation, and complex Python refactoring.
- Use AI assistants to increase engineering velocity and ensure code adheres to modern, highly efficient standards.
Technical & Behavioral Competencies
Category
Requirement
Programming
4 years of professional experience in Python (PEP-8, type hints, profiling).
Data Engineering
Deep expertise in Apache Spark (Core, SQL, Structured Streaming) and PySpark. Hands-on cluster setup and configuration — session tuning, memory/executor sizing, partitioning and join optimization on datasets exceeding 1TB.
CI/CD & DevOps
3+ years building CI/CD pipelines with Jenkins, Git, Bitbucket, Artifactory. Experience integrating quality gates (SonarQube) and automated testing into the deployment lifecycle.
Containerization & Orchestration
Strong knowledge of Docker and Kubernetes for scalable, reproducible deployments.
Infrastructure Automation
Proficiency in Linux/Unix, Ansible, and shell scripting for infrastructure delivery and configuration management.
Observability & APM
Hands-on with Grafana and Prometheus; dashboarding for throughput, latency, and failure rates. APM platforms (e.g., Dynatrace) for distributed tracing and full-stack monitoring highly preferred.
Production Support
Experience in troubleshooting and on-call/production support using telemetry and logs to resolve bottlenecks.
Behavioral Skills:
- Communication: Ability to explain complex technical concepts to stakeholders; fluent in English (written and spoken).
- Mindset: Proactive, enthusiastic, and driven to improve processes and system reliability.
- Global Collaboration: Ability to work effectively within a distributed team (Paris, London, NY, Singapore, India, Frankfurt).
Education Level: Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related quantitative field.
Location: Bangalore, India
About BNP Paribas Group:
BNP Paribas is the European Union’s leading bank and key player in international banking. It operates in 65 countries and has nearly 185,000 employees, including more than 145,000 in Europe. The Group has key positions in its three main fields of activity: Commercial, Personal Banking & Services for the Group’s commercial & personal banking and several specialized businesses including BNP Paribas Personal Finance and Arval; Investment & Protection Services for savings, investment, and protection solutions; and Corporate & Institutional Banking, focused on corporate and institutional clients. Based on its strong diversified and integrated model, the Group helps all its clients (individuals, community associations, entrepreneurs, SMEs, corporates and institutional clients) to realize their projects through solutions spanning financing, investment, savings and protection insurance. In Europe, BNP Paribas has four domestic markets: Belgium, France, Italy, and Luxembourg. The Group is rolling out its integrated commercial & personal banking model across several Mediterranean countries, Turkey, and Eastern Europe. As a key player in international banking, the Group has leading platforms and business lines in Europe, a strong presence in the Americas as well as a solid and fast-growing business in Asia-Pacific. BNP Paribas has implemented a Corporate Social Responsibility approach in all its activities, enabling it to contribute to the construction of a sustainable future, while ensuring the Group's performance and stability.
About BNP Paribas India Solutions:
Established in 2005, BNP Paribas India Solutions is a wholly owned subsidiary of BNP Paribas SA, European Union’s leading bank with an international reach. With delivery centers located in Bengaluru, Chennai and Mumbai, we are a 24x7 global delivery center. India Solutions services three business lines: Corporate and Institutional Banking, Investment Solutions and Retail Banking for BNP Paribas across the Group. Driving innovation and growth, we are harnessing the potential of over 10000 employees, to provide support and develop best-in-class solutions.
Commitment to Diversity and Inclusion
At BNP Paribas, we passionately embrace diversity and are committed to fostering an inclusive workplace where all employees are valued, respected and can bring their authentic selves to work. We prohibit Discrimination and Harassment of any kind and our policies promote equal employment opportunity for all employees and applicants, irrespective of, but not limited to their gender, gender identity, sex, sexual orientation, ethnicity, race, colour, national origin, age, religion, social status, mental or physical disabilities, veteran status etc. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in.