Lead Software Engineer - AWS automation with Java/Spring Boot, Kubernetes & Spark

Requisition Title: AWS Automation Expert with Java/Sprint Boot, Kubernetes & Spark

Background:

As part of the development and maintenance of our Big Data infrastructure on public cloud, we are looking for an experienced administrator to manage, optimize and ensure the availability of a platform focused on Spark and Synapse, with on-premise environments soon to migrate to public cloud solutions such as Snowflake and Databricks.

Level: Middle to Expert

Technical skills - Must Have:

• Development: Java/Springboot, Powershell

• Java application containerization, AKS application deployment, Docker image creation

• AWS Kubernetes Service with a focus on its specificities: AWS Identity, CSI, Nodepool, autoscaling, VM spot, etc.

• CI/CD & GitOps: Jenkins, ArgoCD, GitHub/Git, Nexus, Harbor

• Linux & Bash; mastery of security protocols: OAuth, SSL

• Monitoring: ElasticSearch/Kibana (user level, no administrator role).

Technical skills - Good to Have:

• Big Data: Spark, Hive Metastore, Hadoop (Hadoop is optional)

• Notion of Snowflake, Databricks (knowledge of Snowflake and Databricks, particularly in terms of storage, Data Catalog, and Data Federation

Relationship skills:

• Spirit of analysis and synthesis, autonomy and sense of responsibility

• Ability to work as a team and communicate effectively

• Customer focus and quality of service

Main missions:

• Development of APIs in Java/Spring Facilitating interface with AWS, Application Lifecycle Management (CI/CD)

• Ensure automated deployment and integration of solutions while complying with security requirements of the bank (authorization, authentication, encryption, resilience, AWS policies, etc.)

• Ensure availability, performance, and security of deployed solutions

• Manage incidents and tickets related to the Hadoop infrastructure by providing quality technical support

• Change management (preparation for change, testing, rollback, coordination with stakeholders, process)

• Participate in the development and monitoring of global production planning

• Set up and maintain technical documentation for internal teams and users

• Participate in task forces to solve complex technical problems

• Support customers in their transitions from on-premises to public cloud

• Work closely with publishers and internal teams

• Ensure technical periodic penalty payments according to the defined schedule