Lead Data Engineer ETL
Société Générale · Bangalore · On-site
Daily Operations & ETL Run Management
-
Ensure the complete and correct execution of all daily ETL batches. All detected errors must be identified, logged, analyzed, and resolved independently, including documentation of findings and corrective actions
-
Maintain and enhance Informatica PowerCenter ETL processes
-
Maintain, optimize, and enhance ETL processes
-
Maintain: ETL, Python, Java, Shell Scripts and Elastic Search
-
Adjust batch chains according to operational needs
-
Provide effort estimations for operational and change tasks
-
Create technical specifications for new requirements
-
Observe Linux Servers (Load, Diskspace, etc.), check Informatica Services Logfiles on errors
-
Work in metadata driven environments (DEV,TST,REF,PRD) based and script ecosystem
-
Administration/configuration of Informatica and Services
Incident & Problem Management
-
Evaluate incoming incidents and classify urgency & impact
-
Investigate error patterns and complex data-processing issues
-
Apply and coordinate corrective measures
-
Perform Root Cause Analysis (RCA)
-
Document all activities in the ticketing system (JIRA/Kanban)
Change Management
-
Follow internal governance, BAIT, MaRisk and compliance guidelines
-
Coordinate required inputs from technical and business stakeholders
-
Conduct effort estimation and timeline planning
-
Specify and implement ETL-related functional changes
-
Modify data models, ETL flows, and reporting logic
-
Prepare and participate in CAB (Change Advisory Board) meetings
-
Document all change-related activities
Testing Activities
-
Plan and conduct technical acceptance tests
-
Prepare test cases and perform manual or automated tests
-
Execute regression tests for ETL components
-
Document test steps, test results, and create formal test reports
Concept Creation & Technical Documentation
Creation or contribution to:
-
Architecture concepts
-
Test concepts
-
Permission concepts
-
Operating manuals
-
Disaster recovery / contingency concepts
-
Processing guidelines
-
Archiving & deletion concepts
-
Regular updates based on regulatory changes (BAIT, MaRisk, etc.).
Authorization Management
-
Create, modify, and remove access permissions
-
Ensure audit-proof documentation
-
Maintain internal access overview records
-
Support recurring user access reviews
Deployment Management
-
Independently plan, coordinate, and execute deployments across DEV/REF/PRD
-
Ensure all deployment activities follow the 4‑eyes principle and internal governance
-
Validate deployment artifacts and ensure compliance with standards
-
Conduct smoke tests after deployments and ensure system stability
-
Document deployment steps