Mid-Level
We are seeking a skilled and experienced Data Engineer to join our team for a cutting-edge Big Data Project. The ideal candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines and infrastructure to support our data-driven initiatives. This role requires a strong technical background in big data technologies and data engineering best practices.
Duties & Responsibilities:
Responsibilities Include:
Implement, maintain and evolve cloud-based Big Data products and services
Responsible for designing, implementing, testing, and maintaining ETL processes for Analytics and Business Intelligence Systems
Analyze data warehouses and suggest optimizations to SQL Queries used for Business Intelligence reporting
Modify structured and unstructured data to provide meaningful reports to business
Write large amounts of code, perform code reviews, write unit tests
Write documentation
Interface with other groups including Product Management, QA and Operations
Create quick proof-of-concept prototypes
Participate in an agile team
Work Experience:
At least 2 years relevant work experience
Skills & Competencies:
Working experience in software development using Java, Scala, or Python is a must
Extensive experience in implementing scalable and reliable ETL pipelines using Big Data Technologies such as Apache Spark, Hadoop, AWS Glue
Experience transforming data in various formats ( JSON,CSV, PARQUET, YAML, Avro, Orc)
Experience managing and scheduling workflows (Apache Airflow experience is preferred)
Experience with working on SQL Databases (Cloud Data Warehouses such as Amazon Redshift, Google BigQuery, and Data Lakes/Delta Lakes are preferred)
Ability to analyze and simplify complex code and algorithms in Java, Scala or Python
Ability to adapt and learn different technologies that best solves the problem regardless of whether it is written in Python, Java, Scala, etc.
Ability to perform ad-hoc complex SQL queries and query optimization
Team player with strong communication skills
Desire to learn fast and pick up latest technologies and tools
Experience with data visualization software (Tableau preferred) is a plus
Experience with Kubernetes and Machine Learning is a plus
Sign up to apply and find out right away if you're a fit.
Your agent will tell you — in seconds.
Sign up and I'll tell you right away how well Samsung Climate Solutions matches you — what you already have, and what's missing. Then I stay on it: I search for you and only write when I find something worth your time.