Vista previa generada por IA
Data Engineer role in Makati focusing on secure data platforms and ETL.
Key skills: Python, SQL, NoSQL, Azure, AWS, GCP, Kafka, Flink.
Title: Data Engineer
Location: Makati City, Philippines
Description: Data Engineer – Data and AI Tribe
Responsibilities
- Design, architect and maintain secure data platform with focus on optimal data warehousing and modelling, data processing and storage
- Assess and work with the right infrastructure and data technologies based on stakeholder requirements, ensuring highly available and scalable data capabilities
- Implement and maintain optimized workflows, ETL / ELT processes, and pipelines
- Produce visualization and insights on ingested data and be able to communicate results with non-technical stakeholders
- Work with colleagues such as Product Owner, Data Analysts, Software Engineers, and tech leads on implementing solutions involving end to end data ingestion, storage, and consumption
Qualifications
- Proficiency and experience in programming languages such as Python
- Expertise in SQL / RDBMS and NoSQL databases
- Extensive experience in design and implementation of data warehousing and data handling processes (ingestion, transformation, modelling, and storage). Experience with MS SQL / SQL Server , Oracle Databases
- Expertise in cloud platforms and technologies. Experience with Azure and its products such is a plus.
- Expertise in cloud platforms and technologies (Azure, AWS, GCP) is a plus but not required
- Experience with streaming platform setup and consumption such as Kafka, Flink
- Experience with consumption from other storages for streaming such as S3, Spark
- Experience in containers and container orchestration platforms such as Docker and Kubernetes
- Experience in CI / CD and Devops, scripting languages such as shell and automation
- Experience with software quality and data pipeline testing
- ETL concepts and tools.
- Preferably a degree in the related fields of Computer Science
- Strong problem solving and solutions engineering mindset
- Experience in working and coordinating remotely