Presently a Data Engineer with over 8 years of diverse experience in big data and analytics, excel in designing, developing, and maintaining highly scalable, secure, and reliable data structures. Quality-driven and confident working independently or collaborating effectively as part of a team, adapting to the needs of each project. Expertise in implementation of robust and efficient data solutions that meet enterprise standards.
Hi, I’m
Juliet Yap
Senior Data Engineer
Kuala Lumpur
Summary
Overview
8
years of professional experience
2
Certifications
Skills
ETL development
Work History
FWD Technology & Innovation Malaysia
DATA ENGINEER
06.2022 - Current
Job overview
Focused on stream process optimization, implementing data governance control processes, and conducting research on emerging technologies such as generative AI.
WING TAI ONLINE BUSINESS
DATA ENGINEER
01.2021 - 06.2022
Job overview
Managed CICD for data operations, worked extensively with the Azure cloud platform, and automated business processes.
KEWMANN
DATA SCIENTIST
05.2019 - 12.2020
Job overview
Conducted research, data scraping, and API integration, and developed data analytics solutions.
ETIQA INSURANCE & TAKAFUL
DATA ANALYST
06.2018 - 05.2019
Job overview
Implemented and enabled big data platforms, and developed dashboards for data visualization.
STURNGROUP
SOFTWARE CONSULTANT
12.2017 - 06.2018
Job overview
Specialized in data integration, reporting solutions, and ETL processes.
AMBANK GROUP
ANALYST PROGRAMMER
11.2016 - 12.2017
Job overview
Focused on shell scripting related to data integration and ETL pipeline development.
SHRDCSelangor
BIG DATA ANALYTICS TRAINEE
09.2016 - 11.2016
Job overview
Education
UNIVERSITI OF SCIENCE, MALAYSIA
BSC. MATHEMATICS AND ECONOMICS
University Overview
Personal Information
Personal Information
- Age: 31 years old
- Date of Birth: 04/21/93
- Gender: Female
Skills & Abilities
Skills & Abilities
Data Pipeline Management: Designing, deploying, and managing secure and efficient data pipelines for seamless data collection, indexing, storage, and retrieval.
Cloud Architecture: Proficient in cloud platforms like Microsoft Azure to develop and deploy scalable and resilient solutions.
Event-Driven Functions: Experience in implementing event-driven functions for seamless data routing, which enhances real-time data processing and system responsiveness.
Data Availability & Performance Optimization: Expertise on maximizing data availability and the performance of existing applications and services, ensuring they run optimally.
Database and Data Management: Expert on Database Design & Management, Data Quality Assessment, Data Analysis, Pattern & Trend Identification, and Data Visualization.
Technical Proficiencies:
- Languages & Tools: Python, SQL, Base SAS, .NET, C#, Shell scripting, Excel.
- Streaming & Event Platforms: Spark Streaming, Confluent Platform.
- Platforms & Frameworks: Snowflake, Prefect, Docker, ADF, Databricks, Unity Catalog, Oracle BDA, Qlikview.
- Emerging Technologies: Generative AI
Accomplishments
Accomplishments
- Achieved >30% of optimization by enhancing Spark processing for real-time processing tasks.
- Achieved process streamlining by implementing CI/CD for repeated data operations.
- Resolved data protection issue through implementation of data governance control process.
- Collaborated with team of data engineers in the development of gen-AI solution.
Certification
Microsoft Certified: Azure AI Engineer Associate
Timeline
Microsoft Certified: Azure AI Engineer Associate
09-2023
Microsoft Certified: Azure Data Fundamentals
09-2023
DATA ENGINEER
FWD Technology & Innovation Malaysia
06.2022 - Current
DATA ENGINEER
WING TAI ONLINE BUSINESS
01.2021 - 06.2022
DATA SCIENTIST
KEWMANN
05.2019 - 12.2020
DATA ANALYST
ETIQA INSURANCE & TAKAFUL
06.2018 - 05.2019
SOFTWARE CONSULTANT
STURNGROUP
12.2017 - 06.2018
ANALYST PROGRAMMER
AMBANK GROUP
11.2016 - 12.2017
BIG DATA ANALYTICS TRAINEE
SHRDC
09.2016 - 11.2016
UNIVERSITI OF SCIENCE, MALAYSIA
BSC. MATHEMATICS AND ECONOMICS
Similar Profiles
Alfred Raj ThainesAlfred Raj Thaines
Service Delivery Specialist at IBM Client Innovation Centre Malaysia Sdn BhdService Delivery Specialist at IBM Client Innovation Centre Malaysia Sdn Bhd
Cloud ArcCloud Arc
Technical Support Engineer at FUJIFILM Business Innovation Malaysia Sdn BhdTechnical Support Engineer at FUJIFILM Business Innovation Malaysia Sdn Bhd
Tan Lok WenTan Lok Wen
SUPPORT CENTRE SENIOR MANAGER （OCEANIA OPERATION) at Fujifilm Business Innovation (Malaysia) Sdn BhdSUPPORT CENTRE SENIOR MANAGER （OCEANIA OPERATION) at Fujifilm Business Innovation (Malaysia) Sdn Bhd
Abduzafar MadraimovAbduzafar Madraimov
IDS (Infrastructure and Digital Solutions) Intern at Efes Kazakhstan JSC FEIDS (Infrastructure and Digital Solutions) Intern at Efes Kazakhstan JSC FE
Jack GooJack Goo
Senior Chef De Partie at Ilham Dining ConceptSenior Chef De Partie at Ilham Dining Concept