MUTHUKANNAN VELAN
Malaysia,14
Summary
Highly experienced Senior Data Engineer with 4+ years of successful experience building and maintaining data lakes to increase data processing efficiency, ETL processes and implementing data security and compliance measures, and leading cross-functional teams in the design and implementation of real-time data pipelines for improved business-critical decision making.
Overview
5
5
years of professional experience
1
1
Certification
Work History
DATA ENGINEER
AMBANK
05.2023 - Current
- Designed and implemented a scalable data pipeline to collect and process data from various sources.
- Developed and maintained ETL workflows using Talend TAC for processing and transforming large volumes of data.
- Analyzed the requirements and framed the business logic for the ETL process using Talend and involved in the Talend jobs design and its Development.
- Developed TAC jobs to move inbound files to HDFS file location based on monthly, weekly, daily partitioning.
- Developed Stored Procedure in order to perform the backlog data ingestion into the DataLake System.
- Developed and refined reporting tools managed lifecycle elements of ETL development, from robust testing to final deployment.
- Implemented a data lake solution by writing Shell Scripts to manage and ingest Source files into the System.
- Closely monitored data warehouse functionality and performance, proactively responding to issues.
- Designed high-performing data warehouse systems, optimizing business intelligence and analytics.
DATA ENGINEER- BIGDATA
IBM
03.2019 - 04.2023
- Developed and maintained Bigdata application with Spark-Scala on Hadoop Cluster (Cloudera) with current size of 160 Data Nodes running on Yarn Cluster mode.
- Enhanced and maintenance of Bigdata application on Talend Studio and TAC 6.4.1.
- Developed and maintained for EDWH area with ETL DataStage Application.
- Imported data using sqoop into Hive and HDFS from existing SQL Server.
- Developed multiple jobs in Scala spark for data cleaning, preprocessing and transforming.
- Maintained and managed Tableau driven dashboards & analytics and working knowledge of Tableau administration/architecture.
- Scheduled jobs using Oozie before deploying it to production and shared knowledge to operation team for day to day monitoring and supported code/design analysis, strategy development and project planning.
- Administered, supported and monitored databases by proactively resolving database issues and maintaining servers.
Education
B.E - COMPUTER SCIENCE AND ENGINEERING
SAVEETHA SCHOOL OF ENGINEERING
CHENNAI10.2018
Skills
- Python
- Scala
- Hadoop
- SQL
- Spark
- MS Azure
- AWS
- Talend/TAC/TDC/TDS
- Tableau
- Cloudera
- Hive
- Oracle
- Hadoop Ecosystem
- ETL processes
Certification
- MICROSOFT AZURE FUNDAMENTALS
- MICROSOFT AZURE DATA FUNDAMENTALS
- MICROSOFT AZURE AI FUNDAMENTALS
- MICROSOFT AZURE ADMINISTRATOR ASSOCIATE
- AWS CERTIFIED CLOUD PRACTITIONER
- BIGDATA FOUNDATIONS LEVEL 1
- HADOOP PROGRAMMING - LEVEL 1
- HADOOP FOUNDATIONS - LEVEL 1
- DATA SCIENCE FOUNDATIONS - LEVEL 1
Languages
Tamil
First Language
English
Upper Intermediate
B2
Timeline
DATA ENGINEER
AMBANK
05.2023 - Current
DATA ENGINEER- BIGDATA
IBM
03.2019 - 04.2023
B.E - COMPUTER SCIENCE AND ENGINEERING
SAVEETHA SCHOOL OF ENGINEERING
Similar Profiles
Hariz Faisal Abdul HalimHariz Faisal Abdul Halim
Senior Project Manager at Ambank (M) BerhadSenior Project Manager at Ambank (M) Berhad
Sholehak Mohamad AliSholehak Mohamad Ali
Customer Service Executive at Ambank (M) BerhadCustomer Service Executive at Ambank (M) Berhad
Pauline SiewPauline Siew
VP - Bancassurance at AmBank Group MalaysiaVP - Bancassurance at AmBank Group Malaysia