Summary
Overview
Work History
Education
Skills
Accomplishments
Certification
Projects
Interests
Timeline
Generic

Manish Semwal

Pune

Summary

Experienced Data Engineer and ETL Specialist with a proven track record in integrating on-premises and cloud technologies for comprehensive data integration and management solutions. Demonstrated success in managing complex data integration and digital transformation projects across diverse industry verticals, including manufacturing, retail, and insurance.

In the domains of B2B, ETL, and cloud technologies, I have served as an offshore lead and developer, contributing significantly to high-impact engagements throughout the software development lifecycle. My role encompassed all stages from system design and development to testing, technical leadership, and client training. Adept at delivering scalable and efficient solutions, enhancing data processes, and enabling clients with robust data management capabilities.

Overview

15
15
years of professional experience
1
1
Certification

Work History

Data Integration Engineer | ETL

Pingahla Solutions Pvt. Ltd.
08.2018 - Current
  • Designed and Implemented ETL Solutions: Developed and implemented a comprehensive redesign of all enterprise-wide ETL processes, leveraging state-of-the-art solutions such as Informatica and Talend to increase data throughput by 200%.
  • Developed a Robust Framework: Designed and implemented a detailed error recording system to systematically capture, categorize, and analyze data errors within ETL processes.
  • Enhanced Troubleshooting Efficiency: The new structure led to a 50% reduction in troubleshooting time by streamlining error identification and resolution processes.
  • Optimized ETL Processes: Enabled seamless ETL operations through improved error handling and reporting mechanisms, significantly enhancing the reliability and performance of data integration workflows.
  • Delivered Expert Training: Provided coaching to a group of eight professionals on sophisticated data integration methods, covering advanced ETL processes, cloud data solutions, and best practices in data management.
  • Data Integration & Management: Expert in designing and implementing robust data integration solutions that bridge on-premises systems with cloud technologies, ensuring seamless data flow and operational efficiency.
  • Integrated CI/CD Practices: Led the adoption and integration of Continuous Integration and Continuous Deployment (CI/CD) methodologies into ETL workflows, streamlining the development and deployment pipeline.
  • Achieved Significant Time Reduction: Successfully decreased deployment time by 40% through automated testing, continuous integration, and efficient deployment practices.
  • Promoted Docker Adoption: Championed the use of Docker for containerizing ETL processes, enhancing the efficiency and scalability of data manipulation tasks.
  • Improved Resource Utilization: Achieved a 20% increase in resource utilization through optimized container management, resulting in more effective use of system resources.
  • Enhanced Scalability and Isolation: Provided a highly scalable and isolated environment for ETL operations, improving the flexibility and reliability of data processing workflows.
  • Data Quality and Governance: Implemented data quality checks, validation processes, and governance practices to ensure data accuracy, consistency, and compliance with organizational standards.

ETL Developer

Freelance Consultant
10.2016 - 07.2018
  • End-to-End System Design and Development: Led the complete design and development of various analytical and operational data systems, ensuring comprehensive solutions tailored to client needs.
  • EDI/EDIFACT Solutions: Developed and implemented EDI/EDIFACT interchange systems, facilitating efficient and standardized data exchange between business partners.
  • Informatica Expertise:Informatica PowerCenter: Designed and built ETL workflows and data integration solutions using Informatica PowerCenter, optimizing data extraction, transformation, and loading processes.
    Informatica B2B Data Transformation: Utilized Informatica B2B Data Transformation to streamline and enhance data processing capabilities, integrating data from multiple sources.
    Informatica B2B Data Exchange: Managed Informatica B2B Data Exchange implementations to enable secure and reliable data exchanges between different business systems.
  • Solution Design: Created and executed solution designs for complex data integration projects, ensuring alignment with business requirements and technical specifications.
  • Project Management: Oversaw all phases of project lifecycles, from initial design and development to implementation and post-deployment support, delivering projects on time and within budget.
  • Client Collaboration: Worked closely with clients to understand their data integration needs, providing expert advice and customized solutions to address specific challenges and improve operational efficiency.
  • Technical Documentation: Developed detailed technical documentation and user guides to support system maintenance and provide clients with clear instructions on using and managing data integration solutions.
  • Streamlined ETL Workflows: Implemented optimized ETL processes that significantly reduced data processing times by 30%, enhancing the efficiency of data extraction, transformation, and loading operations (This emphasizes the specific actions you took to optimize ETL processes and the direct result on data processing times).
  • mplemented Automation Solutions: Introduced automation strategies and best practices to streamline data integration workflows, significantly reducing manual intervention and operational overhead.
  • Achieved Efficiency Gains: Realized a 25% increase in overall efficiency by automating repetitive tasks, optimizing data pipelines, and implementing efficient data handling practices.
  • Client Interaction: Actively interfaced with clients to gather detailed requirements, provide regular project updates, and ensure alignment with project goals, fostering strong client relationships and understanding.
  • Achieved High Satisfaction: Attained a 95% client satisfaction rate by delivering on project objectives, maintaining clear communication, and addressing client needs and feedback effectively.
  • Ongoing Support: Highlights your role in providing consistent and reliable support for ETL solutions, emphasizing the ongoing nature of your work.
  • Prompt Issue Resolution: Quantifies your effectiveness in resolving issues, demonstrating a high level of proficiency in troubleshooting and problem-solving.
  • Performance Optimization: Describes your role in improving ETL job performance and the methods used to achieve these improvements.
  • Efficient Data Handling: Quantifies the impact of your optimizations on data processing time, providing a clear measure of your success.
  • Optimized SQL Queries: Fine-tuned SQL queries to enhance efficiency, reduce execution time, and improve overall performance of data retrieval and manipulation processes.
  • Refined Data Manipulation: Streamlined data manipulation processes to eliminate bottlenecks and ensure faster and more accurate data handling.



Junior Consultant - Data Engineer

Perficient
08.2014 - 07.2016
  • Functionality Testing: Conducted thorough testing of product functionality to ensure alignment with design specifications and business requirements.
  • Performance Evaluation: Assessed product performance under various conditions to verify stability, scalability, and responsiveness, ensuring optimal user experience.
  • Compliance Verification: Verified that products met industry standards, regulatory requirements, and internal development guidelines to maintain high quality and compliance.
  • Standards Maintenance: Implemented rigorous testing procedures and quality assurance practices, resulting in strong development standards and consistently high customer satisfaction.

Operations Manager

Capillary Technologies
10.2009 - 04.2012
  • Operational Leadership: Spearheaded the implementation of both short-term and long-term strategies to drive day-to-day operations, ensuring alignment with business plans and profitability goals.
  • Customer Satisfaction Enhancement: Elevated customer satisfaction ratings by providing timely and effective resolutions to customer issues, significantly improving client experience and retention.
  • Team Coaching and Training: Coached and trained 30-40 team members across multiple client sites, enhancing their skills and performance, which contributed to improved operational efficiency and team effectiveness.

Education

Diploma of Higher Education Statistical Analysis and Machine Learning -

Imarticus Learning Institute
Mumbai, MH

Integrated Bachelor Honors and Masters (Applied Geology & Geophysics) - undefined

Indian Institue of Technology
Kharagpur, WB

Skills

  • Data Transformation: Talend, Databricks, IDMC, SQL, Informatica PowerCenter, Azure Data Factory
  • Data Analysis: Python (Pandas, NumPy), Tableau, Excel
  • Programming: Python
  • Database Management: Microsoft SQL Server, Oracle Database, PostgreSQL, MySQL, MongoDB, Redshift, Amazon Relational Database Service, Datalake/Lakehouse
  • Core Competencies: Data Warehouse Architecture, ETL, Data Modelling, Data Governance, Data Quality
  • Project Management: Skills in managing data projects, including Agile methodologies and tools
  • Machine Learning: Basic understanding of machine learning algorithms and their applications (if applicable)
  • Data Visualization: Creating meaningful visual representations of data to aid in decision-making

Accomplishments

  • Optimized ETL Processes:Achievement: Implemented performance optimization strategies for ETL jobs, leading to a 30% reduction in data processing time.

    Impact: Enhanced overall system performance and efficiency, enabling faster data availability and improved operational workflows.

  • Automated Data Integration Workflows:Achievement: Introduced automation strategies and best practices, resulting in a 25% increase in efficiency in data integration workflows.

    Impact: Streamlined processes, reduced manual intervention, and increased overall productivity.

  • Enhanced Performance with SQL and ETL:Achievement: Fine-tuned SQL queries, data manipulation processes, and ETL workflows, achieving a 20% improvement in data processing speed.

    Impact: Improved data handling and system responsiveness, supporting better decision-making and operational efficiency.

Certification

  • Informatica Cloud Data and Application Integration R34, Certified Professional certified
  • Databricks Certified Data Engineer Professional
  • Databricks Certified Data Engineer Associate
  • Informatica Cloud Data Governance & Catalog Foundation Series

Projects

Imarticus Learning, Credit Risk Analysis:Build Predictive Models Using Algorithm to Annalise the Risk Associated with the Loan Institute Des Sciences De La Terre D'Orleans (CNRS, Orleans, France), Worked on the numerical modelling of volcanic degassing and developed a mathematical simplification of the complex system of equations. Instituto Nazionale di Geofisica & Vulcanologia (Rome, Italy), Worked on the use of Italian data for statistical analysis using Matlab and ZMAP software to process seismic data coming from permanent and non-permanent Italian networks for the analysis of the seismic patterns.

Interests

Data Science and Machine Learning: Passionate about exploring advancements in data science and machine learning, including staying updated on new algorithms, techniques, and applications

Open Source Contributions: Contribute to open source projects related to data engineering and ETL, supporting community-driven innovations and collaborative problem-solving

Travel and Culture: Interest in exploring different cultures and traveling, which provides new perspectives and inspires creative thinking in problem-solving

Fitness and Wellness: Commitment to maintaining a healthy lifestyle through activities like running, yoga, and mindfulness practices, contributing to overall well-being and productivity

Timeline

Data Integration Engineer | ETL

Pingahla Solutions Pvt. Ltd.
08.2018 - Current

ETL Developer

Freelance Consultant
10.2016 - 07.2018

Junior Consultant - Data Engineer

Perficient
08.2014 - 07.2016

Operations Manager

Capillary Technologies
10.2009 - 04.2012

Diploma of Higher Education Statistical Analysis and Machine Learning -

Imarticus Learning Institute

Integrated Bachelor Honors and Masters (Applied Geology & Geophysics) - undefined

Indian Institue of Technology

Similar Profiles

  • Tasneem Kanchwala

    Tasneem KanchwalaTasneem Kanchwala

    Data Engineer/ Manager at PingahlaData Engineer/ Manager at Pingahla

  • Jissin Antony

    Jissin AntonyJissin Antony

    Assistant Manager - Financial Shared Services at Thinksynq Solutions Pvt Ltd (Outsourced to Servion Global Solutions Pvt Ltd)Assistant Manager - Financial Shared Services at Thinksynq Solutions Pvt Ltd (Outsourced to Servion Global Solutions Pvt Ltd)

  • Hari Prasad Poovalingam

    Hari Prasad PoovalingamHari Prasad Poovalingam

    Quality Analyst at Nthrive Global Solutions Pvt. Ltd (Formerly E4E Business Solutions Pvt. Ltd)Quality Analyst at Nthrive Global Solutions Pvt. Ltd (Formerly E4E Business Solutions Pvt. Ltd)

  • Sagar Chandrawar

    Sagar ChandrawarSagar Chandrawar

    Sales Operation Specialist at Veritas Technologies Ltd (now Part of Cohesity)Sales Operation Specialist at Veritas Technologies Ltd (now Part of Cohesity)

  • Yad Sinha

    Yad SinhaYad Sinha

    Mainframe Sen. Consultant at ADPMainframe Sen. Consultant at ADP

CREATE PROFILE
Manish Semwal