Abhishek Shandilya
Berlin
Overview
14
14
years of professional experience
Work History
Senior Data Engineer
Contorion GmbH
10.2019 - Current
- Development and maintenance of ETL pipelines using Postgres SQL and Python, maintaining data integrity and verifying pipeline stability.
- Integrated different API's to data warehouse using Python.
- Analyzed complex data and identified anomalies, trends, and risks to provide useful insights to improve internal controls.
- Designed and implemented effective database solutions and models to store and retrieve data.
- Performance optimization and adding new features to ETL pipeline for data gathering of user tracking and creating optimized reporting solutions in Looker.
- Migration and development of data warehousing capabilities in Google BigQuery (GCP).
- Prepared documentation and analytic reports, delivering summarized results, analysis and conclusions to stakeholders.
- Contributed to internal activities for overall process improvements, efficiencies and innovation.
- Developed, implemented and maintained data analytics protocols, standards, and documentation.
- Scheduling and maintenance of ETL pipelines using Airflow scheduler.
Data Engineer
Ice Services
01.2019 - 07.2019
- Working on stabilization initiative to enhance data pipelines using
Python, Relational DB, SQL and Big Data technologies. - Providing distribution scripts to enable transfer of money which involves
complex royalties’ calculation resulting from all types of digital music
consumption to reduce royalty distribution by 30%. Versioning using Github. - Involved in agile Scrum and Kanban teams for refactoring of code for better performance.
ETL Developer
Barclays Global Service Centre
02.2017 - 11.2018
- Implementation of ETL operations in data warehouse using Python, Relational DB Oracle thus moving data in Data Lake and warehouse.
- Extensively involved in moving data and creating pipelines and
applying ETL transformations to publish data for business using Big Data technologies like Oracle PLSQL, Spark, Sqoop, Hive and Datastage. - Involved in processing of structured, semi-structured data using Hadoop and Python, processing files in Relational DB using PL/SQL.
- Involved in all agile Scrum ceremonies and troubleshooting activities as
and when required in production. - Worked on analyzing and POC activities in data warehouse using AWS
Redshift and loading data from S3 bucket and RDS. - Led initiative for switching to deploying and delivering containerized applications using Docker and Docker Compose.
- Wrote and optimized in-application SQL statements.
- Trained in coding for numerous Data Warehousing solutions.
Senior Consultant
Capgemini
09.2012 - 01.2017
- Involved in all phases of SDLC starting from requirement gathering and
analysis. Involved in creating batch jobs using ETL, Oracle PL/SQL. Worked as onsite coordinator and SME at IKEA of Sweden, Helsingborg. - Developed custom solutions based upon clients' strict requirements.
- Involved in agile scrum and Kanban ways of working to deliver new
functionality quickly and efficiently. - Exceeded customer requirements with accurate and deliverable solutions.
- Worked on identification of bottlenecks in application and
dependency of architecture on it. - Led the initiative of performance tuning of supplier report,
cleanup jobs and reorganisation activity. - Written Automation SQL scripts for batch job monitoring in critical order
flow which is a mission critical process for IKEA. - Lead and guide team during development and maintenance processes and creating standard operating procedures for new members of the team.
- Mentoring new resources in team and making sure they are productive
at the earliest. - Streamlined processes to cut downtime and optimize employee productivity.
Associate Software Engineer
HCL Technologies
04.2010 - 08.2012
- Teamed with business analysts to deliver high-availability solutions for mission-critical application for IKEA IT.
- Written procedures and functions in batch jobs as per change
requests. - Preparing SQL scripts for end user reports for stock situation in IKEA warehouse.
- Working with version control in Clear case and Clear quest.
- Supporting the business critical flows and users during the release.
- Worked on maintaining and creating the logs in reorganisation activity.
- Implementation of log checks functionality to log batch failures and track errors efficiently.
Timeline
Senior Data Engineer
Contorion GmbH
10.2019 - Current
Data Engineer
Ice Services
01.2019 - 07.2019
ETL Developer
Barclays Global Service Centre
02.2017 - 11.2018
Senior Consultant
Capgemini
09.2012 - 01.2017
Associate Software Engineer
HCL Technologies
04.2010 - 08.2012
Technical Diploma - Software Engineering
NIIT
Bachelor of Arts - English Literature
School of Open Learning
Summary
Detail-oriented Senior Data Engineer proficient in design, development and maintaining highly scalable, secure and reliable data structures. Accustomed to working closely with system architects, software architects and design analysts to understand business or industry requirements to develop comprehensive data models, looks and explores. Proficient at developing database architectural strategies at the modeling, design and implementation stages.
Skills
- Data analysis
- Data extracting
- ETL
- SQL Programming
- Python
- Looker
- Reporting
- Attention to Detail
- Performance tuning
- Teamwork and Collaboration
- Data Warehousing Management
- Warehousing expertise
Education
Technical Diploma - Software Engineering
NIIT
Delhi04.2010
Bachelor of Arts - English Literature
School of Open Learning
Delhi08.2009
Languages
English
Bilingual or Proficient (C2)
German
Beginner (A1)
Hindi
Bilingual or Proficient (C2)
Similar Profiles
Ute Küker-BannaschUte Küker-Bannasch
Head of Category Management & Private Label at Contorion GmbHHead of Category Management & Private Label at Contorion GmbH
Manja BeckerManja Becker
Head of Customer Service at ContorionHead of Customer Service at Contorion
Andreas LehmannAndreas Lehmann
Senior Vice President Operations / Customer Experience at ContorionSenior Vice President Operations / Customer Experience at Contorion