Niranjan Kyathanahally Shankarananda
Geel
Summary
Dynamic and results-driven Data Engineer with a comprehensive background in leading data transformation initiatives and optimizing data workflows. Skilled in fostering collaboration across teams to implement data-driven solutions that enhance operational efficiency and support strategic decision-making. Committed to continuous learning and leveraging cutting-edge technologies to drive business intelligence and reporting capabilities to new heights.
Overview
17
17
years of professional experience
1
1
Certification
Work History
Data Engineer
Apollo Solutions
02.2023 - Current
- Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability in Databricks and Airflow DAGs.
- .Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
- Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
- Streamlined complex workflows by breaking them down into manageable components for easier implementation and maintenance.
- Build Data consumption Aggregated layer in snowflake for Tableau reporting.
- Involved in improving the performance issues of Tableau dashboard and proposed solutions for faster response of Tableau reports.
- Involved in preparing data lineage and mapping documents for integrating new sources.
Data Engineer
Advantest
06.2020 - 01.2023
- Designed SCD2 data model and migrated the legacy system from oracle to Exasol
- Transitioned reporting solutions from outdated formats to modern PowerBI dashboards for interactive data analysis.
- Developed and deployed data pipeline in Lua scripting.
- Interacted with business for requirement gathering and proposing solution.
- Optimized SQL queries and database indexes to enhance query performance, achieving a 30% reduction in query execution times.
Lead Data Engineer
AI Enterprise
06.2019 - 01.2020
- Project: KDP Insights
- Responsibilities:
- Designed Data flow channels to retrieve data from source system [GCP/Oracle] and transforming it to structured data and storing in Hive & Bigquery.
- Created schema in Hive with performance optimization using bucketing & partitioning.
- Written Hive queries to transform data for further downstream processing.
- Realized 50% improvement in daily data load speeds and increased data volumes through extensive tuning and query redesign.
- Interacted with business to prepare design documents, data models for new requirements.
- Creating Dynamic Dashboards in Tableau to help the management identify trends in the business KPI’s over time and to take informed decisions.
Senior Product Engineer
Verizon Telematics
02.2017 - 06.2019
- Project: OEM - original equipment manufacturer
- Responsibilities:
- Load and transform large sets of structured and semi structured data.
- Responsible for managing data coming from different sources.
- Created Informatica workflows to bring data from upstream to stage area and to warehouse target tables.
- Written spark program using pyspark & Dataframes to process the data in hdfs and Oracle and storing in Warehouse/HDFS as per business request.
- Managed the end-to-end life cycle of development for projects including analyzing the requirements, translating new ideas into solutions and providing delivery, support, analysis & documentation
- Worked with Data Modeler and architects in designing the Warehouse architecture, involved in Data analysis and solution proposal to team members to design data model for reporting purpose
- Extensive experience in designing and development of various dashboards, reports utilizing various Tableau Visualizations like Dual Axis, Bar Graphs, Geo Maps, Histograms, Pie-Charts, Heat Maps, Bubble Charts.
Senior Software Engineer
Fidelity Investment
11.2013 - 02.2017
- Project: MDM ( Master Data Management )
- Responsibilities:
- Developed Informatica workflows to bring data into AMWH and used transformations like Source Qualifier, Expression, Aggregator, Joiner, Lookup, Update Strategy Union and Sequence Generator.
- Implemented business functionalities in PLSQL procedures, functions, packages and created triggers for real time data movement.
- Actively participated in discussion sessions to design the ETL job flow. Prepared detail design documents, which contain job designs and functionality of each job.
- Worked with Data Modeler and DBAs to build the data model and table structures in designing star scheme in AMWH.
Senior Software Engineer
Societe Generale
07.2012 - 11.2013
- Project: TSS ( Trade Settlement System )
- Responsibilities:
- Analyzed requirements and prepared of design documents and implementation strategy.
- Delivered customized applications script to setup Archive database and automated the Archive/Purging mechanism after the retention period.
- Development of new applications and enhancements on Oracle, PLSQL, Unix Shell scripting.
- Participated in Risk analysis in various stages of the project and providing risk mitigation mechanism.
Senior Software Engineer
Mindtree Limited
01.2011 - 07.2012
- Project: SITA Bag Manager
- Responsibilities:
- Analyzed & modified existing codes in PL/SQL, Shell scripts.
- Analyzed requirements and handled the preparation of design documents.
- Tuned the Oracle queries for reports to run in minutes which was running for hours.
- Resolved production tickets on priority basis.
Assistant System Engineer
TCS
09.2008 - 01.2011
- Project: QRM ( Qualitative Risk Management )
- Responsibilities:
- Created the stored procedures in PL/SQL and written shell scripts for business needs.
- Conducted unit testing of the modules before moved into production.
- Liaised with clients for gathering requirements, and worked on the development of the change requests.
Education
MBA - Project Management
Sikkim Manipal University
06.2013
Bachelor Of Engineering - Information Science
National Institute of Engineering
06.2008
Skills
- Apache Spark, Hive, Hadoop, Pyspark, DataFrames, Databricks
- Shell scripting, Python, Lua Scripting
- SQL, PLSQL, Oracle
- Informatica, ETL
- BigQuery, ExaSol, Snowflake
- AWS,GCP
- Tableau, PowerBI
- Stash, SVN,GIT
- ETL development
- Data warehousing
Certification
- Oracle Certified Associate
- Oracle
- 2013-03
LANGUAGES
English 100%
German 25%
Timeline
Data Engineer
Apollo Solutions
02.2023 - Current
Data Engineer
Advantest
06.2020 - 01.2023
Lead Data Engineer
AI Enterprise
06.2019 - 01.2020
Senior Product Engineer
Verizon Telematics
02.2017 - 06.2019
Senior Software Engineer
Fidelity Investment
11.2013 - 02.2017
Senior Software Engineer
Societe Generale
07.2012 - 11.2013
Senior Software Engineer
Mindtree Limited
01.2011 - 07.2012
Assistant System Engineer
TCS
09.2008 - 01.2011
Bachelor Of Engineering - Information Science
National Institute of Engineering
MBA - Project Management
Sikkim Manipal University
Similar Profiles
Ashley GunessAshley Guness
Customer Service Associate at Apollo Solutions LimitedCustomer Service Associate at Apollo Solutions Limited
Natalie CalleiNatalie Callei
Talent Acquisition Specialist at Bae Systems Inc./Apollo Pro SolutionsTalent Acquisition Specialist at Bae Systems Inc./Apollo Pro Solutions
Kumaresan VanmeekanathanKumaresan Vanmeekanathan
General Manager - Business Develeopment at Apollo Supply Chain SolutionsGeneral Manager - Business Develeopment at Apollo Supply Chain Solutions
Elie KeersmaekaersElie Keersmaekaers
Executive Officer at Roland DGExecutive Officer at Roland DG
Muhammad ZubairMuhammad Zubair
Crew Member at McDonald's BelgiumCrew Member at McDonald's Belgium