Rahul Vishnoi

Janio.Asia Customer 360 Development

• Led the "One Customer View" project at Janio.Asia, aimed at consolidating data from multiple business units to create a unified customer database.
• Managed data synchronization from various sources, including MySQL, PostgreSQL, SFTP, Kafka, and third-party APls, ensuring high scalability and seamless integration.
• Reduced operational costs and maintenance overhead, enhancing overall organizational productivity.
• Role involved full system architecture design, EC2 server installations, Superset and Redshift cluster setups, and comprehensive system testing.
• Technologies: Spark Scala, Debezium, Databricks, Athena, Redshift, S3, EC2, Spark Streaming Kafka, Airflow, Superset, Metabase.

Databricks Infrastructure Setup and Management

• Configured and managed scalable Databricks clusters, integrated seamlessly with existing IT infrastructure to support sophisticated data processing and analysis.

Data Warehouse Construction Using Delta Lake

• Initiated and led the development of a state-of-the-art data warehouse using the Delta Lake format to improve data reliability, quality, and accessibility.
• Designed the warehouse to support both batch and real-time data processing for more dynamic and actionable analytics.
• Utilized Delta Lake's ACID transaction features to ensure data integrity across large datasets and multiple processing tasks.
• Enhanced data ingestion, storage, and retrieval processes by integrating the warehouse with the existing data ecosystem.
• Technologies: Delta Lake, Databricks, Spark, Redshift, S3, Airflow.

Paisabazaar.com Analytics Engine

• Led the development of an Analytics Engine to enhance real-time analytics and reporting across multiple channels at Paisabazaar.
• Integrated Debezium CDC and established a data lakehouse architecture to support scalable analytics and real-time data synchronization.
• Achievements include enhanced order tracking, improved conversion rates, and more effective competitor analysis.
• Technologies: Hadoop, MapReduce, Druid, Orc, Zeppelin, Spark, Scala, Debezium CDC, Hortonworks Cluster installation.

Bureau Reports Query Optimization

• Directed the optimization of bureau report queries, improving data retrieval efficiency and report speed.
• Developed and implemented query optimization techniques and indexing strategies to enhance system performance.
• Resulted in a faster, more efficient reporting system aiding timely decision-making.

Advantage:

• Real-time tracking of Customer's orders.
• Increase conversion rates by better identification of successful sales transactions.
• Enhance the inventory management system.
• Easy comparison of competitor's offers.
• Consumer behaviour learning and retargeting.

Real-Time Data Processing System

• Developed and optimized a real-time analytics system using Apache Hadoop, HBase, Kafka, and Open Replicator.
• Role: System design, streaming implementation, performance optimization.
  Technologies: Hadoop, HBase, Kafka, Aerospike, Java.

Email Personalization System

• Built a system for personalized email and push notifications based on user behavior, enhancing engagement and conversion rates.
• Role: Architecture design, coding, testing, team management.

Advantage:

Makes conversion easier

• Fewer email yields more customers
• Builds a passionate Audience