Design and Implementation of a Cloud Based Big Data Pipeline Architecture for Global E-commerce Analytics

The aim of this paper is to design the data pipeline for multinational e-commerce unified analytics platform by the Lambda data architecture then leveraging the Amazon Web Services (AWS) Cloud platform and services to implement the entire data pipeline. To support a large volume of transactions analysis, the data pipeline needs to consider load balancing and auto-scaling servers to ensure high availability and performance under varying workloads. In result, the data pipeline able to ingestion the data from various platforms and database then enabling advanced analytics and real-time actionable insight for example personalized recommendation, customer behavior analysis clickstream analysis, inventory monitoring, and real-time fraud detection.