TrueTag an E-commerce Assistant

Abstract

The surge in e-commerce has generated huge unorganized flows of product information, such as reviews, availability and varying prices. Although manual collection methods are inefficient, automated scraping tools that are currently offered cannot often be easily integrated with platforms of structured storage and visualization, restricting their utility as real-time analysis tools. In this paper, TrueTag, a complete-stack, modular system of automating the whole process, including interactive visualization to data scraping is presented. Its Python-based backend will gather structured product information on such popular market places as Amazon and myntra by circumventing antibot defenses using specialized scripts. A real-time search, comparison, and trend visualization interactive dashboard is offered by a React-based frontend which is fed by the standardized information via a middleware API. As shownby experimental tests, the framework is scalable to various platforms, is highly accurate in extracting data and can handle the dynamic structure of sites. TrueTag provides a useful and versatile platform to analyze the market, business intelligence, and academic research by converting raw data into practical information.