Web scraping and sentiment analysis based product analysis system

Customer reviews provide real-time feedback on the product or service and influence potential purchasing decisions of the customers. Develops trust and credibility in businesses. It contributes to the decision-making process of the customers about the product and can provide a competitive advantage with the comments made on the product. For customers who want to buy the product, there are opportunities such as getting a preliminary idea about the quality and performance of the product, and access to up-to-date and accurate information about the product. In this study, 34007 comments from 15 brands on Trendyol were taken with Scrapy, a web scraping library. By applying the dictionary-based sentiment analysis libraries Textblob and Vader to these comments, positive, neutral and negative values were calculated about the products and brands, and the keywords of all comments were obtained by applying the text summarization process. In this way, it has been determined what people think about products and brands without the need for customers to read comments. In addition, by analyzing the star values and comments given to the products, it was determined that the given stars could be misleading.