RT book part
T1 Scrapy: Methodology in Extracting User-Generated Content to Compile a Corpus from the Internet
A1 Orrequia Barea, Aroa
A1 Marín-Honor, Cristian
A2 Filología Francesa e Inglesa
K1 corpus linguistics
K1 computational linguistics
K1 sentiment analysis
K1 user-generated content
K1 Scrapy
K1 programming
AB Sentiment Analysis and Opinion Mining are becoming increasingly important in the field of Computational Linguistics due to the growing presence of the Internet in our lives. For this reason, in this chapter we discuss the research we conducted on technical and methodological aspects to extract user-generated content from webpages. This data is going to be used to compile a corpus of customer reviews of car rentals in Andalusia. The process has two main phases: on the one hand, the semi-automatic download of information and on the other, the cleaning of the text. For the first step, Scrapy is going to be used. It is a framework written in Python programming language, which allows users to extract and store information in different formats. In the second step, a text editor will be used to clean and format the reviews through regular expressions. The resulting texts will be suitable for specific corpus tools to study different aspects of Sentiment Analysis.
PB Peter Lang AG
SN 9783631797228
YR 2020
FD 2020
LK http://hdl.handle.net/10498/34340
UL http://hdl.handle.net/10498/34340
LA eng
NO Esta obra es resultado de investigación del proyecto "SentiTur: sistema de monitorización de opinión de usuarios de recursos turísticos andaluces basado en análisis de sentimiento y análisis visual"(UMA18-FEDERJA-158), financiado con 28.636,47€ por la Junta de Andalucía, Proyectos I+D+I en el marco del Programa Operativo FEDER Andalucía 2014-2020 Convocatoria 2018
DS Repositorio Institucional de la Universidad de Cádiz
RD 10-nov-2026