English Dataset for Automatic Forum Extraction
Computación y Sistemas (2019)
Abstract
This paper describes the process of collecting, maintaining and exploiting an English dataset of web discussions. The dataset consists of many web discussions with hand-annotated posts in the context of a tree structure of a web page. Each post consists of username, date, text, and citations used by its author. The dataset contains 79 different websites with at least 500 pages from each. Each web page consists of a tree structure of HTML tags with texts taken from selected web pages. In the paper, we also describe algorithms trained on the dataset. The algorithms employ basic architectures (such as a bag of words with an SVM classifier and an LSTM network) to set a baseline for the dataset. The dataset is available for research purposes.
Authors
BibTex
@article{cicling2019, title = {English Dataset for Automatic Forum Extraction}, author = {Jakub Sido and Miloslav Konop\'{i}k and Ond\v{r}ej Pra\v{z}\'{a}k}, journal = {Computaci{\'o}n y Sistemas}, year = {2019}, volume = {23}, pages = {765--771}, number = {3}, publisher = {Centro de Investigaci{\'o}n en Computaci{\'o}n, IPN}, url = "https://www.cys.cic.ipn.mx/ojs/index.php/CyS/article/view/3259/0", doi = "10.13053/CyS-23-3-3259", issn = "ISSN 2007-9737" }
