Přístupnostní navigace
E-přihláška
Vyhledávání Vyhledat Zavřít
Detail publikace
BURGET, R.
Originální název
Scraping Data from Web Pages using SPARQL Queries
Typ
článek ve sborníku mimo WoS a Scopus
Jazyk
angličtina
Originální abstrakt
Despite the increasing use of semantic data, plain old HTML web pages often provide a unique interface for accessing data from many domains. To use this data in computer applications or to integrate it with other data sources, it must be extracted from the HTML code. Currently, this is typically done by single-purpose programs called scrapers. For each data source, specific scrapers must be created, which requires a thorough analysis of the source page's implementation in HTML. This makes writing and maintaining a set of scrapers a complex and time-consuming task. In this paper, we present an alternative approach that allows defining scrapers based on visual properties of the presented content instead of the HTML code structure. First, we render the source page and create an RDF graph that describes the visual properties of every piece of the displayed content. Next, we use SPARQL to query the model and extract the data. As we demonstrate with real-world examples, this approach allows us to easily define more robust scrapers that can be used across multiple web sites and that that better cope with changes in the source documents.
Klíčová slova
Web scraping, Page rendering, Data extraction, RDF, SPARQL
Autoři
Vydáno
16. 6. 2023
Nakladatel
Springer Nature Switzerland AG
Místo
Alicante
ISBN
978-3-031-34443-5
Kniha
Web Engineering - 23rd International Conference, ICWE 2023
Edice
Lecture Notes in Computer Science
Strany od
293
Strany do
300
Strany počet
8
URL
https://link.springer.com/chapter/10.1007/978-3-031-34444-2_21
BibTex
@inproceedings{BUT183806, author="Radek {Burget}", title="Scraping Data from Web Pages using SPARQL Queries", booktitle="Web Engineering - 23rd International Conference, ICWE 2023", year="2023", series="Lecture Notes in Computer Science", pages="293--300", publisher="Springer Nature Switzerland AG", address="Alicante", doi="10.1007/978-3-031-34444-2\{_}21", isbn="978-3-031-34443-5", url="https://link.springer.com/chapter/10.1007/978-3-031-34444-2_21" }
Dokumenty
icwe_scraping_draft.pdf