Learning from Textual Data in Database Systems

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

Abstract

Relational database systems hold massive amounts of text, valuable for many machine learning (ML) tasks. Since ML techniques depend on numerical input representations, pre-trained word embeddings are increasingly utilized to convert text values into meaningful numbers. However, a naïve one-to-one mapping of each word in a database to a word embedding vector misses incorporating rich context information given by the database schema. Thus, we propose a novel relational retrofitting framework Retro to learn numerical representations of text values in databases, capturing the rich information encoded by pre-trained word embedding models as well as context information provided by tabular and foreign key relations in the database. We defined relation retrofitting as an optimization problem, present an efficient algorithm solving it, and investigate the influence of various hyperparameters. Further, we develop simple feed-forward and complex graph convolutional neural network architectures to operate on those representations. Our evaluation shows that the proposed embeddings and models are ready-to-use for many ML tasks, such as text classification, imputation, and link prediction, and even outperform state-of-the-art techniques.

Details

Original languageEnglish
Title of host publicationCIKM '20: Proceedings of the 29th ACM International Conference on Information & Knowledge Management
PublisherAssociation for Computing Machinery (ACM), New York
Pages375-384
Number of pages10
Volume2020
ISBN (electronic)978-1-4503-6859-9
Publication statusPublished - 19 Oct 2020
Peer-reviewedYes

Publication series

SeriesCIKM: Conference on Information and Knowledge Management

Conference

Title29th ACM International Conference on Information and Knowledge Management
Abbreviated titleCIKM 2020
Duration19 - 23 October 2020
CityVirtual, Online
CountryIreland

External IDs

Scopus 85095865181
ORCID /0000-0001-8107-2775/work/142253587

Keywords

Keywords

  • relational database, retrofitting, word embedding