FacetE: Exploiting web tables for domain-specific word embedding evaluation

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

Abstract

Today's natural language processing and information retrieval systems heavily depend on word embedding techniques to represent text values. However, given a specific task deciding for a word embedding dataset is not trivial. Current word embedding evaluation methods mostly provide only a one-dimensional quality measure, which does not express how knowledge from different domains is represented in the word embedding models. To overcome this limitation, we provide a new evaluation data set called FacetE derived from 125M Web tables, enabling domain-sensitive evaluation. We show that FacetE can effectively be used to evaluate word embedding models. The evaluation of common general-purpose word embedding models suggests that there is currently no best word embedding for every domain.

Details

Original languageEnglish
Title of host publicationDBTest '20: Proceedings of the workshop on Testing Database Systems
PublisherAssociation for Computing Machinery (ACM), New York
Pages1-6
Number of pages6
ISBN (electronic)978-1-4503-8001-0
Publication statusPublished - 19 Jun 2020
Peer-reviewedYes

Publication series

SeriesMOD: International Conference on Management of Data (DBTest)

Conference

Title2020 Workshop on Testing Database Systems, DBTest 2020
Duration19 June 2020
CityPortland
CountryUnited States of America

External IDs

Scopus 85086066357
ORCID /0000-0001-8107-2775/work/142253453

Keywords