Fast approximated nearest neighbor joins for relational database systems
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
K nearest neighbor search (kNN-Search) is a universal data processing technique and a fundamental operation for word embeddings trained by word2vec or related approaches. The benefits of operations on dense vectors like word embeddings for analytical functionalities of RDBMSs motivate an integration of kNN-Joins. However, kNN-Search, as well as kNN-Joins, have barely been integrated into relational database systems so far. In this paper, we develop an index structure for approximated kNN-Joins working well on high-dimensional data and provide an integration into PostgreSQL. The novel index structure is efficient for different cardinalities of the involved join partners. An evaluation of the system based on applications on word embeddings shows the benefits of such an integrated kNN-Join operation and the performance of the proposed approach.
Details
| Original language | English |
|---|---|
| Title of host publication | Datenbanksysteme fur Business, Technologie und Web, BTW 2019 and 18. Fachtagung des GI-Fachbereichs "Datenbanken und Informationssysteme", DBIS 2019 |
| Editors | Torsten Grust, Felix Naumann, Alexander Bohm, Wolfgang Lehner, Theo Harder, Erhard Rahm, Andreas Heuer, Meike Klettke, Holger Meyer |
| Publisher | Gesellschaft fur Informatik (GI) |
| Pages | 225-244 |
| Number of pages | 20 |
| ISBN (electronic) | 9783885796831 |
| Publication status | Published - 2019 |
| Peer-reviewed | Yes |
Publication series
| Series | GI-Edition : lecture notes in informatics. Proceedings |
|---|---|
| Volume | P-289 |
| ISSN | 1617-5468 |
Symposium
| Title | 18th Conference on Database Systems for Business, Technology and Web |
|---|---|
| Abbreviated title | BTW 2019 |
| Conference number | 18 |
| Duration | 4 - 8 March 2019 |
| Website | |
| Location | Universität Rostock |
| City | Rostock |
| Country | Germany |
External IDs
| Scopus | 85072108736 |
|---|---|
| ORCID | /0000-0001-8107-2775/work/142253468 |
Keywords
ASJC Scopus subject areas
Keywords
- Approximated nearest neighbor search, Product quantization, RDBMS, Word embeddings