Fast Integer Compression using SIMD Instructions

Schlegel, B.; Gemulla, Rainer; Lehner, W.

doi:10.1145/1869389.1869394

Item

ITEM ACTIONSEXPORT

Add to Basket

Local TagsRelease HistoryDetailsSummary

Released

Conference Paper

Fast Integer Compression using SIMD Instructions

MPS-Authors

/persons/resource/persons44484

Gemulla, Rainer
Databases and Information Systems, MPI for Informatics, Max Planck Society;

External Resource

No external resources are shared

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

Fulltext (public)

There are no public fulltexts stored in PuRe

Supplementary Material (public)

There is no public supplementary material available

Citation

Schlegel, B., Gemulla, R., & Lehner, W. (2010). Fast Integer Compression using SIMD Instructions. In Proceedings of the Sixth International Workshop on Data Management on New Hardware (pp. 34-40). New York, NY: ACM. doi:10.1145/1869389.1869394.

Cite as: https://hdl.handle.net/11858/00-001M-0000-0019-B30F-D

Abstract

We study algorithms for efficient compression and decompression of a sequence of integers on modern hardware. Our focus is on universal codes in which the codeword length is a monotonically non-decreasing function of the uncompressed integer value; such codes are widely used for compressing ``small integers''. In contrast to traditional integer compression, our algorithms make use of the SIMD capabilities of modern processors by encoding multiple integer values at once. More specifically, we provide SIMD versions of both null suppression and Elias gamma encoding. Our experiments show that these versions provide a speedup from 1.5x up to 6.7x for decompression, while maintaining a similar compression performance.