Abstract
Imagine handling collisions in a hash table by storing, in each cell, the bit-wise exclusive-or of the set of keys hashing there. This appears to be a terrible idea: For an keys and n buckets, where α is constant, we expect that a constant fraction of the keys will be unrecoverable due to collisions.
We show that if this collision resolution strategy is repeated three times independently the situation reverses: If α is below a threshold of ≈ 0.81 then we can recover the set of all inserted keys in linear time with high probability.
Even though the description of our data structure is simple, its analysis is nontrivial. Our approach can be seen as a variant of the Invertible Bloom Filter (IBF) of Eppstein and Goodrich. While IBFs involve an explicit checksum per bucket to decide whether the bucket stores a single key, we exploit the idea of quotienting, namely that some bits of the key are implicit in the location where it is stored. We let those serve as an implicit checksum. These bits are not quite enough to ensure that no errors occur and the main technical challenge is to show that decoding can recover from these errors.
We show that if this collision resolution strategy is repeated three times independently the situation reverses: If α is below a threshold of ≈ 0.81 then we can recover the set of all inserted keys in linear time with high probability.
Even though the description of our data structure is simple, its analysis is nontrivial. Our approach can be seen as a variant of the Invertible Bloom Filter (IBF) of Eppstein and Goodrich. While IBFs involve an explicit checksum per bucket to decide whether the bucket stores a single key, we exploit the idea of quotienting, namely that some bits of the key are implicit in the location where it is stored. We let those serve as an implicit checksum. These bits are not quite enough to ensure that no errors occur and the main technical challenge is to show that decoding can recover from these errors.
Originalsprog | Engelsk |
---|---|
Titel | Proceedings, 2023 Symposium on Simplicity in Algorithms (SOSA) |
Redaktører | Telikepalli Kavitha, Kurt Mehlhorn |
Forlag | Society for Industrial and Applied Mathematics |
Publikationsdato | 2023 |
Sider | 228-241 |
ISBN (Elektronisk) | 978-1-61197-758-5 |
DOI | |
Status | Udgivet - 2023 |
Begivenhed | 2023 Symposium on Simplicity in Algorithms (SOSA) - Florence, Italien Varighed: 23 jan. 2023 → 25 jan. 2023 |
Konference
Konference | 2023 Symposium on Simplicity in Algorithms (SOSA) |
---|---|
Land/Område | Italien |
By | Florence |
Periode | 23/01/2023 → 25/01/2023 |