Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement Private Information Retrieval for Key-Value Databases #2

Merged
merged 72 commits into from
Jan 25, 2025
Merged

Implement Private Information Retrieval for Key-Value Databases #2

merged 72 commits into from
Jan 25, 2025

Conversation

itzmeanjan
Copy link
Owner

Following https://ia.cr/2024/092 to implement ChalametPIR, a PIR scheme for key-value maps, using FrodoPIR ( https://ia.cr/2022/981 ) under the hood and Binary Fuse Filters ( https://arxiv.org/pdf/2201.01174 ).

  • Implementation added, supporting both {3,4} -wise XOR filters
  • Add tests ensuring functional correctness

@itzmeanjan
Implement Index and IndexMut traits so that we can use [] index ope…
42fc8b4 
…rator on Matrix struct

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Implement multiplication trait for Matrix struct
cca641d 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add function for generating an identity matrix
ae76e83 
It can be used for testing correctness of matrix multiplication implementation

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Implement partial equality trait for Matrix struct
f26a6ed 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Use overflowing multiplication in murmur3 hash function
479698c 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add test ensuring that matrix multiplication is implemented correctly
9dfeaa0 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Sample secret/ error vector from uniform ternary distribution
70466f1 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add serde and bincode as dependency for serializing/ deserializing a …
7dd6d2b 
…matrix struct

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Do not implement partial equality, rather derive its implementation
778309d 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Serialize and deserialize Matrix struct using bincode
006e8d3 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Use reference to matrix struct when serializing
84681a6 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Correctly handle number of elements not matching case when deserializ…
eced6e1 
…ing matrix

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add test ensuring that serialized matrix can be deserialized
63601de 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Explicitly mention that we want to use wrapping addition/ multiplicat…
9621ffd 
…ion operation

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Implement Add trait for Matrix struct
7ec45e6 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add server setup function
f8268cc 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
First parsed KV database to get column size of public matrix A
2de0540 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add server respond function
ee86620 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Implement matrix multiplication, which works with reference to operan…
848ff9a 
…d matrices

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Refactor the owned version of Matrix multiplication to use borrowed v…
c85f2c1 
…ersion under the hood

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Implement matrix addition s.t. operands are borrowed instances of Mat…
38da57a 
…rix struct

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Prefer using borrowed version of matrix multiplication in server comp…
05799b9 
…utation to avoid expensive cloning

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Rename filter_size with db_size
5462f7b 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Move common params to different module
5e85bee 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Implement client setup function
797a8d4 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Implement function to prepare query at client-side
81fa1bd 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Serialize and deserialize binary fuse filter
79ef9c9 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Update server struct, also return filter params as bytes during serve…
8e7689d 
…r setup phase

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Update client setup function to also accept filter parameters as bytes
7d53080 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Update prepare-query function to actually produce a query
88ab15f 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add function for recovering value KV database encoded using a 4-wise …
20d78ed 
…XOR filter

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Define public API for ease of encoding KV database using filter of di…
1bad05d 
…fferent arities and also recovering value

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Address bug in construction phase of 4-wise xor BFF
4b3622d 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Test functional correctness of encoding KV database as matrix and rec…
8f106f8 
…overing values from underlying Binary Fuse Filter

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Refactor test for PIR -based on 3-wise XOR filter
10c18a8 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add support for generating query when using arity 4 for underlying BFF
d6bbcd8 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Compiler hint for denoting whether branch is likely or not
02409f8 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add compiler hints, denoting which branches are more likely
e835871 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add branch optimization hints to server operations
36699c0 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Define new profiles for running tests and benchmarks
2b09452 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Run tests with test-release profile on CI
a95b8ff 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Remove fields from server struct, which are not required
b73fdbf 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add test ensuring functional correctness of keyword PIR, with 4-wise …
c2c155c 
…XOR filter

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Reduce number of entries in test PIR KV database
ca583c3 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Extract test for encoding KV database using 4-wise xor filter and rec…
bfd43eb 
…overing values

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Make client and server modules public
a950104 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add optimization hints to matrix funtions
3c0c5d6 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Move internal functions into new directory
be65730 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Utilize common function to generate random KV database with variable …
138a3f0 
…length (key, value) pairs

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add property based test for matrix addition implementation
c73306d 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Fix typo
1559157 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Prefer LTO "thin" instead of "fat", it is faster
48eedf1 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Use unsafe bounds unchecked method for accessing matrix elements
91e75e9 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Refactor hash batch function for 4-wise xor filter
11b118f 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Increase max number of matrix element bit length to 11, in serializat…
69721ab 
…ion tests

Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add function to compute "bits/entry" for Binary Fuse Filter
ce2f8fe 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Add tests validating "bits/entry" for both {3,4}-wise xor filters
d9e8b05 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan
Do not parallelize test run
54deb51 
Signed-off-by: Anjan Roy <[email protected]>
@itzmeanjan itzmeanjan merged commit 74d2242 into main Jan 25, 2025
2 checks passed
@itzmeanjan itzmeanjan deleted the implement-pir branch January 25, 2025 16:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@itzmeanjan