by John Lukach
I needed a way to automate the updating and distribution of the bloom filter used by the project. The first step was reducing the GitHub repository size using the BFG Repo-Cleaner to remove the bloom filters.
Next was shrinking the package size distributed by the Python Package Index (PyPI) using a content delivery network to host the bloom filters.
Finally, I removed the likelihood test for now from the bundle to keep the volume down, allowing the application to check if a new version is available automatically.
If you haven’t checked out the BLAKE3 cryptographic hash function, it is worth it for the performance improvements.
Once the Rust programming language is more readily available on the default Amazon Linux operating system installation, I will switch over as ready for the future.
If you want to try it out –> https://github.com/jblukach/mmitags: Amazon - AWS - Linux - Meta - SHA256