https://zaidishahbaz.com/blog Software Engineer sharing tech essays, travel stories, book notes, and paper annotations. en-us shahbazzaidi15@gmail.com (Shahbaz Zaidi) shahbazzaidi15@gmail.com (Shahbaz Zaidi) Mon, 20 May 2024 00:00:00 GMT https://zaidishahbaz.com/blog/discord-message-storage https://zaidishahbaz.com/blog/discord-message-storage Notes on Discord's migration from Cassandra to ScyllaDB and their data modeling strategy for handling trillions of messages with strict latency requirements. Mon, 20 May 2024 00:00:00 GMT shahbazzaidi15@gmail.com (Shahbaz Zaidi) discorddatabasescassandrascylladbdistributed-systems https://zaidishahbaz.com/blog/meta-cache-invalidation https://zaidishahbaz.com/blog/meta-cache-invalidation Notes on how Meta solved the cache invalidation problem at scale using a system called Polaris that guarantees cache consistency without sacrificing performance. Wed, 08 Nov 2023 00:00:00 GMT shahbazzaidi15@gmail.com (Shahbaz Zaidi) cachingdistributed-systemsmetaconsistency https://zaidishahbaz.com/blog/kafka-trillion-messages-cloudflare https://zaidishahbaz.com/blog/kafka-trillion-messages-cloudflare Notes on how Cloudflare scaled Kafka to handle over 1 trillion messages daily across their analytics and logging infrastructure. Fri, 15 Sep 2023 00:00:00 GMT shahbazzaidi15@gmail.com (Shahbaz Zaidi) kafkacloudflaredistributed-systemsmessaging https://zaidishahbaz.com/blog/maglev-software-load-balancer https://zaidishahbaz.com/blog/maglev-software-load-balancer Notes on Google's software load balancer that handles traffic for Search, YouTube, and other services using consistent hashing with minimal disruption. Sat, 22 Jul 2023 00:00:00 GMT shahbazzaidi15@gmail.com (Shahbaz Zaidi) distributed-systemsgooglenetworkingload-balancing https://zaidishahbaz.com/blog/mapreduce-simplified-data-processing https://zaidishahbaz.com/blog/mapreduce-simplified-data-processing Notes on Google's seminal 2004 paper that introduced a programming model for processing massive datasets across thousands of commodity machines. Sat, 10 Jun 2023 00:00:00 GMT shahbazzaidi15@gmail.com (Shahbaz Zaidi) distributed-systemsgooglebig-dataparallel-computing