Arpit Bhayani
Projects
Blogs
Notes
Videos
Papershelf
Bookshelf
Courses
Talks
Home
Topics
System Design
#system-design
(118)
12 blogs
•
92 notes
•
14 videos
All
118
Distributed Systems
66
Career Growth
32
Systems Internals
7
Algorithms & Data Structures
5
Databases
3
AI Systems
2
Leadership
1
Software Engineering Practices
1
Api Design
1
2026
(9)
Sep 01
VIDEO
Consistent Hashing: Demystifying the Algorithm and Its Simple Implementation
Distributed Systems
#consistent-hashing
#distributed-systems
#system-design
Aug 30
VIDEO
Bitcask Explained: A Log-Structured, Fast Key-Value Store
Databases
#bitcask
#key-value-store
#embedded-database
Jun 18
NOTE
Design Document Gaps Foster Engineer Decision-Making and Issue Discovery
Leadership
#leadership
#design-docs
#engineer-empowerment
Jun 07
VIDEO
Implementing Redis-Style Transactions in a Custom Database (DiceDB)
Databases
#redis
#transactions
#database-internals
May 20
BLOG
Temporal Primer - Building Long-Running Systems
Distributed Systems
#distributed-systems
#ai-agents
#career-growth
May 09
VIDEO
Implementing Command Pipelining in Redis: A Deep Dive into Internals
Systems Internals
#redis
#pipelining
#network-optimization
Mar 19
VIDEO
Low-Level Design and Data Schema Modeling of API Clients like Requestly
Systems Internals
#api-client
#requestly
#low-level-design
Mar 09
NOTE
Clarity is the difference between a good design doc
Career Growth
#career-growth
#clear-communication
#communication
Mar 08
BLOG
Databases Were Not Designed For This
Distributed Systems
#distributed-systems
#ai-agents
#caching
2025
(13)
Nov 26
BLOG
The Q, K, V Matrices
AI Systems
#ai-systems
#llms
#system-design
Nov 22
BLOG
How LLM Inference Works
AI Systems
#ai-systems
#llm-inference
#llms
Sep 24
BLOG
Why gRPC Uses HTTP2
Systems Internals
#systems-internals
#networking
#system-design
Sep 18
NOTE
Growth Isn't About Doing Everything
Career Growth
#career-growth
#leadership
#system-design
Sep 03
BLOG
Why Eventual Consistency is Preferred in Distributed Systems
Distributed Systems
#distributed-systems
#consistency
#networking
Aug 02
VIDEO
How PayPal's Braintree Solved the Thundering Herd Problem and Simplified Architecture
Distributed Systems
#thundering-herd
#distributed-systems
#microservices
Jul 11
VIDEO
Inside Stripe's Multi-Tier Rate Limiter Architecture
Distributed Systems
#rate-limiting
#distributed-systems
#system-design
Jun 27
NOTE
Writing a Design Document Improves Project Ideas
Career Growth
#career-growth
#design-document
#project-idea
Feb 09
VIDEO
How Atlassian Reduced Latency by 70% Using the Sidecar Pattern
Distributed Systems
#sidecar-pattern
#distributed-systems
#microservices
Jan 31
NOTE
Should you learn sharding and partitioning if we already have
Distributed Systems
#system-design
Jan 25
NOTE
YAGNI is my favorite principle when I build and implement any system
Distributed Systems
#system-design
Jan 19
VIDEO
Trello's Migration from RabbitMQ to Kafka for Real-time WebSocket Updates
Distributed Systems
#trello
#rabbitmq
#kafka
Jan 05
VIDEO
Load Balancers Are Not Magic: Dissecting the Atlassian Outage
Distributed Systems
#load-balancer
#atlassian-outage
#aws-elb
2024
(41)
Dec 25
NOTE
Bayes' Theorem, the thing we learned in our statistics class
Distributed Systems
#system-design
#ads-engineering
Dec 17
NOTE
60% of the tables I have recently designed, do not
Distributed Systems
#databases
#system-design
Dec 06
NOTE
PostgreSQL is a fascinating database and if you want to
Distributed Systems
#system-design
#databases
Nov 03
NOTE
Today, I spent some time digging deeper into K-D trees
Algorithms & Data Structures
#system-design
#database-internals
Oct 26
NOTE
While exploring deadlock management in databases, I stumbled upon an
Career Growth
#database-internals
#system-design
Oct 13
NOTE
The root cause of performance issues is almost always a
Distributed Systems
#system-design
Sep 28
VIDEO
Amazon DynamoDB - Paper Explained: Deep Dive into its Architecture and Design Principles
Databases
#dynamodb
#distributed-databases
#nosql
Sep 13
NOTE
While I was trying to figure out which paper to
Distributed Systems
#system-design
Sep 11
NOTE
I extensively used Elasticsearch for 2 years straight while I
Distributed Systems
#system-design
#elastic-search-internals
Sep 03
NOTE
You must the isolation level of your database, as picking
Distributed Systems
#databases
#system-design
Sep 02
NOTE
It is not space vs time, but space vs time vs correctness
Algorithms & Data Structures
#redis
#system-design
Aug 29
NOTE
Most early engineers (in some cases even seniors) get confused
Distributed Systems
#system-design
Aug 23
NOTE
Database guarantees durability using WAL, and it is possible due
Distributed Systems
#database-engineering
#system-design
Aug 21
BLOG
Paper Notes - WTF - The Who to Follow Service at Twitter
Distributed Systems
#distributed-systems
#algorithms
#memory-management
Aug 15
VIDEO
A Bug in GitHub's Redis-Based Rate Limiter: The Wobbling X-RateLimit-Reset Header
Distributed Systems
#rate-limiting
#redis
#distributed-systems
Aug 11
VIDEO
Software Rewrites vs. Reuse: Navigating the Build vs. Buy Dilemma
Software Engineering Practices
#software-development
#code-rewrite
#code-reuse
Aug 08
NOTE
PostgreSQL crumbles even when a moderate number of clients connect to it
Distributed Systems
#database-internals
#system-design
Aug 04
VIDEO
Postel's Law: Principles for Robust API Design
Api Design
#api-design
#postels-law
#robustness
Jul 24
NOTE
Should two microservices services share a database
Distributed Systems
#system-design
Jul 19
NOTE
ULIDs are great, but are they the ultimate ID generation solution
Career Growth
#system-design
Jul 17
NOTE
I spent some time this afternoon going through Buffer Cache
Distributed Systems
#postgre-sqlinternals
#system-design
Jun 18
NOTE
One of the most amusing features of PostgreSQL is Tablespaces,
Distributed Systems
#system-design
#database-internals
#postgre-sqlinternals
Jun 13
NOTE
One really interesting blog I read today was about how
Career Growth
#system-design
#recommendation-system
Jun 12
NOTE
While exploring PostgreSQL internals, I stumbled upon an interesting internal
Algorithms & Data Structures
#database-internals
#system-design
Jun 05
NOTE
Today, I was going through PostgreSQL internals and found something
Distributed Systems
#database-internals
#system-design
May 22
NOTE
Zero-copy writes make Kafka fast, but how exactly
Distributed Systems
#system-design
May 04
NOTE
One of the most interesting projects that I did in
Career Growth
#system-design
May 01
NOTE
Once I was reviewing a code and I found that
Career Growth
#system-design
Apr 11
NOTE
It is not worth optimizing your code further ⚡
Career Growth
#system-design
#optimization
Apr 08
NOTE
Do not keep looking for beginner-friendly content ⚡
Career Growth
#career-growth
#asli-engineering
#system-design
Mar 25
NOTE
You can understand Bloom Filters through a 5-minute video but
Algorithms & Data Structures
#bloom-filters
#system-design
Mar 07
NOTE
Hot shards are a pain, but why do they occur
Distributed Systems
#system-design
Mar 06
NOTE
Whenever you are shipping any service, make it highly observable ⚡
Distributed Systems
#system-design
Mar 03
NOTE
Interfaces in Go are costly
Career Growth
#system-design
#database-internals
Feb 29
NOTE
Frontend is the worst place to hardcode the errors ⚡
Career Growth
#system-design
Feb 18
NOTE
Spent Sunday afternoon prototyping probabilistic counting ⚡
Career Growth
#system-design
#algorithms
Jan 21
NOTE
Google created the Snappy Compression Algorithm that trades off better
Systems Internals
#system-design
Jan 20
NOTE
Why do most Bloom Filters use MurmurHash over SHA or MD5
Algorithms & Data Structures
#bloom-filters
#system-design
Jan 11
NOTE
Some internal tools at cloud companies like AWS, GCP, and
Career Growth
#system-design
Jan 10
NOTE
System Design in the real world always revolves around cost 💰
Distributed Systems
#system-design
Jan 06
NOTE
Projects are the best way to learn a programming language,
Distributed Systems
#go
#system-design
2023
(31)
Dec 23
NOTE
We can optimize for anything, and the context determines what we choose to optimize ⚡
Career Growth
#career-growth
#asli-engineering
#system-design
Dec 20
NOTE
The coolest thing about Google's Spanner Database is its clock
Career Growth
#system-design
#distributed-systems
Dec 18
NOTE
One paper that sparked my interest in the big data
Career Growth
#system-design
Dec 08
NOTE
Pre-signed URLs are great, but should we add an extra
Career Growth
#system-design
Dec 01
NOTE
Before you ship your next big feature, just put it
Career Growth
#system-design
Nov 25
NOTE
Here's an interesting question asked on Partitioning and Sharding ⚡
Distributed Systems
#system-design
Nov 02
NOTE
Why designing highly available services important
Distributed Systems
#system-design
Oct 24
NOTE
Netflix gave up on strict data consistency and guarantees to
Career Growth
#system-design
Oct 14
NOTE
During my live cohort, we were discussing BLOB vs TEXT,
Distributed Systems
#system-design
#my-sql
Oct 04
NOTE
Just built a SQL connection pool in Go from scratch ⚡
Career Growth
#system-design
Sep 21
NOTE
Changing something in staging can take down production ⚡
Distributed Systems
#microservices
#system-design
Aug 25
NOTE
Common misconception - CDNs can *only* cache images and videos ⚡
Career Growth
#system-design
Aug 14
NOTE
System Design is not about drawing boxes, you need to
Distributed Systems
#system-design
Jul 30
NOTE
ACID and CAP theorem, both have C standing for "Consistency",
Distributed Systems
#system-design
Jul 18
NOTE
Something that always gets us confused
Career Growth
#system-design
#python
Jun 27
NOTE
Dropbox migrated systems that handle tens of millions of open
Career Growth
#system-design
Jun 22
NOTE
How important is a rate limiter for a system like S3
Career Growth
#system-design
Jun 10
NOTE
3 videos that cover everything about sharding, partitioning, and their
Distributed Systems
#system-design
Jun 06
NOTE
How do the updates happening on the master reach the replica
Distributed Systems
#database-engineering
#system-design
May 14
NOTE
A lot of engineers believe RPC is the same as gRPC 🤦♂️
Career Growth
#system-design
May 04
NOTE
Amazon's Prime Video cut 90% of its cloud costs by
Distributed Systems
#system-design
May 01
NOTE
CockroachDB is fascinating
Distributed Systems
#system-design
#cockroach-db
Apr 22
NOTE
Writes in CockroachDB are fascinating as it directly guarantees a
Distributed Systems
#system-design
#database-internals
Apr 18
NOTE
CockroachDB Internals ] CockroachDB is distributed SQL database that replicates
Distributed Systems
#system-design
#database-internals
Apr 17
NOTE
Consistent Hashing is not some magical solution that fits everywhere
Distributed Systems
#consistent-hashing
#system-design
Apr 12
NOTE
CockroachDB Internals ] Data Structures and Algorithms are crucial in
Distributed Systems
#system-design
#database-internals
Apr 06
NOTE
CockroachDB Internals ] Let's talk about OLTP and OLAP databases
Distributed Systems
#system-design
Apr 01
NOTE
I was always fascinated by virtual memory management, hence decided
Systems Internals
#memory-management
#system-design
Mar 30
NOTE
Spent yesterday evening reading about and implementing Snappy Compression Algorithm
Systems Internals
#system-design
Mar 12
NOTE
How databases are upgraded in production
Distributed Systems
#system-design
#databases
Feb 21
NOTE
3 in-depth videos that cover everything about Sharding along with
Distributed Systems
#system-design
2022
(14)
Dec 25
NOTE
Here's how you design a good distributed system 👇
Distributed Systems
#system-design
#distributed-system
Dec 11
NOTE
Here is a 4-step process I follow to learn new technologies, tools, and frameworks ⚡
Career Growth
#distributed-systems
#engineering
#system-design
Nov 28
NOTE
Reading books is extremely important for Software Engineers.
Career Growth
#career-growth
#asli-engineering
#system-design
Nov 18
NOTE
Why did the college want us to study Compiler Construction?
Systems Internals
#distributed-systems
#asli-engineering
#dice-db
Oct 15
NOTE
CDN is much more than a cache for images and videos
Distributed Systems
#system-design
#cdn
Oct 11
NOTE
How do I learn new technologies, tools, and frameworks?
Career Growth
#career-growth
#engineering
#system-design
Sep 14
NOTE
How databases are upgraded in production
Distributed Systems
#system-design
#database
May 07
NOTE
How much DSA does a senior engineer use?
Career Growth
#career-growth
#system-design
#engineering
Feb 07
NOTE
Essay : Indexing on a Partitioned Data
Distributed Systems
#system-design
#distributed-systems
Jan 31
BLOG
Partitioning Data - Range, Hash, and When to Use Them
Distributed Systems
#distributed-systems
#databases
#hashing
Jan 31
NOTE
Essay : Data Partitioning Strategies
Distributed Systems
#distributed-systems
#system-design
Jan 25
NOTE
Essay : An Introduction to Data Partitioning
Distributed Systems
#distributed-systems
#system-design
Jan 17
NOTE
Essay : Leaderless Replication to have Strong Consistency in Distributed Database
Distributed Systems
#distributed-systems
#system-design
Jan 09
NOTE
Essay : Conflict Resolution in Multi-Master setup
Career Growth
#distributed-systems
#system-design
2021
(10)
Oct 03
NOTE
Essay : Preventing Wormholes in a Distributed Datastore
Distributed Systems
#system-design
#distributed-systems
Sep 22
NOTE
How would you feel when you posted on a Social
Distributed Systems
#system-design
#distributed-systems
Sep 07
BLOG
What Happens When a Master or Replica Fails
Distributed Systems
#distributed-systems
#databases
#replication
Sep 07
NOTE
Essay : Everything you need to know about handling node
Career Growth
#system-design
#distributed-systems
Aug 23
NOTE
Recently I wrote a short snippet about setting up a
Distributed Systems
#system-design
#distributed-systems
Aug 21
NOTE
Ever wondered how the Replication happens, how a new Replica
Distributed Systems
#system-design
#distributed-systems
Aug 15
BLOG
Replication Formats - Statement vs Row-based
Distributed Systems
#distributed-systems
#databases
#networking
Aug 15
NOTE
Ever wonder how replication happens between Master and Replica
Distributed Systems
#system-design
#distributed-systems
Aug 07
BLOG
Master-Replica Replication
Distributed Systems
#distributed-systems
#databases
#replication
Jun 22
BLOG
Architectural Patterns for Distributed Systems
Distributed Systems
#distributed-systems
#databases
#system-design