Arpit Bhayani

BM25

Wed, 04 Mar 2026 00:00:00 GMT

There is a particular kind of respect reserved in engineering for the algorithm that outlives its era. BM25 is one of them. BM25 was born out of information retrieval research in the 1970s and 1980s, polished over decades, and eventually adopted as the default ranking function in Elasticsearch, Solr, and Lucene.

JOIN Algorithms

Tue, 24 Feb 2026 00:00:00 GMT

When you write a SQL query with a JOIN clause, you probably do not think much about what happens next. You just expect the database to return the right rows. But this simple keyword forces your database to make one of the most consequential decisions a query planner makes: which join algorithm should it use?

Venting at Work Comes at a Reputation Cost

Mon, 09 Feb 2026 00:00:00 GMT

We all vent at work. That is normal. Tough sprints, messy decisions, frustrating meetings - it happens, and letting off steam is okay and, in fact, healthy.

Why Half Your Skills Expire Every Few Years

Sun, 08 Feb 2026 00:00:00 GMT

That is the half-life of knowledge in computer science and software engineering - the time it takes for half of what you know to be replaced by better tools, approaches, or understanding. For an engineering degree earned in 1930, the half-life was roughly 35 years. By 1960, it had dropped to about a decade.

Multi-Paxos - Consensus in Distributed Databases

Tue, 27 Jan 2026 00:00:00 GMT

Distributed databases face an interesting challenge: how do you ensure that multiple servers scattered across different machines, data centers, or even continents agree on the order and outcome of database transactions? This is where consensus algorithms come into play.

MySQL Replication Internals

Fri, 16 Jan 2026 00:00:00 GMT

MySQL replication enables data synchronization across databases, powering read scaling and even some complex distributed architectures. At the core lies the binary log (binlog), which is the authoritative record of all data modifications on a source server.

Bloom Filters

Mon, 29 Dec 2025 00:00:00 GMT

A Bloom filter is a probabilistic data structure that answers a very specific question - have I seen this thing before? - while using almost no memory.

Clock Synchronization Is a Nightmare

Tue, 23 Dec 2025 00:00:00 GMT

Time seems simple. But we engineers lose sleep over something as basic as keeping clocks in sync. Here’s why…

When You Increase Kafka Partitions

Sat, 13 Dec 2025 00:00:00 GMT

Partitions sit right in the middle of how Kafka works. They define ordering, parallelism, and how far it can scale. But what actually happens when you need more of them? How does Kafka grow that number, what happens to the data you already have, and which guarantees stay intact after the change?

Product Quantization

Sun, 07 Dec 2025 00:00:00 GMT

Recommendation engines, image retrieval platforms, document matching services, and RAG pipelines all rely on finding the nearest neighbors to a given query vector in high-dimensional space. This is where vector similarity search comes in.

The Q, K, V Matrices

Wed, 26 Nov 2025 00:00:00 GMT

At the core of the attention mechanism in LLMs are three matrices: Query, Key, and Value. These matrices are how transformers actually pay attention to different parts of the input. In this write-up, we will go through the construction of these matrices from the ground up.

The Day I Accidentally Deleted Production

Mon, 24 Nov 2025 00:00:00 GMT

Back in 2015-16, I once accidentally deleted the "entire production" at Practo. Slight exaggeration, but here's what happened...

How LLM Inference Works

Sat, 22 Nov 2025 00:00:00 GMT

When you enter a prompt into an LLM, the model converts your text into numbers, processes them, and returns a response one token at a time. In this article, we go through the journey of LLM inference and see how it works.

What are Blocking Queues and Why We Need Them

Fri, 14 Nov 2025 00:00:00 GMT

Concurrent programming is one of the most interesting and challenging aspects of software engineering. When multiple goroutines need to share data, coordinating access becomes critical.

Heartbeats in Distributed Systems

Wed, 12 Nov 2025 00:00:00 GMT

In distributed systems, one of the fundamental challenges is knowing whether a node or service is alive and functioning properly. Unlike monolithic applications, where everything runs in a single process, distributed systems span multiple machines, networks, and data centers. This becomes even glaring when the nodes are geographically separated. This is where heartbeat mechanisms come into play.

How Writes Work in Apache Cassandra

Mon, 20 Oct 2025 00:00:00 GMT

Apache Cassandra is a distributed database designed for high availability and horizontal scalability. This write-up explores the complete write path in Cassandra, from the moment a client sends a write request to how data gets replicated across nodes in the cluster.

Redis Replication Internals

Fri, 17 Oct 2025 00:00:00 GMT

One of the most fundamental design decisions in Redis replication is that it's push-based rather than pull-based. This means the master (or primary) actively sends data to replicas, rather than replicas polling the master for updates.

How to Handle Arrogant Colleagues at Work

Sun, 05 Oct 2025 00:00:00 GMT

We've all dealt with that colleague who dominates the room, dismisses ideas, and acts like the smartest person there. That's arrogance, but it doesn't have to ruin your day...

How Does a CDN Handle Content Replication

Thu, 02 Oct 2025 00:00:00 GMT

Content Delivery Networks (CDNs) content replication is far more nuanced than most engineers realize. Let's dive deep into how CDNs actually replicate, distribute, and manage content across their global networks.

You Can't Fix Everything on Day One

Mon, 29 Sep 2025 00:00:00 GMT

You will notice processes, tools, or practices that feel inefficient, outdated, or even wrong. Maybe the team uses Jira instead of Linear, Java instead of Go, MongoDB instead of MySQL (for a use case), or Tabs instead of Spaces. It will be tempting to point it all out immediately. Resist that urge.

When Emotions Spill Over at Work

Thu, 25 Sep 2025 00:00:00 GMT

Emotional outbursts are natural. I've been there too, and I've seen teams struggle because of it. We all have moments when the pressure gets too much, and emotions spill out.

Why gRPC Uses HTTP2

Wed, 24 Sep 2025 00:00:00 GMT

When Google introduced gRPC in 2015, one of the most significant architectural decisions was building it on top of HTTP/2 rather than the widely adopted HTTP/1.1. This was just about following some trend, but a deliberate choice that fundamentally shapes how gRPC performs and behaves.

Meetings With No Agenda Are a Waste of Time

Mon, 22 Sep 2025 00:00:00 GMT

We've all been in meetings where no one really knows why they're there or what's about to happen. Always attach an agenda doc or at least a clear description when you schedule a meeting.

Growth Isn't About Doing Everything

Thu, 18 Sep 2025 00:00:00 GMT

I follow a simple flow of questions that helps me stay focused, improve consistently, and make incremental impact at workplace. I'm never running around like a headless chicken. Here are the questions I ask myself, and answer honestly, like really true to its core

Career Longevity Beats Constant Job Hopping

Sat, 13 Sep 2025 00:00:00 GMT

Frequent job switches can be great for short-term financial gains. I believed that early in my career as well, but here’s what I’ve learnt over the years.

Stay Relevant at Higher Salary Levels

Mon, 08 Sep 2025 00:00:00 GMT

Yes, higher compensation means you won't have as many options to choose from, but fewer does not mean none. As long as you can demonstrate measurable impact, there will always be opportunities at every compensation level.

Why Distributed Systems Need Consensus Algorithms Like Raft

Sat, 06 Sep 2025 00:00:00 GMT

Everything we interact with today is a "distributed system". From microservices to cloud-native applications, from databases to message queues. We are constantly building systems that span multiple machines. But there comes a fundamental challenge - how do we ensure that all independent nodes agree on shared state?

Why Do Databases Deadlock and How Do They Resolve It

Fri, 05 Sep 2025 00:00:00 GMT

Database deadlocks are one of the most challenging concurrency issues encountered in production systems. Understanding why they occur and how databases handle them is important in building robust applications.

Why and How Cache Locality Can Make Your Code Faster

Thu, 04 Sep 2025 00:00:00 GMT

While we write code thinking about algorithms and data structures, the CPU is quietly making millions of decisions about what data to keep close and what to evict from its precious cache memory.

Why Eventual Consistency is Preferred in Distributed Systems

Wed, 03 Sep 2025 00:00:00 GMT

While strong consistency might seem like the obvious choice - given it keeps the data perfectly synchronized at all times - the reality is that eventual consistency has become the preferred approach for most large-scale distributed systems. But why so...

Why does DNS use both UDP and TCP

Tue, 02 Sep 2025 00:00:00 GMT

DNS is one of the most critical pieces of internet infrastructure, quietly translating human-readable domain names into IP addresses billions of times per day.

Should You Do a Master's My Honest Take

Mon, 01 Sep 2025 00:00:00 GMT

If you're aiming for research, go for a top school and squeeze every drop of value. If you want to switch domains or countries but can't break in otherwise (via job switches), a master's can help bridge that gap. But, doing it just because it feels like the “next step” is usually not worth it.

Empathy Makes Great Engineers Unstoppable

Tue, 29 Jul 2025 00:00:00 GMT

Remember, your job is to solve a problem, not just write code. You are not a code monkey who just hammers the keyboard. You are on a journey to build something that millions use, and for that, you have to

Good Mentors Build People, Not Just Skills

Mon, 21 Jul 2025 00:00:00 GMT

Mentoring someone is one of the most satisfying ways to share what you've learned and see someone grow because of it, but doing it well is what makes the difference.

Why You Should Always Have Back-Burner Projects

Mon, 14 Jul 2025 00:00:00 GMT

If you have more than 5 years of experience, always keep a few small projects ready on the back burner. These are ideas you can pick up and run with at any time.

Before You Push Back, Know What You're Standing On

Mon, 30 Jun 2025 00:00:00 GMT

When participating in conversations, meetings, or discussions, we're often very confident in what we're saying and the points we're putting forward. But pause for a moment and ask yourself - do you truly know, or are you assuming, vaguely remembering, or guessing with confidence?

Be the One They Can Count On

Mon, 23 Jun 2025 00:00:00 GMT

Dependable always beats the brilliant; if people can't count on you, nothing else matters.

How Much Are People Willing to Bet on You

Mon, 16 Jun 2025 00:00:00 GMT

If you are known for owning outcomes and driving results, leadership will trust you with higher-stakes work because the most important projects go to those who get things done.

How to Get Leadership to Say Yes to Your Project

Tue, 10 Jun 2025 00:00:00 GMT

A few years back, I proposed a "brilliant" idea to my leadership, and it got rejected. That day, I learnt what turns an idea into a funded project.

Don't Let Your Best Ideas Die in Silence

Mon, 02 Jun 2025 00:00:00 GMT

Say you have an idea, something that could change your company's or product's trajectory and fast-track your career growth. What do you do?

Be the Person Everyone Wants to Work With

Mon, 26 May 2025 00:00:00 GMT

Beyond a point, your reputation determines how high you will go in the career ladder. And it takes months, sometimes years, to build one that truly matters.

The XY Problem and How to Avoid It

Thu, 22 May 2025 00:00:00 GMT

We often focus on the wrong problem when asking for help. Instead of describing what we actually want to achieve, we end up asking about a side issue, i.e., instead of asking about X, we end up asking about Y. Let me explain...

The Startup Hiring Lie Nobody Talks About

Mon, 19 May 2025 00:00:00 GMT

The biggest lie startups tell during hiring is - We have a lot of problems, and you can pick whatever you want to solve.

You Won't Be Promoted Unless You Ask

Fri, 16 May 2025 00:00:00 GMT

Chasing promotions is important, but it shouldn't consume all your energy. Even if it's your main focus, that's okay. Just make sure you're also growing, doing work you're proud of, and finding peace in what you do.

It's Not Enough to be Right; Learn to be Heard

Mon, 12 May 2025 00:00:00 GMT

Once you're in the system and thinking deeply, you'll start to notice inefficiencies and gaps. You might see decisions being made that feel wrong. But instead of putting your point across bluntly, it's important to raise it thoughtfully.

Book Notes - What is Existentialism

Sat, 10 May 2025 00:00:00 GMT

It's a collection of essays or short philosophical reflections on various existential themes like devotion, action, and more.

Book Notes - White Nights

Wed, 23 Apr 2025 00:00:00 GMT

It's the story of a lonely man who meets a young woman, and through this encounter, we explore the emotional landscape of

No One Ships Great Software Alone

Wed, 23 Apr 2025 00:00:00 GMT

The best engineers ask for help early and often. We all have blind spots - technical, architectural, and just plain human.

You Don't Win by Proving Others Wrong

Mon, 14 Apr 2025 00:00:00 GMT

Don't be a nitpicker! Learn when to let small mistakes slide and build a positive team culture. Kindness drives progress, not constant correction.

Appreciate Generously; It Costs Nothing, But Builds Everything

Wed, 09 Apr 2025 00:00:00 GMT

If there's one underrated superpower at work, it's giving credit - generously, and often. When your teammate goes out of their way to help, contributes meaningfully, or quietly ships something excellent, take a moment to recognize it, publicly.

Your Soft Skills Aren't Soft at All

Mon, 24 Mar 2025 00:00:00 GMT

Of course, soft skills matter, but which ones? In my opinion, every engineer should be better at these two: active listening and clear communication.

Before you form an opinion, experience it

Fri, 21 Mar 2025 00:00:00 GMT

Don't just listen, experience! Form opinions based on firsthand understanding. Real impact in work and life demands seeing the full picture.

Why You Need Both Curiosity and Action to Thrive

Tue, 18 Mar 2025 00:00:00 GMT

Unlock your potential! Learn how curiosity and action combine to drive impact, avoid stagnation, and achieve real results in your career.

A Daily Worklog Changed Everything

Mon, 10 Mar 2025 00:00:00 GMT

A worklog is just a set of things you did grouped by the day. I have been doing this for the last 12 years, and it has been extremely helpful.

How We Handle Mistakes Defines Us

Thu, 06 Mar 2025 00:00:00 GMT

Instead of sweeping failures under the rug, own them. When we try to hide our mistakes, we miss out on growth opportunities. Owning up to what went wrong is the first step toward becoming a better engineer.

Own Your Mistakes

Thu, 06 Mar 2025 00:00:00 GMT

Learn to own your failures as an engineer. Reflect, take responsibility, and grow from mistakes to build a stronger career.

Don't Wait. Step Up.

Tue, 04 Mar 2025 00:00:00 GMT

We all encounter issues and blockers, and it's inevitable, but how well we respond to them says a lot about our effectiveness and efficiency. So, when you face a problem

Temporary Fixes Are Permanent

Tue, 25 Feb 2025 00:00:00 GMT

Temporary fixes can become permanent problems. Invest in quality code now to save yourself (or others) headaches later. Ship it right!

Why Interviews Are Biased And What Sets You Apart

Tue, 18 Feb 2025 00:00:00 GMT

Interviews are unfair and will remain so, no matter how hard we try they can never evaluate people 100% objectively with clear measurables; and the intuition and gut feel of the interviewer will always add a small bias.

Saying 'This isn't my problem' is actually the problem

Tue, 11 Feb 2025 00:00:00 GMT

You must show a high bias for action at work, take ownership, and make an impact. Here are some actions that you can apply right away at work to earn some brownie points

How to Write Effective OKRs

Fri, 07 Feb 2025 00:00:00 GMT

Craft effective engineering OKRs with this practical guide. Learn best practices, avoid common pitfalls, and drive team alignment.

Never Lose a Battle due to Miscommunication

Tue, 04 Feb 2025 00:00:00 GMT

At your workplace, keep people informed. Driving a project or working on an individual item, you should always keep the people informed about - progress, clarity, and timeline.

When In Doubt, Code It Out

Wed, 29 Jan 2025 00:00:00 GMT

Prototypes are not only great for learning concepts better, but they are also great for doing highly reliable project estimations. Here's how ...

How to Follow Up Without Annoying People

Mon, 13 Jan 2025 00:00:00 GMT

Working with people is hard, but making them prioritize your work is even harder. Hence, one of the key skills you have to build is getting things done by others.

Lead Projects That Land, Execution Over Everything

Tue, 07 Jan 2025 00:00:00 GMT

If you are leading a project, your only responsibility is to ensure it is delivered, whatever it takes. Here are a few pointers that I have followed

Abstract Thinking Will Define Your Next Decade

Thu, 12 Dec 2024 00:00:00 GMT

Stop searching for beginner-friendly content, because for hard topics, it doesn't exist.

We Engineers Suck at Task Estimation

Wed, 11 Dec 2024 00:00:00 GMT

We engineers are terrible at estimating timelines. Here's a neat trick

Shiny Obect Syndrome in Tech

Tue, 10 Dec 2024 00:00:00 GMT

With the tech moving and evolving so fast, every few years, evaluate the work you are doing vs what the world is doing. Do not let the gap widen.

When to Change Jobs - The 3P Framework

Sat, 19 Oct 2024 00:00:00 GMT

Is it time for a career change? Use the 3P formula (Paisa, Power, Position) to evaluate your job and unlock your career growth potential.

Comfort and Competition - Know When to Switch Gears

Wed, 02 Oct 2024 00:00:00 GMT

Discover the power of balanced leadership - blending comfort and competition to drive team success and avoid burnout.

Paper Notes - On-demand Container Loading in AWS Lambda

Sun, 15 Sep 2024 00:00:00 GMT

Explore AWS Lambda's efficient scaling - block-level loading, deduplication with encryption, & erasure coding for low-latency container startups.

Paper Notes - SQL Has Problems. We Can Fix Them Pipe Syntax In SQL

Tue, 03 Sep 2024 00:00:00 GMT

Explore GoogleSQL's new pipe syntax for SQL - Improves readability, extensibility, and debugging with operators like ASSERT and LOG.

Paper Notes - NanoLog - A Nanosecond Scale Logging System

Wed, 28 Aug 2024 00:00:00 GMT

Explore NanoLog's high-performance logging - compile-time optimization, lock-free buffers, and lightweight encoding for nanosecond speed.

Don't Wait, Learn - The Best Resource is Mythical

Mon, 26 Aug 2024 00:00:00 GMT

Stop searching for the perfect resource! Focus on consistent learning, critical thinking, and adapting to new information for continuous growth.

Paper Notes - WTF - The Who to Follow Service at Twitter

Wed, 21 Aug 2024 00:00:00 GMT

Explore Twitter's recommendation system - in-memory graph processing with Cassovary, random walks, and SALSA for user suggestions.

The Unexpected Benefit of Reading Random Engineering Articles

Tue, 13 Aug 2024 00:00:00 GMT

Learn how a broad knowledge base, built through consistent learning, can make you a better engineer. Discover the power of cross-pollination and continuous growth!

Roadmaps Are Limiting Your Growth

Mon, 12 Aug 2024 00:00:00 GMT

Don't let roadmaps limit your growth! Explore beyond the plan to deepen your understanding, boost adaptability, and truly excel as an engineer.

Stop Leaving Money on the Table - Negotiate Your Job Offer

Tue, 06 Aug 2024 00:00:00 GMT

Negotiate your job offer like a pro! Learn key strategies, including leveraging your current salary and competing offers, for career and financial growth.

Never Bad-Mouth Your Past Employers

Wed, 31 Jul 2024 00:00:00 GMT

Don't bad-mouth ex-employers in job interviews! Learn why it hurts your chances and how to discuss past roles professionally and positively.

Show You're a Culture Fit

Mon, 29 Jul 2024 00:00:00 GMT

Ace your tech interview! Learn how to demonstrate culture fit alongside your skills to land your dream engineering role.

Quantify your resume, Know Your Numbers

Tue, 23 Jul 2024 00:00:00 GMT

Stand out with your resume! Learn how to quantify your engineering achievements and showcase your impact with simple, effective templates.

The Importance of Being Likeable in Interviews

Mon, 15 Jul 2024 00:00:00 GMT

Job hunting? Discover tips to make a great impression in interviews and improve your chances of landing the role, even if it's a close call.

Questions to Ask Your Interviewer

Mon, 08 Jul 2024 00:00:00 GMT

Ace your interview! Discover 7 smart questions to ask the interviewer & gain valuable insights into the company culture and role.

How to Build Trust Through Collaboration

Mon, 01 Jul 2024 00:00:00 GMT

Build trust & collaborate effectively! 3 simple rules I used leading engineering teams to foster ownership, execution & better teamwork.

Do This, Once You Are Out of the Interview Cycle

Thu, 20 Jun 2024 00:00:00 GMT

Break free from the interview cycle! Explore your engineering passions & boost your skills. Find fulfillment and unlock new opportunities.

Stop Pitching Ideas, Start Pitching Projects

Mon, 17 Jun 2024 00:00:00 GMT

Stop pitching ideas, start pitching projects! Learn how to get your engineering proposals approved by focusing on execution and planning.

Read Those Design Docs, Even the Ones That Seem Irrelevant

Mon, 10 Jun 2024 00:00:00 GMT

Learn how reading design documents can make you a better engineer. Discover the benefits and practical insights hidden within your company's internal documentation.

The Best Engineering Lessons Happen During Outages

Wed, 29 May 2024 00:00:00 GMT

Embrace on-call & RCAs! Level up your engineering skills by learning from production outages & real-world system failures. YouTube playlist included!

Great Engineers Start Broad

Mon, 27 May 2024 00:00:00 GMT

Become a generalist engineer early in your career to build a strong foundation, then specialize later for expertise and impact. Learn how!

LLM Summaries are Ruining Your Learning

Tue, 21 May 2024 00:00:00 GMT

LLMs summarize well, but summaries hinder deep learning. For engineers, relying solely on them creates a surface-level understanding.

Turn System Design Interviews into Discussions

Mon, 06 May 2024 00:00:00 GMT

Ace your system design interview! Learn a structured 5-step approach to tackle open-ended questions and showcase your engineering skills.

Title Inflation

Wed, 27 Mar 2024 00:00:00 GMT

Don't let inflated titles fool you! Focus on building real skills & impact for lasting career growth in software engineering.

At Work, Find Your Own Projects

Mon, 11 Mar 2024 00:00:00 GMT

Level up your engineering career! Learn how to generate innovative project ideas and become a proactive problem-solver.

6 Simple Strategies to Cracking Any Tech Interview

Mon, 15 Jan 2024 00:00:00 GMT

Ace your next tech interview! Learn 6 key strategies - clear communication, smart solutions, and asking the right questions.

How to Remain Unblocked

Thu, 16 Nov 2023 00:00:00 GMT

Stuck as a software engineer? Learn practical strategies to get unblocked, improve problem-solving, and boost your productivity.

Solving the Knapsack Problem with Evolutionary Algorithms

Mon, 07 Mar 2022 00:00:00 GMT

Solve the Knapsack problem with a Genetic Algorithm! This guide offers a polynomial-time approximation for this famous optimization challenge.

Generating Pseudorandom Numbers with LFSR

Mon, 21 Feb 2022 00:00:00 GMT

Explore LFSRs, a simple & efficient pseudorandom number generator widely used in microcontrollers. Learn how they work with code examples.

Local vs Global Indexes in Partitioned Databases

Mon, 07 Feb 2022 00:00:00 GMT

Explore indexing strategies for partitioned databases, focusing on local and global secondary indexes. Optimize query performance on non-partitioned attributes.

Partitioning Data - Range, Hash, and When to Use Them

Mon, 31 Jan 2022 00:00:00 GMT

Partitioning - Learn how to scale your database reads and writes by horizontally partitioning your data. Explore range-based vs hash-based approaches.

Partitioning Strategies for Distributed Databases

Mon, 24 Jan 2022 00:00:00 GMT

Learn database partitioning! Scale reads/writes & improve availability by splitting your database. Explore horizontal/vertical strategies.

Leaderless Replication

Sun, 16 Jan 2022 00:00:00 GMT

Explore leaderless replication - a fault-tolerant, strongly consistent data replication strategy. Learn how it works and its benefits.

Multi-Master Conflicts - How to Handle Them

Mon, 03 Jan 2022 00:00:00 GMT

Explore conflict resolution strategies in multi-master databases. Learn to handle conflicts with unique IDs, database precedence, & custom logic.

Multi-Master Replication - Why Conflicts Happen

Sun, 28 Nov 2021 00:00:00 GMT

Understand conflicts in multi-master databases - Learn how to detect and resolve data inconsistencies for reliable systems.

Multi-Master Replication - Scaling Writes Across Geographies

Wed, 03 Nov 2021 00:00:00 GMT

Explore Multi-Master replication - its benefits like load sharing and high availability, use cases, and key challenges to consider.

Monotonic Reads - How Asynchronous Replication Creates Wormholes

Sun, 03 Oct 2021 00:00:00 GMT

Explore how asynchronous database replication creates "wormholes" in data consistency and how to fix it with monotonic reads.

Read-Your-Writes Consistency

Wed, 22 Sep 2021 00:00:00 GMT

Explore read-your-writes consistency in distributed systems. Learn how to solve replication lag with strategies like synchronous replication.

What Happens When a Master or Replica Fails

Tue, 07 Sep 2021 00:00:00 GMT

Explore Master-Replica architecture - handling node outages, replica recovery, and master failover strategies for robust systems.

Replication Formats - Statement vs Row-based

Sun, 15 Aug 2021 00:00:00 GMT

Explore Master-Replica replication - Understand statement-based vs. row-based formats, advantages, and disadvantages for distributed systems.

Replication Strategies - Synchronous, Asynchronous, and Semi-Synchronous

Tue, 10 Aug 2021 00:00:00 GMT

Explore synchronous, asynchronous, and semi-synchronous data replication strategies in distributed systems. Understand their trade-offs and implications.

Master-Replica Replication

Sat, 07 Aug 2021 00:00:00 GMT

Explore the Master-Replica architecture - how it scales reads, handles writes, and recovers from failures. Examples included!

Decoding Durability - The D in ACID

Mon, 19 Jul 2021 00:00:00 GMT

Explore database durability, the "D" in ACID. Learn how databases ensure data survives failures & the role of transaction logs.

Decoding Isolation - The I in ACID

Wed, 07 Jul 2021 00:00:00 GMT

Dive into database isolation! Understand its importance in maintaining data integrity during concurrent transactions with real-world examples.

Decoding Atomicity - The A in ACID

Fri, 02 Jul 2021 00:00:00 GMT

Understand Atomicity (the "A" in ACID) in databases, file systems, and hardware. Learn how it ensures data integrity and prevents partial updates.

Decoding Consistency - The C in ACID

Fri, 02 Jul 2021 00:00:00 GMT

Understand database consistency (the "C" in ACID) and its importance. Learn how databases maintain data correctness through rules and constraints.

Architectural Patterns for Distributed Systems

Tue, 22 Jun 2021 00:00:00 GMT

Explore common architectures in distributed systems, including client-server, 3-tier, n-tier, and peer-to-peer. Understand their characteristics and when to use each one for optimal system design.

Fallacies of Distributed Computing Every Engineer Should Know

Thu, 17 Jun 2021 00:00:00 GMT

Learn about the 8 common fallacies of distributed computing that can lead to critical system design flaws. Understand the realities of network reliability, latency, bandwidth, security, topology, administration, transport costs, and network homogeneity for building robust and scalable distributed systems.

Fork Bomb

Wed, 09 Jun 2021 00:00:00 GMT

Online Coding Platforms and Code Evaluators are susceptible to this attack as they accept raw code from the user and execute it. So, if you are building one, do ensure you are protected against it and infinite loops.

Python Internals - Exploring Chained Comparison Operators

Wed, 28 Apr 2021 00:00:00 GMT

Explore Python's chained comparisons (like a < b < c) and short-circuiting. Learn how they work under the hood and how to modify CPython!

Modeling Udemy's Categories in a Relational Database

Mon, 19 Apr 2021 00:00:00 GMT

Model Udemy's taxonomy on a relational database. Learn efficient SQL queries, indexing, and design for optimal performance.

I Changed the Rules for the Python's Walrus Operator

Thu, 01 Apr 2021 00:00:00 GMT

Explore Python's walrus operator ( -=) and its quirks! Learn why `a -= 10` throws an error and how to modify CPython to allow it.

Fully Persistent Arrays

Mon, 15 Feb 2021 00:00:00 GMT

Explore Fully Persistent Arrays - Understand how to implement arrays that preserve all previous versions, enabling auditing and historical access.

How Persistent Data Structures Work

Sun, 07 Feb 2021 00:00:00 GMT

Explore persistent data structures - access historical versions, understand partial, full, and confluent persistence, and see real-world applications.

Constant Folding in Python

Sun, 10 Jan 2021 00:00:00 GMT

Explore Python's constant folding - how it optimizes code by evaluating expressions at compile time. Dive into CPython's elegant implementation.

How Python Uses String Interning to Keep Runtime Efficient

Sun, 20 Dec 2020 00:00:00 GMT

Explore Python's string interning - a compiler optimization for performance. Learn how CPython uses it to boost speed and reduce memory use.

Visualizing Recursion in Python with Just a Decorator

Sun, 13 Dec 2020 00:00:00 GMT

Visualize recursion in Python! Learn to build a simple recursion tree visualizer using decorators and the recviz package.

Count Distinct With Minimal Memory - Flajolet Martin Algorithm

Sun, 06 Dec 2020 00:00:00 GMT

Approximate count-distinct in streams using the Flajolet-Martin algorithm. Dive into its intuition, implementation, and applications.

The 2Q Algorithm - Addressing LRU's Sub-Optimality

Sun, 29 Nov 2020 00:00:00 GMT

Explore the 2Q cache eviction algorithm, an improvement over LRU, used in databases like Postgres. Learn how it optimizes performance!

Israeli Queues

Sun, 22 Nov 2020 00:00:00 GMT

Explore Israeli Queues, a unique priority queue variation where elements join friends already waiting! Learn how they optimize batch processing.

1D Terrain Generation

Mon, 16 Nov 2020 00:00:00 GMT

Explore procedural 1D terrain generation for games using Python. Learn techniques like interpolation and superposition for realistic landscapes.

MinHash - Fast Jaccard Similarity at Scale

Sun, 08 Nov 2020 00:00:00 GMT

Learn Jaccard Similarity and MinHash, a technique to efficiently estimate set similarity at scale for tasks like near-duplicate detection.

Time Series Smoothing for Anomaly Detection

Sun, 01 Nov 2020 00:00:00 GMT

Learn how to optimally smooth time series data using kurtosis to highlight anomalies. Prioritize user attention with this smoothing technique.

Implementing LFU in O(1)

Sun, 23 Aug 2020 00:00:00 GMT

Explore constant time LFU cache implementation using hash tables and doubly-linked lists. Learn how to achieve O(1) complexity!

Space-Efficient Counting - Exploring Morris' Algorithm

Sun, 02 Aug 2020 00:00:00 GMT

Learn about the Morris Algorithm, a probabilistic method for counting large events with minimal memory. Explore its math and implementation.

Why Slowsort is Hilariously Inefficient

Sun, 26 Jul 2020 00:00:00 GMT

Explore Slowsort, the deterministically worst sorting algorithm! Learn how it works and its "Multiply and Surrender" paradigm.

Bitcask - A Log-Structured fast KV store

Sun, 19 Jul 2020 00:00:00 GMT

Bitcask was introduced as the backend for a distributed database named Riak in which each node used to run one instance of Bitcask to hold the data that it was responsible for. In this essay, we take a detailed look into Bitcask, its design, and find the secret sauce that makes it so performant.

Phi Accrual Failure Detection Algorithm

Sun, 12 Jul 2020 00:00:00 GMT

Explore Phi Accrual Failure Detection, an adaptive algorithm for detecting failures in distributed systems. Learn how it improves on heartbeats!

10x Engineer DNA

Sun, 05 Jul 2020 00:00:00 GMT

Unlock 10x engineer potential - Simplify complex problems, own your work, and prioritize business impact. Learn key traits for career growth.

Breaking Repeating-Key XOR Encryption

Sun, 05 Jul 2020 00:00:00 GMT

Crack repeating-key XOR ciphers! Learn how to find the key length using Hamming distance and frequency analysis in this crypto challenge.

ETAOIN SHRDLU - Using Letter Frequency to Decipher the Ciphered

Sun, 21 Jun 2020 00:00:00 GMT

Crack single-byte XOR ciphers! Learn how to decipher encrypted messages without the key using frequency analysis and Python.

Making Integers Iterable in Python

Sun, 14 Jun 2020 00:00:00 GMT

Dive into Python internals - Modify CPython to make integers iterable! Explore iterators, protocols, and why it's a bad idea.

Structure Composition and Emulating Inheritance in C

Sun, 07 Jun 2020 00:00:00 GMT

Emulate inheritance in C using structure composition! Learn how it enables code extensibility, powering Linux Kernel & Python.

The RUM Conjecture - Storage System Trade-offs

Sun, 31 May 2020 00:00:00 GMT

Explore the RUM Conjecture - How Read, Update, and Memory overheads impact storage system design and performance trade-offs.

Consistent Hashing - What It Is and How to Implement It

Sun, 24 May 2020 00:00:00 GMT

Consistent hashing is a hashing technique that performs really well when operated in a dynamic environment where the distributed system scales up and scales down frequently.

How Python Handles Integers Under the Hood

Sun, 17 May 2020 00:00:00 GMT

Dive into Python's integer implementation! Explore how singletons and reference counting optimize performance for small integers.

Fractional Cascading - Speeding Up Multiple Binary Searches

Sun, 10 May 2020 00:00:00 GMT

Explore Binary Search variations k-searches, unified search & fractional cascading. Optimize search time in k sorted lists!

Copy-On-Write - When to Use It, When to Avoid It

Sun, 03 May 2020 00:00:00 GMT

Explore Copy-on-Write (CoW) - Boost performance, manage resources, and enable versioning. Learn how it works with examples and trade-offs.

How MySQL Avoids Performance Hits from Table Scans

Sun, 26 Apr 2020 00:00:00 GMT

Explore MySQL InnoDB's buffer pool and its midpoint insertion strategy for efficient cache management and scan resistance.

Modeling Finite State Machines with Python Coroutines

Sun, 19 Apr 2020 00:00:00 GMT

Explore Finite State Machines (FSM) with Python coroutines. Learn to model FSMs for regex, divisibility, & SQL validation.

Building Better Ratings with Bayesian Averages

Sun, 12 Apr 2020 00:00:00 GMT

Learn how to create a robust rating system using Bayesian Average to rank items effectively. Explore its advantages over arithmetic mean and cumulative ratings, and see how it can be applied using the MovieLens Dataset.

Sliding Window Rate Limiting - Design and Implementation

Sun, 05 Apr 2020 00:00:00 GMT

A rate limiter restricts the intended or unintended excessive usage of a system by regulating the number of requests made to/from it by discarding the surplus ones.

The Intuition Behind IDF

Tue, 10 Mar 2020 00:00:00 GMT

Explore Inverse Document Frequency (IDF), a key concept in search & text mining. Learn how it quantifies term rarity and its connection to probability.

Habits that Make a Great Programmer

Fri, 28 Feb 2020 00:00:00 GMT

8 rituals to level up your programming skills! Learn how to code better, think faster, and build complex systems with these actionable tips.

Python Prompt Strings

Fri, 21 Feb 2020 00:00:00 GMT

Customize your Python interactive shell prompt! Learn how to personalize and format your `>>>` and `...` prompts.

Rule 30 - Generating Random Numbers with Cellular Automata

Fri, 14 Feb 2020 00:00:00 GMT

Explore Rule 30, a cellular automaton, and its surprising application in pseudorandom number generation. Discover its chaotic patterns!

Python's Missing Feature - Function Overloading

Fri, 07 Feb 2020 00:00:00 GMT

Explore function overloading in Python! Learn how to implement it using decorators and namespaces, despite Python's limitations.

Isolation Forest - Fast and Efficient Anomaly Detection

Fri, 31 Jan 2020 00:00:00 GMT

Uncover anomalies with Isolation Forest, an unsupervised algorithm. Learn its core principles, tree construction, and scoring for anomaly detection.

Image Steganography

Fri, 17 Jan 2020 00:00:00 GMT

Explore image steganography - Hide secret messages within images! Learn techniques, from LSB substitution to JPEG methods.

How Python Handles Gigantic Integers

Fri, 10 Jan 2020 00:00:00 GMT

Explore Python's arbitrary-precision integers! Learn how it handles large numbers internally, from storage to operations like addition.

Python Internals - I Made Addition Unpredictable

Fri, 03 Jan 2020 00:00:00 GMT

Explore Python internals by tweaking its source code! Learn how I made addition unpredictable and the challenges I faced.

Analyzing MongoDB Pagination Performance Differences

Fri, 24 Mar 2017 00:00:00 GMT

Benchmark of MongoDB pagination strategies! See which method (_id vs skip/limit) performs best for large datasets. Find the code on GitHub.

MongoDB Pagination - Skip is Slow

Thu, 23 Mar 2017 00:00:00 GMT

Is MongoDB `skip` slow? Understand when & why `skip` impacts pagination performance. Learn efficient alternatives for large datasets.

MongoDB Pagination - Two Approaches You Need to Know

Wed, 22 Mar 2017 00:00:00 GMT

Learn how to efficiently paginate MongoDB data using `skip/limit` and `_id`-based methods. Improve performance for batch processing & UI display.

HTTP - The Hard Way with Netcat

Tue, 12 Apr 2016 00:00:00 GMT

Explore HTTP messages by building a simple Python webserver and interacting with it using Netcat. See requests in action!