Skip to main content
José David Baena

Redpanda 26.1 Architecture and Operations

An eight-part source-guided study of Redpanda 26.1.13: Kafka compatibility, Raft durability, storage, remote data, transforms, RPC, cluster control, and benchmark design.

Episodes

  • Published on

    Redpanda Architecture: Kafka Outside, Shards Inside

    redpandakafkaarchitectureseastardistributed-systems
    Redpanda presents Kafka APIs outside while sharded C++, per-partition Raft, and raft0 define the implementation and operational boundaries inside.
  • Published on

    Redpanda Raft: From Acknowledgement to Durable Media

    redpandaraftconsensusreplicationdistributed-systems
    Redpanda maps Kafka acknowledgements onto Raft while replication, commit, visibility, and durable-media flush remain separate guarantees.
  • Published on

    Redpanda Storage: Logs, Offsets, Recovery, Compaction

    redpandastoragelog-structured-storagekafkadistributed-systems
    Redpanda stores Raft metadata and Kafka-visible records in segmented logs while indexes, offset translation, and recovery preserve the client view.
  • Published on

    Redpanda Tiered Storage: Local Writes, Remote Reads

    redpandatiered-storagekafkaobject-storageretention
    Redpanda Tiered Storage uploads stable local segments asynchronously, serves old offsets through a disk cache, and separates local from remote retention.
  • Published on

    Redpanda Data Transforms: Boundaries of In-Broker Wasm

    redpandawasmtransformsstreamingdata-processing
    Redpanda Data Transforms run core-local Wasm after input commit, with at-least-once delivery, bounded resources, and deliberate limits on state and I/O.
  • Published on

    Redpanda Internal RPC: Versioned Bytes Between Brokers

    redpandaserializationrpcnetworkingc++
    Redpanda's internal Serde and RPC protocols version broker messages, bound parsing, share buffer fragments selectively, and apply backpressure before writes.
  • Published on

    Redpanda Cluster Control: raft0, Moves, and Limits

    redpandacluster-managementcontrollerraftdistributed-systems
    Redpanda's raft0 controller orders cluster metadata; broker lifecycle, balancing, feature gates, and partition limits define its operational envelope.