06 / The reading shelf

Back to the source.

Papers and documentation behind the systems questions on this site, with reading notes and links to related experiments.

This is a reading queue, not a list of completed research. Statuses show what is still to read.

AI Infrastructure

Efficient Memory Management for Large Language Model Serving with PagedAttention

Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, Ion Stoica

To read KV cacheMemory managementPaged allocation

Suggested reading. Questions to investigate: which allocation costs are removed by paging, and which runtime costs remain? Contrast physical block sharing with the visualizer's independent-sequence assumption.

Distributed Systems

Dynamo: Amazon's Highly Available Key-Value Store

Giuseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swami Sivasubramanian, Peter Vosshall, Werner Vogels

To read Consistent hashingReplicationQuorumsVersioning

Suggested reading. Separate the placement, replication, version reconciliation, and failure detection mechanisms. The site's single-writer simulator does not reproduce Dynamo's full consistency model.

Search the notebook

Search articles, projects, and experiments. Everything stays on your device.

palash / notebook

A small doorway into the site. No shell, no remote execution.

Welcome. Type help to find your way around.

lab →experience →contact →Ctrl / Cmd + K