Data service diaries

In the weeds of building and running full-network atproto data services for microcosm! less-niche microcosm posts at https://updates.microcosm.blue/

STAR: a special-length prefix?

what if: [ len key len val ] - [ len len key val ]

Oct 29

Becoming a varint hater (who's compliment? zigzag??)

what if STAR used signed varints for length prefixes, so that -1 could be an end-of-archive signal?

Oct 29

Should STAR detect early truncation?

Weird varints? Control bytes?? And we are not too preoccupied to stop and ask whether or not we should.

Oct 28

STAR: settling the details

On the path to stabilizing STreaming ARchives

Oct 27

Auto repair

Progress on moving the Atmosphere toward actually verifying Content Addressable aRchive contents

Sep 29
War on CARs: the rest of it cover

War on CARs: the rest of it

Part 2: streaming struggles, bad blocks, worthless weight, and superfluous structure in Content Addressable aRchives

Sep 23
War on CARs cover

War on CARs

A widespread authenticity problem in the Authenticated Transfer Protocol, from real-world use of Content-Addressible aRchives

Sep 16
atproto

Never miss a post

Get new writing sent to your inbox.

Subscribe