1. Server 101 receives a request to create a new thread with ID 1101 and writes it to its own store. It then chooses Server 201 at random to backup the data. 2. Server 201 later fails. When Server 101 receives a request for thread 1201 that is backed up on 201, it cannot fulfill the request. 3. Server 101 identifies Server 301 has the backup for 201's data and retrieves thread 1201 from 301 to fulfill the read request. Server 101 now uses 301 as the backup for 201's data until 201 recovers.

1. 1: Server 101 receives a “Create Thread” write requestCServer 101RwServer 301Server 201

2. 2: Server 101 assigns it threadID of 1101 and writes it to its store1101CServer 101Server 301Server 201

3. 3: Server 101 chooses a backup server (least loaded or random if equal load) and requests a backup write1101CServer 101Rb: 1101Server 301Server 201

4. 4: Server 201 writes the data to its store as a backup1101CServer 101Server 301Server 2011101

5. 5: Server 201 receives a “Create Thread” write request, writes it to store, sends a backup request to next highest ID, who in turn writes it to store (ie, process repeated)1101CServer 101RwServer 301Server 201120111011201Rb: 1201

6. 6: Server 101 recieves a read request for Thread 1101. Data is fetched from it’s own store, and returned.1101CServer 101Server 301Server 201120111011201

7. 7: Server 101 recieves a read request for Thread 1201. Request is forwarded to Server 201, data is returned and passed back on to client1101CServer 101Server 301Server 201120111011201

8. 8: Server 201 dies.1101CServer 101Server 301Server 201120111011201

9. 9: Server 101 receives a read request for 1201. It attempts to retrieve the data from Server 201, but gets nowhere as Server 201 is down.1101CServer 101Rw2101Server 301Server 201120111011201

10. 10: Server 101 sends a request to other known servers for Server 201’s backup. It gets the data from there, and until 201 reinstates, it uses the new server as a 201 source.1101CServer 101Rw2101Server 301Server 201120111011201

11. 11: Server 101 receives a write request. It writes it to its own store (as 2101) and attempts to send a backup request to Server 201.11012101CServer 101RwRb: 2101Server 301Server 201120111011201

12. 12: Server 101 chooses a second backup server (least loaded), and backup request like usual. Thread is written in new server, like before.11012101CServer 101RwRb: 2101Server 301Server 2011201210111011201

13. 12: Server 201 recovers. Server 101 notices, and requests that Server 301 (temporary backup) move its backup back to Server 201.11012101CServer 101RmServer 301Server 2011201110112012101