We launched the second version of Photoblog today, and things went smoothly for half a day. People were posting frequently, and everything looked fine. Then, I checked the page one time and noticed that everyone's photographs weren't showing up. We looked and saw that everything was deleted...

Turns out a bug in our new code went through our whole server and deleted the photographs. We fixed the code and restored the photographs with our backup. However, our most recent backup was from about seven days ago. This meant that we pretty much permanently lost seven days of photographs for our members. With over three hundred entries a day of up to twenty photographs, we might have lost around 30,000 - 40,000. I was pretty stressed out most of the day, especially after discovered that Mac users also weren't able to upload.

To make matters worse, I have a research paper due for computer science tomorrow, and I don't have any written yet. Things weren't going too well today but, all we can do is...

trust and obey.