Looks like the entire app has blown up, including your own ticket tracker…

I get the ninja error message on every single page I try to access on all the accounts I have access to.

We’re having the same problem here. Consider this my ticket.

Can we get a status update?

Sorry about that. Had a small deployment issue this morning and didn’t notice it until I checked my email while getting lunch. We should be all good to go now.

Our svn repo blew up over the weekend, so I had to rebuild my local working directory. Of course, I forgot to save my capistrano deploy.rb file, so I recreated it with the wrong rails revision.

Update: Still had some issues. This time it didn’t properly reset all of the mongrels on both slices.

Cheers Rick – we were starting to panic for a minute there :)

That sucks. I’m trying to work out a way so you guys (or better yet, some script that notices lots of errors in a short time) can ping me directly. I just feel weird about putting my cell # on here for calls/SMSs though. I’ll have to figure something out though. I only caught this when I did because I was playing with my iphone while waiting in line to grab lunch.

How about setting up nagios to monitor a couple key parts of the site? You can set up a script that logs in to your account, and maybe posts a ticket at a test account. If the script fails, you can have nagios complain to you via SMS or phone or IM or whatever.