LJ Owwwies? 0,o;

[Old Storm SilverWolf]

Anybody else get this error message page?
Our data center (Internap) lost all its power, including redundant backup power, for some unknown reason. (unknown to me, at least) We're currently dealing with bringing our 100+ servers back online. Not fun. We're not happy about this. Sorry... More details later.
Like whoa... That's gotta smart but good! I do Not envy the eye strain of the coding there.

[Lumi]

For abit there I was just getting an error message. Now I'm getting that one. o.o;; Yikes, no wonder it wouldn't work.

[sera]

yepp, got it too.

blegh for having to bring the servers back up. . . ^^; that's never fun. but, if they have some good routers and switches and someone who knows perl it doesn't have to be that bad. . . . well, depending on their configuration. . . *realizes she's network rambling and trails off. . . . inches beneath the green chair*

[Lumi]

*stares at Sera* You know about Networking? XD *facepalm* I don't even know what you know! *hides under the chair too* Oh hello how are you? *giggle*

[AirRaiser]

Update #1, 7:35 pm PST: we're up on 'dirty' power for now (it works, but it's unreliable), and we're working to assess the state of the databases. The worst thing we could do right now is rush the site up in an unreliable state. We're checking all the hardware and data, making sure everything's consistent. Where it's not, we'll be restoring from recent backups and replaying all the changes since that time, to get to the current point in time, but in good shape. We'll be providing more technical details later, for those curious, on the power failure (when we learn more), the database details, and the recovery process. For now, please be patient. We'll be working all weekend on this if we have to.

[Lumi]

Oh God all weekend?!!! *DIES* But BUt BUTY!!! *hugs her ljs* I need my ljs noow. ;.;

[Dyani]

Arrrrgh. I don't think I can survive without LJ! *twitch* *twitch*
...
.....
...
*twitch*

[Lumi]

*clings to Dyani* Don't you die on me now!! We'll get through this together. Somehow....*twitchy* hold onto me. ...don't crush my arm though. o.x




((XD;;; yes I'm feeling rather random tonight. ))

[Dyani]

*weeps on teh Lumi's shoulder*

*attempts to click "update" on a scrap of paper*

[Lumi]

*patpatpatsnugs* *shoulder gets very wet*

*feeling weak* been...away...from...lj...too long..already...*gasping*

[Old Storm SilverWolf]

0,O
*is suddenly very nervous* I uh didn't mean to panic anybod... Uhm want some munchies while you're there?
*gets on her hands and knees with a huge plate-full of choco-chip cookies and whatnots for those having a nice get-together under the chair* They're fresh from the toaster oven! Nice and warm and gooey! ^___^

[Pega]

*sneaks up and snatches a cookie*

Yeee!! ^_^ Cookiesnatcher! *points at self*

XD

[Lumi]

((*smiles slightly at Storm* Thats alright we would of panic anyways. This way more fun. XD;; ))

*we're all under the chair* XD

*takes a moment from her gasping to take a yummy cookie!* MmmMMf!!

[Thalron]

Cookies! *steals some and hides in the corner munching them*

[sera]

^^; lol The longest job I've held was for 3 years as an Asst. Network Admin for a college. My first 'real' job was running cable for a network. It's one of my big things that I really hope I can get back into soon. ^^

*glances around* it's getting kindof crowded under here. . . lol *steals a cookie and munches*

Edit ::

Update #2, 10:11 pm: So far so good. Things are checking out, but we're being paranoid. A few annoying issues, but nothing that's not fixable. We're going to be buying a bunch of rack-mount UPS units on Monday so this doesn't happen again. In the past we've always trusted Internap's insanely redundant power and UPS systems, but now that this has happened to us twice, we realize the first time wasn't a total freak coincidence. C'est la vie.