01/15/05 02:08 - ID#31572
Livejournal is still down
Temporarily Unavailable
LiveJournal is currently down due to a massive power failure at our data center. We'll provide updates at /powerloss/ as they're available.
Our data center (Internap, the same one we've been at for many years) lost all its power, including redundant backup power, for some unknown reason. (unknown to us, at least) We're currently dealing with verifying the correct operation of our 100+ servers. Not fun. We're not happy about this. Sorry... :-/ More details later.
Update #1, 7:35 pm PST: we have power again, and we're working to assess the state of the databases. The worst thing we could do right now is rush the site up in an unreliable state. We're checking all the hardware and data, making sure everything's consistent. Where it's not, we'll be restoring from recent backups and replaying all the changes since that time, to get to the current point in time, but in good shape. We'll be providing more technical details later, for those curious, on the power failure (when we learn more), the database details, and the recovery process. For now, please be patient. We'll be working all weekend on this if we have to.
Update #2, 10:11 pm: So far so good. Things are checking out, but we're being paranoid. A few annoying issues, but nothing that's not fixable. We're going to be buying a bunch of rack-mount UPS units on Monday so this doesn't happen again. In the past we've always trusted Internap's insanely redundant power and UPS systems, but now that this has happened to us twice, we realize the first time wasn't a total freak coincidence. C'est la vie.
Update #3: 2:42 am: We're starting to get tired, but all the hard stuff is done at least. Unfortunately a couple machines had lying hardware that didn't commit to disk when asked, so InnoDB's durability wasn't so durable (though no fault of InnoDB). We restored those machines from a recent backup and are replaying the binlogs (database changes) from the point of backup to present. That will take a couple hours to run. We'll also be replacing that hardware very shortly, or at least seeing if we can find/fix the reason it misbehaved. The four of us have been at this almost 12 hours, so we're going to take a bit of a break while the binlogs replay... Again, our apologies for the downtime. This has definitely been an experience.
Update #4: 9:12 am: We're back at it. We'll have the site up soon in some sort of crippled state while the clusters with the oldest backups continue to catch up.
Permalink: Livejournal_is_still_down.html
Words: 448
Location: Buffalo, NY
01/15/05 02:00 - ID#31571
We finally met our neighbors
Believe it or not, they do not have the internet at their house. I can't even imagine what that is like. One of their friends had a celphone that can email pics. I told him about the site, so maybe we will see a new jorunal soon.
Permalink: We_finally_met_our_neighbors.html
Words: 114
Location: Buffalo, NY
01/15/05 03:41 - ID#31570
To all the people trying to contact me
Permalink: To_all_the_people_trying_to_contact_me.html
Words: 49
Location: Buffalo, NY
01/14/05 03:48 - ID#31569
I live at the asian 666
Permalink: I_live_at_the_asian_666.html
Words: 35
Location: Buffalo, NY
01/14/05 01:01 - ID#31568
Computer Painting
It is beyond fun, especially if you have access to a drawing tablet. A small one costs about $90 and you can get them at compusa or online. Wacom is a good brand but there are cheaper ones I think. The drawing tablet makes it more interesting because depending how hard you press the stroke of the brush is bigger or smaller. You can also erase with the eraser side of the pen.
Here are two example paintings I made but unfortunately, I only had a mouse that time, so the brush strokes are all the same width. It is still very fun, I would almost say therapeutic.
These ones are called Wheat One and Wheat Two and are inspired by wheat fields and basket weaving.
Permalink: Computer_Painting.html
Words: 213
Location: Buffalo, NY
01/14/05 01:40 - ID#31567
What a day
Permalink: What_a_day.html
Words: 24
Location: Buffalo, NY
01/13/05 10:40 - ID#31566
Image system
While searching for picture from Iraq on the net, I found this picture of "British Soldiers." I wonder who they are posing for?
Permalink: Image_system.html
Words: 101
Location: Buffalo, NY
01/13/05 03:27 - ID#31565
The coop is being deconstructed
I have to admit, I am not very educated on the matter since I stopped caring about the coop. I still shop there when it's convenient but I don't go out of my way like before. My feelings changed when we were asked to "vote" to give up our right to veto board decisions. At that point I felt less like an "owner" and more like a paid customer at Sam's Club.
The worst part is the "gas cut off" sprayed on the side of the building. I guess it signifies to the workers that building is ripe for deconstruction. The Atwater house next to pano's has the same spray paint now.
Permalink: The_coop_is_being_deconstructed.html
Words: 159
Location: Buffalo, NY
01/13/05 02:46 - ID#31564
It is unbelieveably warm
Permalink: It_is_unbelieveably_warm.html
Words: 6
Location: Buffalo, NY
01/12/05 04:32 - ID#31563
Old Media
Here are some sound files I found in the process. The first one was the first ringtone I made for my sidekick. I was such a pain to figure out the right kind of file format to make it work.
The other file was from a tour we made at the 567 on halloween. I am refering to (e:jill) here iin the bathtub.
I also found all of the old pictures that (e:jill) had drawn and lost. At least I think so. I will email them to you.
Permalink: Old_Media.html
Words: 133
Location: Buffalo, NY
Author Info
Date Cloud
- 03/24
- 11/23
- 02/23
- 01/23
- 12/22
- 01/22
- 12/21
- 11/21
- 12/20
- 11/20
- 01/19
- 12/18
- 08/18
- 04/18
- 03/18
- 02/17
- 01/17
- 12/16
- 11/16
- 09/16
- 08/16
- 07/16
- 06/16
- 05/16
- 04/16
- 03/16
- 02/16
- 01/16
- 12/15
- 11/15
- 10/15
- 09/15
- 08/15
- 07/15
- 06/15
- 05/15
- 04/15
- 03/15
- 02/15
- 01/15
- 12/14
- 11/14
- 10/14
- 09/14
- 08/14
- 07/14
- 06/14
- 05/14
- 04/14
- 03/14
- 02/14
- 01/14
- 12/13
- 11/13
- 10/13
- 09/13
- 08/13
- 07/13
- 06/13
- 05/13
- 04/13
- 03/13
- 02/13
- 01/13
- 12/12
- 11/12
- 10/12
- 09/12
- 08/12
- 07/12
- 06/12
- 05/12
- 04/12
- 03/12
- 02/12
- 01/12
- 12/11
- 11/11
- 10/11
- 09/11
- 08/11
- 07/11
- 06/11
- 05/11
- 04/11
- 03/11
- 02/11
- 01/11
- 12/10
- 11/10
- 10/10
- 09/10
- 08/10
- 07/10
- 06/10
- 05/10
- 04/10
- 03/10
- 02/10
- 01/10
- 12/09
- 11/09
- 10/09
- 09/09
- 08/09
- 07/09
- 06/09
- 05/09
- 04/09
- 03/09
- 02/09
- 01/09
- 12/08
- 11/08
- 10/08
- 09/08
- 08/08
- 07/08
- 06/08
- 05/08
- 04/08
- 03/08
- 02/08
- 01/08
- 12/07
- 11/07
- 10/07
- 09/07
- 08/07
- 07/07
- 06/07
- 05/07
- 04/07
- 03/07
- 02/07
- 01/07
- 12/06
- 11/06
- 10/06
- 09/06
- 08/06
- 07/06
- 06/06
- 05/06
- 04/06
- 03/06
- 02/06
- 01/06
- 12/05
- 11/05
- 10/05
- 09/05
- 08/05
- 07/05
- 06/05
- 05/05
- 04/05
- 03/05
- 02/05
- 01/05
- 12/04
- 11/04
- 10/04
- 09/04
- 08/04
- 07/04
- 06/04
- 05/04
- 04/04
- 03/04
- 02/04
- 01/04
- 12/03
- 11/03
- 10/03
- 09/03
- 08/03
- 07/03
Category Cloud
- 24 linwood
- animals
- art
- basra
- bathroom
- biking
- birthdays
- body
- botanical gardens
- brushwood
- buffalo
- camping
- cars
- clothes
- clothing
- computers
- dancing
- food
- furniture
- games
- haircut
- haircuts
- halloween
- hiking
- holidays
- house
- key west
- mobile
- music
- nature
- pets
- provincetown
- rochester
- swimming
- toronto
- toys
- travel
- vacation
- weather
- wedding
- weddings
- work
- accidents
- allentown
- android
- animals
- apple
- architecture
- art
- artvoice
- bars
- bathroom
- beach
- bikes
- biking
- birthdays
- body
- books
- brushwood
- buffalo
- buffalo rising
- bugs
- buildings
- camping
- cancer
- cars
- cats
- central terminal
- childhood
- church of the ascension
- clothes
- clothing
- computer
- computers
- conference
- crohns
- dance
- dancing
- dentist
- design
- downtown
- drugs
- electronics
- elmwood
- energy
- environment
- estrip
- events
- exercise
- family
- festivals
- firecracker
- food
- friends
- furniture
- gadgets
- games
- garden
- gay
- government
- gym
- hair
- haircut
- haircuts
- halloween
- hardware
- health
- hiking
- history
- holiday
- holidays
- house
- housing
- jewlery
- kenmore
- key west
- life
- linux
- linwood
- love
- marriage
- media
- mobile
- mobl
- movies
- music
- mustache
- nature
- nikon
- opinion
- orange tongue
- party
- peeptalk
- people
- pets
- photos
- poetry
- politics
- portland
- pride
- programming
- property
- protest
- random
- recycling
- religion
- rememberbuffalo
- renting
- school
- shoes
- shopping
- sports
- stress
- stuff
- swimming
- technology
- television
- thesis
- thursday
- thursdays
- toys
- transportation
- travel
- vacation
- vegas
- war
- water
- weather
- web
- wedding
- weddings
- weekend
- windows
- winter
- work
- world
- youtube
- zooey