Thomas Hawk's Digital Connection

Sunday, May 20, 2007

Sun Comes Up Over Silicon Valley

The Morning Skies of Silicon ValleyThe Morning Skies of Silicon Valley Hosted on Zooomr

Saturday 1:30 a.m. the phone rings in the middle of the night.

Kristopher: "Dude, Zooomr's down."

Me: "Huh, what time is it?"

Kristopher: "It's 1:30 a.m., Zooomr's down, we have to go down to the data center.

Me: "Ugh, dude I'm asleep. I just went to bed 30 minutes ago. I have to be up early this morning to head down to Photowalking with Scoble."

Kristopher: "Yeah man, I know, but Zooomr's down. We have to go down to the data center.

Me: "Ok, I'll be there in 20 minutes."

So I swing by SF, pick up Kristopher and we drive down to our data center at Savvis in Sunnyvale. Grumbling most of the way. Driving is tough.

"Just stay awake!" Kristopher reminds me as I drift out a few times on the way down.

We get to the data center, check in, and Kristopher gets to work.

"Crap," he says, it's worse than I thought. A drive's gone down. More hacking on the computer at the data center. A twitter here and there on my part (I'm pretty useless on these calls except as chaufer).

Finally we fix the problem. Take the bad drive offline. And wrap up at about 5am. As we head out we joke with the guy at the data center about these capsules that you go in and out of at Savvis. They are like something out of star trek. Little phone booth type doorways that seal you off as you go in and out of the data center. Once he said, three guys from Google got stuck in one of them. Another time he tells us that one guy freaked out who was claustrophobic and had a collapse in there. They had to call the paramedics to get him out.

He hands us our IDs back and we say bye. Good night he says. No, good morning, Kristopher laughs back. Ok, now, goodnight, he says back.

And then we get in the car. We drive past this big ass building with Yahoo on it and both laugh. Then Krisopher lays back in the seat to try to sleep while I've got Van Morrison blaring on the radio and I pull out my 5D and snap the photograph above.

My friend Dave Sifry says someday this will be one of those great stories that our employees will love hearing us tell. I sure hope he's right.

17 Comments:

Blogger Jeremy said...

Yeah, he's right. These are the things great products are made of. My last major product rollout had several late-night/early-morning downtime emergency events, and now we look back on them and laugh.

10:12 PM  
Anonymous Yuvi said...

He's right. Driving down to a datacenter in the middle of a night so that my friends can see my crudely photoshopped photos is, uhm, wonderful. Thanks!

3:43 AM  
Anonymous Maurice said...

Hmm if it been me i'd have been calling you from the cab on the way there.

Or was this a dual key setup to get in? the entry device is called a Mantrap BTW

I usued to do some silly hours running the billing for Telecom Gold (a pre internet email system)

sometimes 3-4 days with 4-5 hours of sleep at month end.

5:37 AM  
Anonymous Thejesh GN said...

I appreciate the effort to my our pics online

7:19 AM  
Blogger Jeremy said...

Driving Mr. Tate, huh?

8:01 AM  
Blogger Jim said...

Yes, believe it or not millions of people do stuff like this every single day. What's really interesting is how a single failed drive can take the site down. Wow. I'd like to hear more about that.

10:28 AM  
Anonymous Anonymous said...

Don't you have people for this kind of work? It doesn't make sense for the CEO and founder to be doing this work.

Also, why don't you get a data center closer? There are several in SF. We use 365 Main.

11:29 AM  
Anonymous Ben said...

Yeah, according to the Zooomr blog, it was several drives in the RAID array that went haywire, and not just a single drive.

12:11 PM  
Blogger Thomas Hawk said...

Ben, actually when the one drive kind of freaked out the controller shut down all of the drives on that server. So this server also houses Zooomr's system software. We had to use a backup of our system software, move it to another drive and then restart the system with all drives on that server working except the one that had failed. We will have to have that drive replaced with Dell.

12:38 PM  
Anonymous Ian said...

Great story Thomas! You guys certainly put a lot of love and care into Zooomr to bring us the best photo service. Then you do what sounds like an amazing Photowalk! Dedication indeed. Thank-you!

2:04 PM  
Anonymous Anonymous said...

Kristopher doesn't drive?

Multiple drives going bad in a RAID array is not nice (nor completely unknown to happen). Been there, done that.

How'd 3 google serfs get caught in a mantrap? Usually those things have weight sensors etc to make sure that only one person at a time (based on your historically measured weight and an allowance for varation based on turkey day, notebook bag, heavy coat etc) is going in/out and that you aren't significantly heavier on the way out (removing equipment via the trap is a no no).

2:18 PM  
Blogger lotro gold said...

lotro gold
lord of the rings gold
lord of the rings online gold
lotro gold
lord of the rings gold
lord of the rings online gold
Warhammer gold
Warhammer online gold
Warhammer money
War gold
War money
Tabula Rasa Credit
lotro gold
lord of the rings gold
lord of the rings online gold
lord of the rings online gold
lord of the rings gold
Tabula Rasa Credit
World of Warcraft gold
PotBS Doubloon
Pirates of the Burning Sea Doubloon
PotBS Gold
Pirates of the Burning Sea Gold
lotro gold
lord of the rings gold
lord of the rings online gold
Tabula Rasa Credit
Warhammer gold
Warhammer online gold
PotBS Doubloon
PotBS gold
Age of Conan gold
Age of Conan gold
Pirates of the Burning Sea gold
Pirates of the Burning Sea Doubloon

if

3:57 AM  
Anonymous Anonymous said...

翻译公司
深圳翻译
深圳翻译公司
英语翻译
日语翻译
法语翻译
德语翻译
俄语翻译
藏语翻译
韩语翻译
泰语翻译
越南语翻译
维族语翻译
瑞典语翻译
印尼语翻译
阿拉伯语翻译
马来西亚语翻译
菲律宾语翻译
意大利语翻译
希腊语翻译
柬埔寨翻译
土耳其语语翻译
西班牙语翻译
葡萄牙语翻译
能源翻译
乌克兰翻译

地质翻译
合同翻译
法律翻译
机械翻译
标书翻译
医学翻译
外贸翻译
食品翻译
保险翻译
化工翻译
农业翻译
汽车翻译
通信翻译
建筑翻译
物流翻译
工程翻译

广州翻译公司
深圳翻译
深圳翻译公司
英语翻译
日语翻译
法语翻译
德语翻译
俄语翻译
藏语翻译
韩语翻译
泰语翻译
越南语翻译
印度语翻译
瑞典语翻译
印尼语翻译
阿拉伯语翻译
马来西亚语翻译
菲律宾语翻译
意大利语翻译
爱尔兰语翻译
柬埔寨翻译
土耳其语语翻译
西班牙语翻译
葡萄牙语翻译
外语翻译
小语种翻译
广州深圳同声传译|
证件翻译
合同翻译
法律翻译
机械翻译
标书翻译
医学翻译
外贸翻译
食品翻译
技术翻译
化工翻译
农业翻译
汽车翻译
通信翻译
英译汉,汉译英
汉译日,日译汉
金融翻译
新疆租车

珠海翻译公司|
佛山翻译公司|
惠州翻译公司
汕头翻译公司
三亚翻译公司
东莞翻译公司
深圳无线导览|
口译|
翻译公司非常好
翻译公司|

12:33 AM  
Anonymous Anonymous said...

wow power leveling
wow power leveling
wow power leveling
wow power leveling
wow powerleveling
wow powerleveling
wow powerleveling
wow powerleveling
wow gold
wow gold
world of warcraft power leveling
world of warcraft power leveling
wow power level
wow power level
power leveling wow
power leveling wow
power leveling wow
powerleveling wow
powerleveling wow
cheap wow power leveling
Maple Story mesos
MapleStory mesos
ms mesos
mesos
SilkRoad Gold
SRO Gold
SilkRoad Online Gold
eq2 plat
eq2 gold
eq2 Platinum
EverQuest 2 Platinum
EverQuest 2 gold
EverQuest 2 plat
lotro gold
lotr gold
Lord of the Rings online Gold
Rolex Replica
Replica Rolex
hy

2:06 AM  
Anonymous Anonymous said...

Buy cheap WOW Power Leveling,sell wow gold.welcome to buy cheap wow gold-We can have WOW PowerLeveling,buy wow gold game, World Of Warcraft Gold,wow Gold, world of warcraft gold deal,Cheap WOW Gold. Welcome here to buy the professional World Of Warcraft Power Leveling service, World Of Warcraft PowerLeveling for Cheap Wow Powerleveling, WoW Power leveling Guide.

Alcohol Tester purchasing center is a professional enterprise Breathalyser,Breathalyzer specializes in breath Gas Alarm consulting,Gas Detector through internet.Co Detector,Co Alarm always have been designed to alarm.

12:51 AM  
Anonymous Anonymous said...

济南市龙威液压机械有限公司是专业生产液压升降机,是国内领先的升降机及升降平台的生产厂家。我公司是北京市最大的仓储式弹簧销售企业,经销各种不锈钢弹簧。RAID数据恢复是“Redundant Array of Independent Disk”的缩写,中文意思是独立冗余磁盘阵列。另外还有数据恢复服务器数据恢复等恢复方式。

“加密狗“的工作原理?加密狗内置单片机电路(也称CPU),使得加密锁具有判断、分析的处理能力,增强了主动的反解密能力。我们致力于提供一流的同声传译设备租赁服务,在同声传译领域,同声翻译设备租赁具备一流的新一代博世会议设备租赁服务。

google排名让您通过网络成就搜索引擎优化未来。众多网站优化的客户实践看来,google左侧排名效果非常理想。其中seo效果最好的要属google左侧排名google优化是网络营销的有力推广方式搜索引擎排名

12:51 AM  
Anonymous Anonymous said...

本科生有论文发表,研究生复试可无条件通过吗?
同声翻译,也被叫做“同声传译”,简称“同传”,一般借助于同声传译设备在大型国际会议时各种语言相互转换,要求译出语和译入语几乎同步进行。

12:51 AM  

Post a Comment

Links to this post:

Create a Link

<< Home