Friday, April 18, 2008

Another Example Of Google App Engine's Strength

Check out http://bigtable.appspot.com/

It's basically a REST interface to the Google BigTable database service that is included with Google App Engine. This is simple, yet powerful stuff. And, this is just another example - see my earlier post on creating a simple blog engine on top of this infrastructure.

So, yeah. Your Google App Engine application could be an extension of some piece of the Google infrastructure. There are certainly some practical limitations here (like the current 500MB storage restriction).

But, at this stage, the right things are happening. We're playing with the capabilities that this PaaS provides, and figuring out, along the way, how we can use it as a piece of the utility. Is this stuff hard? Here's the quote:

Exciting times, to be sure.

code.flickr - Open Source 1-Stop Shop For Yahoo! Flickr

image Taste the rainbow.

The Yahoo! Flickr team has their own Open Source code repository now, known as code.flickr. Here's the announcement.

The Subversion tree currently only has the source to their Flickr Uploadr tool, written in XULRunner, but that's a great start. The Flickr API is a beautiful thing. And, I'm happy that quite a few other sites have copied the basic structure of this Web Service API. Makes it easy to mash up solutions from web data. Hmm. Tasty. And simple. Like Skittles.

Flickr is currently processing about 700 API calls per second across 109 public API methods. Nice.

IPython on Mac OS X 10.5 Leopard

Some interesting things have happened recently that have caused me to spend way too much time writing Python code:

  • Google App Engine was release with native support for pure Python web applications. It's now really easy to write and deploy Python applications that are extremely scalable on top of a solid (and portable)  infrastructure.
  • Apple released Mac OS X 10.5 Leopard, and included support for Python as a first-class citizen in its Xcode development tool (which lets you develop with Xcode/Interface Builder pretty seamlessly), in its ScriptingBridge (which allows you to access AppleScript enabled applications using the goodness of Python, and not the confusingness of AppleScript), and allowing for very easy interaction with Cocoa objects (Apple's GUI programming framework).

The net result of all this is that I've been spending a lot of time in Python. Surprised the hell out of me, but it's the truth.

I have found the IPython command-shell particularly useful. It's very well done, and has excellent documentation. Problem is, it doesn't work so well on Mac OS X 10.5 Leopard. Your screen gets scrogged because of a Readline conflict (see the video). Here's my cookbook for getting it to work - it's way easier than all the other documents on the Internet lead you to believe.

  1. Installing IPython on Mac OS X is actually quite easy with the following command:
    sudo easy_install ipython
  2. Execute the command to load the right Readline library:
    sudo easy_install -f http://ipython.scipy.org/dist/ readline

That's it. Let me know if that didn't work for you.

Now, if you could only get Apple to include Python support in the iPhone SDK...

Sharpcast SugarSync Launch Statistics

image The folks at Sharpcast have taken notice of the articles that I have written recently about the online file synchronization market. They contacted me and shared some of the statistics for the SugarSync launch that happened on Mar 20. The stats were interesting, so I asked if I could share them with you all on my blog, and they agreed. Here's the quote:

Only two weeks into our launch, we have a 15% conversion rate and have already doubled our first month's expectations in trials, and we are only half-way to the end if the initial 45-day free trial period. 75% of our customers sign up for 30GB or more.  A quarter of them are on 100 GB and 250 GB plans. And the country's most influential publications and analysts by and large are showing unanimous support that SugarSync is a new standard-bearer for the category.

Sharpcast added that since the launch, SugarSync has synchronized over 75 Million files.

It's always great to get some statistics - especially straight from the company. I would love to hear more (like the breakout of mobile users, for example). Many thanks for sharing!

Comments?

Monday, April 14, 2008

Cassatt: The Green Data Center As A Step To Utility Computing

image ComputerWorld did a nice video interview with Bill Coleman, CEO of Cassatt Corporation, on the positioning of Cassatt as a "Green Data Center" software company as opposed to a "Utility Computing" software company. You should watch it. Some selected points raised by Bill include:

  • Cassatt is trying to build the company around what people are willing to buy today.
  • Cassatt is still a Utility Computing company. The Policy Management that we have built and is needed to do Active Power Management is the same as that needed to build a Utility Compute environment.
  • Cassatt has 25 Patents Pending (23 utility and 2 method patents - I hold one of the utility patents).
  • Inflection point in Utility Computing, going beyond Active Power Management, is 2009-2011.
  • This is a platform because it is the Policy Management Framework by which end user customers define their success in using IT.
  • The Web 2.0 stuff will be built out and there will be a huge bust - just like every decade there is a bust at the end of it.
  • During the whole next decade, utility computing will be proved, and we will have a huge consolidation of industries providing utility vanilla services.
  • What I want to be is the arms supplier. I want to pay all the utilities to take my software and run their systems, and I want to sell to the end users a policy management framework by which they succeed.

Back in 2003, Bill Coleman, Dave McAllister, and I wrote the Cassatt Business Plan that led to the Series A funding by Warburg Pincus. At that time, we wrote a 10-year business plan, which was pretty much unheard of - especially during the funding doldrums of 2002-2004. Cassatt was always set up as an unusual Silicon Valley startup, in that we knew it would take 10 years for the Utility Computing marketplace to play out. Most VC-funded startups need to get to an exit well before that time, else things get messy for the VC fund (as they start to shut it down). Warburg Pincus brought the long-term perspective to the table. Very unusual, and highly respected.

The next 5 years should be very interesting as Utility Computing slams with Platform As A Service (PaaS) slams with highly scalable/reliable systems. What Cassatt has built is not particularly "sexy", but Bill is right that there is a huge need for a Platform to facilitate all the complexity and heterogeneity. In essence, a Utility OS.

Disclaimer: I am Co-Founder, Founding EVP/CTO, and a shareholder of Cassatt Corporation.

Google App Engine Ported To Amazon EC2

imageAs expected, folks are already starting to move the Google App Engine SDK over to run on top of the Amazon Web Services system. The worry over "Google Lock-In" has been a major concern for folks getting their first look at Google App Engine. I commented on exactly that point in one of the responses to my earlier post. My feeling was that the framework would be largely portable to non-Google environments. And, it looks like I was right - way earlier than I expected to be.

Yeah, it's not perfect.

Yeah, it's not as scalable.

Yeah, the user ID's are not authenticated against Google's User database.

But, all of these can be fixed in time.

After all, Chris Anderson only spent 4 days putting this first cut together. The port is called AppDrop and is Open Source.

This means that we can all just get going with bringing great applications to Google App Engine and not worry about the portability issues now, eh? I know I won't be losing any sleep...

Thursday, April 10, 2008

Nuova Systems & Cisco: Sealing The Deal



I wrote a detailed look into the economics of the Nuova Systems and Cisco "M&A" deal (way back in October 2006) in the article: Nuova Systems & Cisco: New Corporate VC Model? Many thanks to my friend Tom Lyon for giving me an early look into what the Nuova Systems folks were up to. And congratulations to the team for completing this deal!

Fast-forward to today (April 2008) and we find that Cisco has announced that they will acquire the remaining 20% of Nuova Systems, as per their original deal. I missed it, but apparently the two firms renegotiated the deal in April 2007 in Nuova Systems' favor "and raised the maximum potential payout of the transaction to $678 million". It was originally set to $578M. The latest announcement included additional information about the milestones of the payout:
The Nuova transaction is success-based with the total value primarily determined by the revenue of Nuova products over three measurement periods. The first measurement period will commence in early fiscal year 2010, the second measurement period will commence in late fiscal year 2010, and the third measurement period will commence in mid fiscal year 2011.

As I mentioned in my original article, I really do like this "Corporate VC"-ish model that they have created with the structure of this deal.

Everybody wins, and risk is dramatically reduced. Hats off to Cisco's Business Development group.

I look forward to hearing more details about the payouts, as the milestones tick by (and the success of the Cisco Nexus 5000 Series).

Final note from their announcement:
Nuova was founded by Ed Bugnion, Luca Cafiero, Prem Jain, Soni Jiandani, Tom Lyon and Mario Mazzola. Bugnion is a former co-founder of VMware and Lyon formerly founded Ipsilion Networks. Cafiero, Jain, Jiandani and Mazzola are all former Cisco executives. All six founders and the company's approximately 200 employees in San Jose and in Beaverton, OR are expected to join Cisco to continue working on data center-related projects.

Nuova will operate as an independent business unit led by Cafiero, Jain and Mazzola who will all report into John Chambers, Cisco's CEO and chairman. In addition, to help ensure alignment with Cisco's development priorities, Jain has been appointed as the ninth member of the development council in Cisco's Development Organization, joining Tony Bates, Marthin DeBeer, Kathy Hill, Ned Hooper, Pankaj Patel, Don Proctor, Manny Rivelo and Jayshree Ullal.

Wednesday, April 9, 2008

An Example Of Why Google App Engine Will Win

So, we've all heard about Google App Engine by now, right?

Well, here's a great example of how easy it is to make an interesting app, in a very small amount of code, on Google App Engine. And, have it be automatically scalable.

Surf on over to Bret Taylor's blog. Bret is one of the FriendFeed founders.

You'll notice that the blog is, in fact, hosted on Google App Engine. In under 100 lines of Python, there's a start at a perfectly functional blog engine (leveraging Disqus comments, which makes complete sense). There was no rocket science involved in what Bret put together. This is just the beginning.

Of course, this specific example lets you know how easy it would be for somebody to take on http://wordpress.com with a Google App Engine hosted solution.

And, this is just one, simple example. Forum software? OpenSocial apps? Software Project Management? Wiki?

I predict a sharp increase in Python and Django book sales. Enjoy the ride O'Reilly!

Tuesday, April 8, 2008

Google App Engine Body-Slams Amazon Web Services

I love it.image

Google makes a strong move into the scalable web services arena with the introduction of Google App Engine. Features include:

  • Dynamic webserving, with full support of common web technologies
  • Persistent storage (powered by Bigtable and GFS with queries, sorting, and transactions)
  • Automatic scaling and load balancing
  • Google APIs for authenticating users and sending email
  • Fully featured local development environment

I had the chance to run through the Google App Engine documentation last night. It's very well done (especially since it is just a Preview Release).

Yeah, it's all Python, but there's nothing wrong with that - Python Rocks.

Yeah, they want you to use Django, but there's nothing wrong with that. Django Rocks. And, if you don't think so, just upload any Pure Python framework and roll your own. It's easy.

But, how does it compare to Amazon EC2 + S3 + SimpleDB?

It's completely different.

Google App Engine is a much, much higher level toolkit and abstraction layer. Here's how I think about it:

Amazon Web Services gives you the logs and asks you to build yourself a cabin. Amazon Web Services lets you change that cabin into a chateaux or a lodge, but you've got to wield the hammer.

Google App Engine gives you a log cabin and asks you to move in, invite your friends, and start to party. When the party gets too big, Google App Engine builds you a bigger cabin, chateaux, or lodge. You keep partying.

I believe the simplest approach wins.

I love the Amazon Web Services guys (and have written many articles about what they are up to). I'm a big fan. The fact is that Google App Engine is severely limited in what it can and cannot do. They sky's the limit with Amazon Web Services, however. AWS pretty much does whatever you want. Just write some code.

Google App Engine will be wildly successful because it makes building and serving a scalable web site super simple (if you know Python).

There is a place for both tools, but Google App Engine will see so much more variety of services.

I added my name to the invite list... Pick me. Pick me. Pick me.

IDC Virtualization Forum West – Simon Crosby

image Simon Crosby, formerly the Founder & CTO of XenSource and, since the acquisition, now the CTO of the Virtualization & Management Division at Citrix, did a very nice job with the morning's kick-off sponsor presentation at the IDC Virtualization Forum West conference.

Some takeaways that I found interesting:

  • Virtualization is not an end-goal in and of itself. Virtualization is a feature set and simply serves a role in IT Application Delivery.
  • Simon took a few jabs at VMware and, why not? Citrix/XenSource is now squarely positioned as the #2 contender. When you have the chance, you take a shot at the big boy. And, VMware is a big boy, to be sure. Simon said, "This is the year the world strikes back" (against VMware, I presume).
  • Simon also said, of one of the sleeping dogs in the Virtualization space, "Microsoft is going to radically change the environment for virtualization". Presumably with their Hyper-V solution and their partner muscle.
  • About the movement of the hypervisor into the firmware of server (and at some point), client computers: "Where this feature ends up is still in play -- in the OS, or in the hardware". Personally, I think the answer is clear. Hypervisors are becoming commoditized and will become a component of the hardware/firmware/BIOS. It can't be stopped.
  • Citrix will create a set of Open Extension API's for Value Added Dynamic Infrastructure Services. Basically a way for third-parties to interact with the lower layers as part of building a truly dynamic data center (which, EVERYONE is talking about getting to at the conference) - Something that we predicted while building the business plan for Cassatt in 2003. The industry/market is absolutely catching up.
  • I think I heard that XenDesktop will be released in Q2 of this year (i.e., soon).
  • On the issue of scaling the virtual desktop infrastructure: "When I talk about scale, the Desktop scales way worse than any Data Center". He cited a customer example where the customer has 250,000 desktop PC's. They absolutely DO NOT want to have 250,000 Virtual Machines! The Citrix approach to scale here is intriguing (and quite likely correct): Break the OS from the Configuration from the Applications. Assemble them in real time for the desktop virtual machine. Result is 1 (or a handful) of OS images that you have to deal with and patch in order to update thousands of desktop machines. Much better scale solution.

I liked what Simon had to say about the virtualization landscape. It is very clear that the choice of Citrix as their acquirer was a good one. Lots of good synergies between the companies.

I had lunch with Simon as well, and we continued the discussion. I was impressed with his understanding of the customer requirements and political challenges to the rollout of a virtualized infrastructure.

IDC Virtualization Forum West - Part 2

At the IDC Virtualization Forum West Conference, John Humphreys, Program Vice President of the Enterprise Platform Group at IDC shared some more detailed thoughts on the virtualization markets (great presentation, BTW).

Further takeaways include:

  • Of the customers that are doing virtualization in their data centers today, IDC says that 22% of servers have already been virtualized, with an expected rise to 45% in 12 months. Note that Gartner claims that the overall virtualized server market share is 5%. Which means, to me, that there is a whole lot of headroom for virtualized server growth.

  • Power & Cooling account for $0.50 for every $1 spent on servers, or about $29 Billion annually.

  • Roughly $8 in maintenance spent for every $1 in new infrastructure.

  • "Server consolidation" is already appearing to be "old news". Now "Desktop Consolidation" is hot - the ability to serve up the desktop client image from a central location, and all the centralized admin goodness that comes from that. IDC notes a number of challenges, like the fact that moving the desktop client images into the data center results in 20-30% cost of storage increase (I would think it would be much more, personally), due to the additional network storage requirements; There are still challenges with running the virtualized OS legally (if you are not already a Software Assurance volume pricing customer, that is; who wants to buy another retail copy of Windows just to serve it up from the central data center?); And, performance of the remote desktop protocols can be poor for some client workloads. IDC specifically mentioned Qumranet and their SPICE remote connection protocol as potentially addressing some of these performance issue.

  • Virtualization appears to be solving the complexity problems that surround the deployment of "clusters" in the data center. And, I completely agree. I've set up many, and they are way too complicated. And virtualizing is way too easy. Death to clusters!


My thought on the Virtual Desktop Infrastructure topic: Today's desktop computers are extremely powerful and should not be used as dumb terminals that just do "Remote Desktop" access. You need to find a hybrid approach that allows you to use the power of the desktop client (and all that lovely disk drive space on the client). Once clients start being delivered with a built-in hypervisor (which is not too far away), you could argue that you might be able to treat the client as a server. Then, there is just the matter of managing the Virtual Hard Disk images. Using a CacheFS would be one very easy way to do so (transparent local storage that can be taken offline with automatic server-based backing I/O).

The Citrix folks have an interesting approach to this, including both the ability to "stream" an application load to a diskful and stateful Windows client, OR to deliver a server-hosted virtual machine through a remote protocol connection. Choice. Choice is good, as one size will not fit all customer environments for client desktop management. Check out the Citrix Delivery Center.

IDC Virtualization Forum West – Eastwood Keynote

I attended the IDC Virtualization Forum West 2008 conference today. It was kicked off by Matthew Eastwood of IDC. He shared some of the IDC analysis of the virtualization markets.

Some takeaways that I found interesting:

  • Worldwide IT Spending on Servers + Power + Cooling currently at about $55 Billion annually.

  • Data centers continue to grow with new server purchases annually (and relatively fewer servers retired annually, so absolute growth appears to never end).

  • Server Management & Admin costs are rising at 4x the rate of new server acquisition growth, while Power & Cooling is growing at 8x the rate.

  • Number of Rack "U" used annually increases 25x to 15.4 Million servers - this is 365,000 racks representing $15 Billion, with an additional $30 Billion going to Power & Cooling requirements.

  • IDC conducted a survey where they asked IT customers about their interest in "Green Data Centers". Result, with n=191, was that 37% would Favor A Green Supplier, 51% thought Green would Help With Compliance, and 81% felt that Green Strategies would help to reduce OPEX.


So, lots of discussion about the need for Green data centers, and the huge amount of Power and Cooling costs that directly affect operating expense. A dynamic and adaptable data center can provide for a green data center - one that can power servers down when they are not needed, performing dynamic server consolidation based on business process needs. In fact, that's what Cassatt's Active Power Management and Active Response products do.

Go save the planet. Or, at least increase your corporation's earnings. That's important too.

Disclosure: I am a Founder and shareholder of Cassatt.

Monday, April 7, 2008

At IDC Virtualization Forum West Conference

image I will be attending the IDC Virtualization Forum West conference tomorrow.

Many thanks to Simon Crosby (formerly of XenSource, now with Citrix) for the invitation.

If you will also be there and would like to chat, please drop me a line.

I'll follow-up here with some of the interesting takeaways.

Thursday, April 3, 2008

Some Nice Scalr Follow-Ups

Just ran across a couple of good follow-ups to my article on Scalr: One done by the awesome Amazon Web Services team, and the other done by the kick-ass team at TechCrunch. Glad to see the Scalr project getting some good coverage. Let's rally around this and make it great!

SugarSync Responds To Negative Pricing Coverage

In my article about Sharpcast and their recently released SugarSync product, one of my key criticisms was the fact that the service was priced too high. It appears that I was not alone. Sharpcast has cut their prices in half in response. From their Pricing page:

Looking for the Founders' Circle (50% off) pricing information? As of April 1, 2008, the Founders' Circle promotional pricing is our new ongoing, everyday low price, as reflected below. We have listened to your feedback and are excited to offer you the best value possible.

imageSharpcast apparently rolled out the price cut quietly. I would not have known about it had I not read a review by Walt Mossberg (cross-referenced here) which stated the lower price point. I was sure that Walt had it wrong. But, he did not. The price for the service has dropped.

Good for them.

I think they should continue to listen to their "customers". Of course, it seems odd that they would not have known that they were too pricey the week before when they launched. Oh well. Better late than never.

The other thing that surprised me from  Walt's review was that the much-touted SugarSync Mobile client actually doesn't sync modified documents:

The cellphone versions can only view photos and whatever documents the phones allow, but changes you make on the phones in documents other than photos aren’t synced back to the computers or to the Web site.

In addition, SugarSync can’t synchronize Microsoft Outlook files and it can’t, say, replicate a new calendar entry or contact change across your computers.

I get that it doesn't handle contacts and calendar information. It just deals with files. But, customers certainly would be interested in having a single "sync" solution for their entire mobile device that works Over The Air. But my guess is that this would be too de-focusing for SugarSync at this time.

My Maxtor Hard Disk Clunks To Death

imageWhen your disk drive starts making loud, squealing noises when you first turn it on... That's a sign.

When your disk drive starts making clicking noises as if it were a metronome... That's a sign.

When your disk drive starts throwing I/O Errors to the console... That's a sign.

When your disk drive no longer mounts its volume... That's a sign.

Yeah - A sign that your disk is about to die or is already dead.

That's what happened to my Time Machine disk that is attached to my Apple iMac desktop computer. It was a 750GB Maxtor One Touch III, purchased just 7 months ago.

The Good News is that it was just my backup drive and not my primary drive. My primary drive is a 1TB disk, as shipped by Apple, and thankfully has hummed along perfectly. So, I could keep working.

The Bad News is that you are no longer making hourly backups, and all of your Time Machine backups are no longer available, so you are completely exposed. I.e., I need a Time Machine backup disk for my Time Machine disk! Or, multiple Time Machine volumes (if that's possible?)...

So, I surf over to the Seagate/Maxtor site and check the warranty coverage. The disk has a 1-year warranty, so I'm good since I bought it about 7 months ago. The warranty process is very streamlined at Maxtor - completely hands-off and web-based. I was given the choice of paying $20 for expedited replacement (two-day shipping), or a free replacement that could take a couple of weeks (I would have to send in my disk first, then get one back through slow mail).

I like my backups, so I chose the $20 option, and the disk arrived 3 days later (submitted the form on Sunday night, it was processed and shipped on Monday, and arrived on Wednesday).

It took all night (about 10 hours) to re-sync my Time Machine backups. About 1,256,435 files in 600GB of data. I was quite surprised to see that I've got over a million files... Hmm.

Ah, I feel safe again.

Wednesday, April 2, 2008

Zoto Open Sources Their Web Site Code - Maybe

image The folks over at the photo sharing site Zoto have decided to Open Source the code for their site. Kord Campbell, CEO of Zoto and currently Chief Evangelist at Splunk, makes the announcement at GeekCEO:

I'll keep this simple. I'm uploading the Zoto 3.0 source code to its new Google Code project tonight, and placing the BSD free software license on it. Version 2.0 of Zoto will follow in a couple of days (as soon as I find where we put it). We've also been working on a new site called Fotofluff, and its code is going up there as well.

This is a very cool development, and very cool of the Zoto folks to do. Hundreds of files filled with Python goodness representing a very well done photo sharing site. Nice.

However, while Kord claims that the code will be released under a BSD license, and the Google Code page specifically references the New BSD License, the About page on Google Code says:

The server and the rest of the Zoto code base is now free for non-commercial use. If you want to use Zoto's software in a commercial, for-profit environment, you can contact Kord Campbell at kordless@gmail.com, to inquire about licensing options for commercial applications.

That's not exactly a BSD license.

And, when you download the code using: "svn checkout http://zoto-server.googlecode.com/svn/trunk/ zoto-server", there is no LICENSE file included in the distribution to clarify. Interestingly, someone even filed a bug/issue against the project about this.

The BSD License would certainly allow for the greatest re-use of the existing code and is a good choice to use, depending on what Kord's goals are.

I look forward to the clarification of the license.

Herb Savor Is A Cool Tool

I agree completely with this article from the folks a Cool Tools.

This thing actually works.

We do have a herb garden, which works so much better than buying herbs at the grocery store for $1.69 a throw. However, when the herbs are not growing, we're using this thing to eek out a little more life.

This was a wedding gift for us, not on our registry, that really surprised us with its utility. Highly recommended.

Y Combinator + RescueTime: Lessons Learned

image Tony Wright wrote a nice article over at FoundRead about his experience with the folks at Y Combinator in getting his most recent company, RescueTime, to market. Definitely worth a read.

I like the Y Combinator model that Paul Graham has put together. And, they're getting lots of great companies built (on the cheap, as it should be).

Monday, March 31, 2008

Sun Microsystems Acquires Parallels For $205M???

Just saw the story over at Virtualization.com.

I hope for the sake of the Parallels folks that this is an April Fool’s joke.

Parallels would be able to build a company valued much higher than the reported price. And, we all know what the Sun stock has been doing: Pretty much flat over the last 5 years.

A heck of a deal for Sun, however, if it’s true.

Tags: Sun, Sun Microsystems, Parallels, SUNW, M&A, Acquisition, Merger, Brian Berliner,brianberliner

New LinkedIn Feeds Work For Me

I must admit that I’m finding some clear networking value in the newly releasedLinkedIn RSS feeds.

You can get Public feeds from LinkedIn Answers (which I don’t care about), or a Personal feed of your Network Updates (which I very much care about). Here’s the announcement.

From the Home page while logged in to LinkedIn, click on the subscribe link next to the Network Updates.

Then, read it with your favorite news/feed reader. Mine’s Google Reader.

Makes it easy to snoop keep up with the connections happening in your network of friends & associates.

Enjoy!

Tags: LinkedIn, RSS, Feeds, Google Reader, Brian Berliner, brianberliner

Scalr - Open Source Framework For Scalable EC2 Deployments

I’ve written quite a few stories about Amazon Web Services, including their EC2 and S3 offerings. They are heading in the right direction toward utility computing in the cloud. I’m definitely a fan.

My most recent article highlighted how Amazon now allows you to use Static IP addresses with your hosted services - a clear step toward true, secure hosting in the cloud.

Of course, it’s still the wild west out there, and you do have to roll your own EC2 management and deployment services. Amazon gives you API’s to do this, but it’s still work and testing.

Enter Scalr:

Scalr is a fully redundant, self-curing and self-scaling hosting environment utilizing Amazon’s EC2.

It allows you to create server farms through a web-based interface using prebuilt AMI’s for load balancers (pound or nginx), app servers (apache, others), databases (mysql master-slave, others), and a generic AMI to build on top of.

Very cool. The project is very young yet, but they are going in the right direction (building easily scalable application tiers).

This project appears to be supported by Intridea.

Tags: Open Source, Scalr, Amazon, EC2, S3, Utility Computing, Scalability, Intridea, GPL, Brian Berliner, brianberliner

Sunday, March 30, 2008

Golf Quote Of The Day

My wife and I went out for a 10-mile hike today near beautiful Pacifica Beach (stopped at Rockaway Beach). We joined up with the I.N.C.H. (Intrepid Northern California Hikers) group. They do some seriously hard hikes here in the Bay Area. This one was rated a Level 2 hike (out of 5).

The hike was a loop of pieces of Sweeney Ridge Trail, Baquiano Trail, and Mori Ridge Trail

Anyway, while on Mori Ridge Trail, I made a comment about the Sharp Park Golf Course, which you can see from the trail (we had some beautiful views today - a bit too much wind for my liking, but the views were great). A delightful woman we were hiking with, who shall remain nameless, said:

I don’t think I’ll ever golf.
It’s like playing fetch with yourself.

I Loved It!

However, the way I play, it’s often more like an Easter Egg Hunt while I search for my ball in the rough.

Tags: Golf, INCH, I.N.C.H., Hiking, Golfing, Hike, Pacifica, Trail, Sweeney, Baquiano, Mori,Quotation, Quote, Brian Berliner, brianberliner

Friday, March 28, 2008

Sony Vaio UX Running Mac OS X At The Hockey Game!

So, I’m at the Sharks hockey game last night, and I notice a guy a couple rows in front of me using a Sony Vaio UX Micro PC. Hey, it’s the Bay Area. People bring high-tech gadgets to hockey games. That’s just how we roll out here.

No big deal, right?

Well, I look a bit closer, and the device appears to be running Mac OS X! WTF?

Furthermore, the Dock appears to be a Leopard Dock, not a Tiger Dock, so I think the device is running Mac OS X 10.5, even…

Geeks.

Sheesh.

Of course, then I get a pang of jealousy.

After all, it is a 1.2 pound device running Leopard…

Geeks (including me).

Sheesh.

Poking around on Google, I find an old article about getting Mac OS X (which they call Mac OSuX for this device) on the Sony Vaio UX. Lots of scary stuff in there. Just get a Macbook Air. The picture above is from jkOnTheRun (i.e., is not a picture of the guy a couple rows in front of me).

So, you know what this means?

It means that you can develop iPhone applications on your mobile phone!

Only in the Bay Area…

Tags: Sony, Vaio, Sony Vaio UX, Micro PC, Apple, Mac OS X, Leopard, Tiger, Mac OS, iPhone SDK, Brian Berliner, brianberliner

All Joe Thornton, All The Time


Photo courtesy of David M*

My wife and I love the San Jose Sharks. We share season tickets with a set of family and friends. The Sharks fans really know how to support their team and make every game a fun event.

We attended last night’s game against the Dallas Stars. And won in overtime. I’ve gotta say. The overtime victories, where you come from behind to tie it and force the overtime, then go on to win it decisively in overtime, are the best!

The San Jose Mercury News covers it well. The first period was a sleeper, with the Sharks looking like they were on Spring Break, but the final two periods (and the ever-so-brief overtime) was hockey bliss.

My favorite player, the one on my Sharks jersey, is Joe Thornton. The man is an assist machine. Last night, he:


  • Took a great pass from Grier to score the tying goal that kicked it into overtime

  • Saved us from Dallas getting an easy winning goal (by mere inches)

  • Set up a perfect pass to Marleau for the overtime win


Thornton is worth every penny.

This was a key victory.

Go Sharks!

Tags: Sharks, San Jose, San Jose Sharks, Hockey, Joe Thornton, Patrick Marleau, Shark Tank,Brian Berliner, brianberliner

Thursday, March 27, 2008

iPhone SDK: Now With Interface Builder Goodness

That was much faster than I had anticipated.

I wrote about the Apple iPhone SDK and how I thought it was going to revolutionize the mobile application market.

At that time, Apple released the first Beta of the iPhone SDK, which was very functional, but did not include a working Interface Builder application. That meant that you would have to roll your own User Interface elements using Cocoa Touch. No big deal for now, but it sure would be much nicer to have IB available.

And, now it is.

Kudos to Apple for moving quickly to get this out.

I am extremely impressed by Apple’s execution of their iPhone strategy and developer program. There will be a shitload of high-quality and reasonably priced applications for this device.

Thanks to Ars Technica for catching the announcement for me.

Tags: Apple, iPhone, iPhone SDK, SDK, Software Development Kit, Mobile, Platform,Programming, Interface Builder, IB, Brian Berliner, brianberliner

Taking A Wii

OK.

We broke down.

We got a Wii.

I’m not a big gamer. I do own a PSP, but I rarely play. I don’t own any other consoles, though my daughter did have a Playstation 2 for a while, and I spent way too many hours playing Grand Theft Auto. Oh, and I used to playDoom when it first came out on the PC. Mostly deathmatch with my co-workers at Sun Microsystems. Sun had a great (internal) multiplayer Doom system back in the mid-1990’s - it even ran on Solaris! I even had short bouts with Quake and Descent. Yeah, I’m old.

OK, so maybe I’m a bit of a gamer.

I am Male, after all.

But, I never really liked the current game controllers. The controller interface to the games is way too complicated and unnatural. Yeah, we’re back to that "old" thing…

So, my evil strategy for getting a Wii was to wait for my wife to decide that we really needed it. And, a couple of weeks back, the Sunday Best Buy ad said that each store had 15 in stock, so we pounced and got it!

And, the results are in.

The Wii is incredibly accessible to kids of all ages.

I went to Oregon to visit with my folks. They are in their 70’s. We had a blast playing golf and bowling, with an occasional tennis match thrown in. But nobody wanted to box against me. Tons of good laughs. Well worth the price.

And, since the Wii is such a small package, it was very easy to tote along with us. It’s my new, favorite, mobile gaming platform!

Recommended.

Tags: Nintendo, Wii, Nintendo Wii, Mobile, Gaming, Wii Sports, Brian Berliner, brianberliner

Universal Parallel Computing Research Center

 

My good friend and advisor, Dave Patterson, has been selected to lead the Universal Parallel Computing Research Center at UC Berkeley.

Patterson has been an advisor for three of the startup companies that I have founded. He’s a great guy and has a brilliant mind. He has a knack for doing research with immensely practical applications. He gets ahead of problems in Computer Science, and addresses them with the end result in mind. I just can’t say enough nice things about him. Brilliant.

The UPCRC is a joint venture between UC Berkeley and University of Illinois at Urbana-Champaign, funded by Intel and Microsoft. These two universities will spend the next 5 years trying to figure out how we build computing systems that can fully utilize the coming wave of multicore and manycore systems.

This is absolutely critical stuff.

Take a look at some of the coverage:

This is a very interesting project to me, and I will be writing more about it later. Why? Well:

  • I know David Patterson well, and have always admired his work
  • I am a graduate of the UIUC Computer Science department
  • Much of my career has been spent on HPC and supercomputer systems
  • Multicore and manycore systems are coming. You can’t stop it or deny it. There’s a solid reason why Intel and Microsoft are sponsoring this research.
  • I’ve been thinking about this topic of late.

You will absolutely hear more from me about this.

Tags: UPCRC, David Patterson, University of Illinois, UIUC, UC Berkeley, Intel, Microsoft, HPC,Parallel, Multicore, Manycore, Brian Berliner, brianberliner

BeInSync Synchronizes With Phoenix Technologies

image In the last couple of weeks, I've talked about the file synchronization market. Products and companies like FolderShare, Dropbox, Syncplicity, and Sharpcast.

In a timely moment, BeInSync has been acquired by Phoenix Technologies for $25M. TechCrunch covers it well.

BeInSync looks to be most similar to Sharpcast's SugarSync product in terms of functionality. Sharpcast has support for Mobile devices, while BeInSync does not. BeInSync may only work on Windows (no Mac) in fact. BeInSync charges $39.95 for 50GB of storage per year, while SugarSync charges $199.99 for 60GB of storage per year. BeInSync certainly has the more attractive price!

I must admit that I don't fully get why Phoenix Technologies was interested, except that Woody Hobbs, current President/CEO and previous President/CEO of IntelliSync, clearly knows what he's looking for.

And, the $25M price tag can't be sitting well with the Sharpcast folks, since they've already taken down $16.5M in VC money. Sharpcast would need a significantly higher exit for an acquisition to make financial sense.

Amazon EC2 Gets It Right

I’ve written a couple of articles about the Amazon EC2 service. It’s the Elastic Compute Cloud that lets you build very scalable (and, reliable) web sites "in the cloud", using Web Services created and operated by Amazon.

It’s amazingly good.

And, just got significantly better.

Amazon just announced two significant improvements to the service:

Elastic IP Addresses:
Elastic IP Addresses are static IP addresses designed for dynamic cloud computing, and now make it easy to host web sites, web services and other online applications in Amazon EC2. Elastic IP addresses are associated with your AWS account, not with your instances, and can be programmatically mapped to any of your instances. This allows you to easily recover from instance and other failures while presenting your users with a static IP address.

Availability Zones:
Availability Zones give you the ability to easily and inexpensively operate a highly available internet application. Each Amazon EC2 Availability Zone is a distinct location that is engineered to be insulated from failures in other Availability Zones. Previously, only very large companies had the scale to be able to distribute an application across multiple locations, but now it is as easy as changing a parameter in an API call. You can choose to run your application across multiple Availability Zones to be prepared for unexpected events such as power failures or network connectivity issues, or you can place instances in the same Availability Zone to take advantage of free data transfer and the lowest latency communication.

These two capabilities answer the primary complaints that I have heard about the EC2 service, and I suspect will allow for significant customer adoption in the next 18 months. Static IP Addresses, combined with serving up the proper certificates, should allow for fully secure computing under Amazon EC2.

The guys at RightScale have described Setting up a fault-tolerant site using Amazon’s Availability Zones.

Amazon also announced User Selectable Kernels:
Amazon EC2 now allows developers to use kernels other than the default Amazon EC2 kernels with their instances.

Including:

This release makes the following new AMIs and AKIs (Kernel IDs) available:
AMI: Fedora Core 6 - 32 bit - a stock FC6 release with matching kernel and RAM disk
AMI: Fedora 8 - 32 bit - a stock F8 release with matching kernel and RAM disk
AMI: Fedora 8 - 64 bit - a stock F8 release with matching kernel and RAM disk
AKI: 2.6.18 Kernel - 32 bit - a stock 2.6.18 kernel (can be used with 32 bit AMIs)
AKI: 2.6.18 Kernel - 64 bit - a stock 2.6.18 kernel (can be used with 64 bit AMIs)

Tags: Amazon, EC2, Cloud Computing, Web Services, Static IP, Failover, Redundancy, Brian Berliner, brianberliner

Wednesday, March 26, 2008

Sharpcast Puts $16.5M To Good Use: Releases SugarSync

Sharpcast, founded in 2004 and funded in 2006, has just announced the launch of their SugarSync product (formerly known as Project Hummingbird).

Similar to the products I talked about last week in the article, "FolderShare, Dropbox, Syncplicity, Oh My…", SugarSync is a tool that keeps your files synchronized across multiple computers (PC & Mac today, maybe Linux as well someday), including mobile devices.

One of the things that sets Sharpcast apart from the others is the support for many mobile platforms. They support Brew, J2ME, BlackBerry, Windows Mobile, and Symbian (coming soon). I don’t really think that the mobile aspect of this is where the market is right now, but I could be wrong. And, Sharpcast certainly has enough VC money to address the perceived needs of the mobile users. In any case, Sharpcast certainly has a big enough market with just the Universal Sync service.

Sharpcast charges $9.99/month or $99.99/year for their basic plan, which includes 30GB of storage in the cloud. I have 40GB of music, 30GB of photos, and 50GB of documents, so for me to use the service for just that (not counting my 450GB of camcorder video), I would need the Business Plan, which runs $499.99 yearly and covers 250GB of storage in the cloud.

Yikes! That’s pricey.

For data protection, I think I’ll just buy another Time Machine drive.

A Note About Sharpcast Photos:

Sharpcast has had a product in the market for a couple years now known as Sharpcast Photos. Focused on synchronizing just your photos between your computers and mobile devices. A subset of what SugarSync provides, to be sure. However, it does not appear that Sharpcast Photos has gained many subscribers. The site https://www.sharpcastphotos.com/ doesn’t even register traffic on Quantcast or Compete.com. Does anyone have any paid subscriber data for Sharpcast Photos?

When Sharpcast Photos was first released, my feeling was that they had priced themselves out of the market. The cost is $5.99/month or $64.99/year, which is a bit steep for just photo protection - especially since the sharing part was limited to their photo sharing service. Perhaps the limited subscriber base backs that up. Anyone?

Tags: Sharpcast, Photos, Sharpcast Photos, SugarSync, Dropbox, FolderShare, Syncplicity,Synchronization, Sync, Brian Berliner, brianberliner

VirtualBox Corrupts My VMware VMDK Files!

I hate it when I’m stupid.virtualbox-logo-1

I started blogging again, and wrote about how I am now using Windows Live Writer as my blog editor. Problem is, that I use Mac computers exclusively, so I needed to run WLW under VMware Fusion (inside a Windows Virtual Machine).

That works pretty well, for the most part, but VMware Fusion does not do copy/paste of images between the virtual machines (yet). And, since I like to include an image with every post, it’s kind of a pain to save the image to a file under Mac OS X only to turn right around and load the image into Windows Live Writer. For me, the writing process is enhanced when friction is removed from the process.

So, I thought, naively, that perhaps the free VirtualBox tool might have this capability. Download the product and install it on my Mac OS X Leopard Server and give it a go. The VirtualBox site says that you can use your existing VMware VMDK (Hard disk image) files with VirtualBox. There is evena video showing you that it works great. The VirtualBox User manual says:

Starting with version 1.4, VirtualBox also supports the popular and open VMDK container format that is now supported by a large number of virtualization products. This means you can import your existing VMDK files by way of the Virtual Disk Manager just like existing VDI images; see chapter 3.5, The Virtual Disk Manager, page 34. While VirtualBox fully supports using VMDK files in most situations, the more advanced features of virtual hard disks are presently not supported.

After trying, and failing, to import my VMDK files into VirtualBox, I found, much to my dismay, that my VMDK files were trashed by the VirtualBox import and no longer readable by VMware Fusion. The term "import" usually implies that it is non-destructive. Nope.

I blamed the Fusion failure on the Apple Security Update that I had just installed. Silly me.

After quite a few hours of reading VirtualBox code and poking around with the VMware VMDK on-disk formats, I was able to "patch" my VMDK files into something that Fusion would once again read. Take a look at the VMware Community Forum article for detailed history.

In the corrupted VMDK that was mucked with by VirtualBox, mine looked like the following:

# Disk DescriptorFile
version=1
CID=4c06b51e
parentCID=f6d5af3d
createType="monolithicSparse"
parentFileNameHint="AmyOffice.vmdk"

# Extent description
RW 41963828 SPARSE "AmyOffice-000001.vmdk"

# The Disk Data Base
#DDB

ddb.toolsVersion = "7362"
ddb.virtualHWVersion = "6"
ddb.uuid.image="309b24ab-4acf-4b11-cbbe-f6935882d848"
ddb.uuid.modification="12ff42d5-f691-4ba3-7abb-6686efa6d59f"
ddb.uuid.parent="00000000-0000-0000-0000-000000000000"
ddb.geometry.cylinders"0"
ddb.geometry.heads"16"
ddb.geometry.sectors"63"
ddb.geometry.cylinders="0"
ddb.geometry.heads="16"
ddb.geometry.sectors="63"

And, it was padded by NULL characters. I extracted it from the VMDK using "dd":

# dd if=AmyOffice-000001.vmdk bs=512 skip=1 count=2 > out

I didn’t like the look of the entries: Note that there is no equals sign between the cylinders/heads/sectors section at the bottom and the values. That did not sit well with me at all. Nor did I like the value of the cylinders was 0 and the heads/sectors did not match the binary values in the first data structure after the MAGIC KMDV in the VMDK file.

Badness.

Comparing this text header info with a very old backup of my VMDK file, it appeared that I could drastically simplify this section.

So, I did.

I edited the "out" file, and made the following changes:

  • Changed the CID to 613506eb
  • Deleted everything after this line (but keep it in): ddb.toolsVersion = "7362"
  • Extended the NULL padding at the end to get the file back up to 1024 bytes exactly.

Then, I patched the VMDK with the following command:

# dd conv=notrunc if=out of=AmyOffice-000001.vmdk bs=512 oseek=1 count=2

Don’t forget the "conv=notrunc", or your VMDK file will be truncated (which I did, and had to copy over from backup again, sigh).

And, guess what? The VMware Virtual Machine booted up with no problem!

I promptly uninstalled VirtualBox. You get what you pay for sometimes.

Now, if I could just get Time Machine to efficiently backup my 30GB Windows VM…

Tags: VirtualBox, VMware Fusion, VMware, Fusion, Virtualization, Open Source, Brian Berliner,brianberliner

Tuesday, March 25, 2008

Brain Fitness Program and VMware Fusion

    

My wife and I listen to National Public Radio almost exclusively when in the car these days. And, living in the Bay Area, you are in the car a lot. Trust me.

So, we make sure to donate to KQED, our local station, every year. And, with that donation, you often get a gift in return.This year, we received Brain Fitness Program Classic.

That’s a fantastic gift, and one that we were certainly looking forward to receiving. Because, hey, we all need to keep our brains sharp, right? We can’t just rely on blogging to do it, can we? No. I didn’t think so.

The product arrived today!

Installation into Windows was a snap, but it wouldn’t run:

The error message is: "Protected program can not be run under virtual machine!"

Now, why would they do that?

So, the problem is that we run our Windows system under VMware Fusion on our Apple iMac computer. Works great and saves electricity (two computers and only one plug in the wall).

However, the fine folks at PositScience that created the Brain Fitness Program seem to specifically check if their application is running on a virtual machine, and refuses to start!

That’s ridiculous.

I now have no way to run the program.

Ridiculous.

Harumpf.

Tags: NPR, KQED, Public Radio, National Public Radio, Charity, VMware, VMware Fusion VMware,Fusion, Windows, Mac OS X, Brian Berliner, brianberliner

Wednesday, March 19, 2008

5 Years In Iraq By The Numbers

Sobering.

Lindsay Campbell and the MobLogic.tv team have done an excellent job putting this summary together. Click here for the video, if the embed below does not work.

Bug Labs at EclipseCon 2008

bug_labs I enjoyed the presentation done by Bug Labs at EclipseCon 2008, titled BUG: A Customizable Hardware and Software Platform using Linux, Java, and OSGi. If you haven't seen the BUG device, you should check out their Products page.

It's Geek Candy.

And, it's entirely built with Open Source goodness - both software AND hardware. Bug Labs gets it!

Start with a BUGbase (which is a full-fledged Linux box on an ARM processor), combine it with a variety of BUGmodules to add various hardware capabilities (like LCD screens, video cameras, GPS devices, accelerometers and the like), and snap it all together to do something interesting. Or, make your own hardware to their spec, and use their software stack. Or, run a different software stack on their hardware. Or, create your own BUGmodule hardware. It's all open. Knock yourself out.

While I find the hardware interesting, I think the truly exciting part of the business is the software components and the dynamic nature that binds it all together.

Yes, it's got OSGi at it's core, including a version of the Concierge runtime!

I think that was a very smart, and bold move. This company may be doing some of the most practical and interesting work in the OSGi space.

This will be a fun company to watch.

spark-capital They are good guys.

Bug Labs is a Spark Capital portfolio company (shout out to Bijan Sabet!).