“Disk is the new RAM”, or is it the other way around

By way of Greg Linden, I just finished watching a tech talk given by Professor Gene Cooperman on “Disk-Based Parallel Computation, Rubik’s Cube, and Checkpointing“.

The part that interested me was Cooperman’s assertion that “disk is the new RAM” if you have enough machines in your cluster, reaching a point where the aggregate bandwidth of the disks reach that of RAM.

The first obvious thing that jumps is that this does not make any sense, while the bandwidth may be the same, the latency is quite different, and will be a performance killer.

Cooperman recognizes that and makes the point that you need to organize your disk accesses to minimize latency, basically avoiding piecemeal reading and going for batch reading. Effectively what you are doing is shuttling data to and from memory in very large batches. (As an aside this is nothing new, the Connection Machine 5 had a similar disk system and I am sure there are other such systems out there).


Apple’s Time Capsule

I was happy to read the review of Apple’s Time Capsule by Robert Mohns for Macintouch.

What really interested me was not so much Time Capsule but the fact that disk I/O was very much improved on the original Apple Extreme Base Station. I had run some disk I/O benchmarks on it and was pretty slow.

ps – Macintouch is a must read for anyone who owns a Mac, it is updated daily, there is a wealth of review and help information as well as

Mobile Monday and the iPhone SDK

I attended the Mobile Monday iPhone SDK Party on monday 24th. The event was fun but packed. I am not sure the Apple folks knew what they were letting themselves in for when they allowed this event to be held in their store.

The Mobile Monday web site has pointers to various recaps of the event along with pictures.

A good friend pointed me to an article about the event on “the Onda by Antonio Rodriguez“, one thing in the article jumped out at me:

…it turns out that the using the radio to send/receive IP packets is relatively cheap from a power perspective, especially when compared to running the CPU at Safari-induced speeds or even keeping the display on for prolonged periods of time.

My experience with power consumption on the iPhone point to a few things which are power hungry. Bluetooth should go to the to of the list, for some reason leaving that on and having a headset paired with it really suck the electrons out of the battery. Second on that list should go Safari and the YouTube application, both are CPU intensive. And third on that list is Wifi which seems to be always on even when the phone is sleeping.

ps – the first presenter at the event was someone called Jonathan A. Zdziarski (also known as “NerveGas”), who recently published an article entitled “The iPhone SDK: APIs Apple Didn’t Want You to Know About“.

Rome API

Recently I have been working on parsing RSS and ATOM feeds, as part of a larger project, and found ROME to be a pretty good toolkit to do that.

JavaWorld has a good article on how to use ROME.

ROME does a good job of hiding the little idiosyncrasies that differentiate different feed types and it also provides a mechanism to access foreign markup in the feeds like the Media RSS elements.

Arthur C. Clarke dies at 90

I was very sorry to read that Arthur C. Clarke died today. The NY Times has a very good account of his life.

I have read all his novels, some more than once. I also remember coming across geostationary orbits (which he discovered) when I was studying physics at school and being surprised at their implications after I worked out the maths for myself.

Smart Sleeping

I have been looking for a utility like this for a while.

Mac laptops have a strange way of sleeping. Unless the battery is close to being completely depleted they will just go to sleep as opposed to hibernate (by hibernate I mean that the contents of the RAM are saved to disk and the machine is actually shut down.) While this may see like a good idea, it does not work well if you want to change the battery without having access to power as the Mac does not go into hibernate mode in a predictable fashion.

So what I have been looking for is a way to make my Mac laptop go into hibernation predictably and I think I may have found it. SmartSleep is a control panel which allows you to control if and how you Mac laptop goes to sleep and/or into hibernation.

State of Perl

Tim Bunce has posted an interesting presentation on Perl 5 and Perl myths.

I have to confess that I have a special affinity for Perl as it was the first ‘scripting’ language I learned, and I have used it extensively over the past 12 years. For example all the index administration code at Feedster was written in Perl, along with lots of parsing and utility libraries, and I always turn to it for all my ‘quick and dirty’ scripts, especially any text processing scripts.