Performance Showdown - SSDs vs. HDDs

Lucas123 writes "Computerworld compared four disks, two popular solid state drives and two Seagate mechanical drives, for read/write performance, bootup speed, CPU utilization and other metrics. The question asked by the reviewer is whether it's worth spending an additional $550 for a SSD in your PC/laptop or to plunk down the extra $1,300 for an SSD-equipped MacBook Air? The answer is a resounding No. From the story: "Neither of the SSDs fared very well when having data copied to them. Crucial (SSD) needed 243 seconds and Ridata (SSD) took 264.5 seconds. The Momentus and Barracuda hard drives shaved nearly a full minute from those times at 185 seconds. In the other direction, copying the data from the drives, Crucial sprinted ahead at 130.7 seconds, but the mechanical Momentus drive wasn't far behind at 144.7 seconds."

bad test

[Werrismys (764601)]

In typical use most of the time is spent seeking, not just reading or writing sequential blocks. The Windows XP disk IO is especially brain damaged in this regard (does not even try to order or prioritize disk I/O). Copying DVD images from one drive another is not typical use case.

Re:bad test

[SanityInAnarchy (655584)]

Consider, also, that when you're doing anything other than the contrived "copy from one device to another"... HD-DVD has a minimum guaranteed throughput of something like 30 mbits, Blu-Ray needs 50. It looks like the worst numbers on the solid state devices were still at least some 30 megabytes per second, meaning you could play five Blu-Ray movies at once.

Skimming the article, it seems very likely that the person responsible has read just enough to be dangerous (they know the physics of why seeking is slow), but not enough to have a clue what kind of behavior would trigger seeking. The one measure was boot time, during which they acknowledge that Vista does a bunch of background stuff after boot, but don't measure it.

He did get one thing right, though -- they are not exactly living up to their potential. For one thing, there are filesystems explicitly designed for flash media, but you need to actually access it as flash (and the filesystem does its own wear leveling) -- these things pretend to be a hard disk, and are running filesystems optimized for a hard disk, so the results are not going to be at all what they could be.

Re:

[Dirtside (91468)]

meaning you could play five Blu-Ray movies at once

I think someone's just invented a new metric unit for measuring bandwidth!

Re:

[peipas (809350)]

Anecdotally, I have a 32 GB SSD in my Dell M1330. I got stuck with Vista with this machine, but in its "User Experience" rating I get a 5.8 for hard drive. The scale is based on 5.0 being the fastest available at Vista's release. I assume "fastest" refers to consumer machines, but have conventional hard drives somehow become that much more efficient all of a sudden that they meet or exceed this performance?

Re:bad test

[ThePhilips (752041)]

XP IO subsystem is pretty OK.

The problem with SSD is that flash based storage has much much higher block size.

While conventional HDDs have block size 512 bytes, actual SSDs have block size of 64 kilobytes.

Not only Flashes write relatively slow, but if file system has e.g. cluster size of 8K, every write to it in worst case would also (re)write redundantly 64K-8K=56K.

Test is realistic - if you want to see how bad most applications can be with SSDs. But that's going to change with SSD becoming more and more common place.

If they really wanted to test SSD performance they would have taken Linux with jffs2 or newer logfs. Though this two have their own problems.

Solutions for hybrid disk setups?

[dubl-u (51156)]

If they really wanted to test SSD performance they would have taken Linux with jffs2 or newer logfs.

Does anybody have a decent solution for using a flash drive to boost performance of a regular drive?

I just ordered a new laptop, and it has an ExpressCard slot into which I could drop 4 or 8 GB of solid-state disk at a reasonable price. That could serve as a giant cache, one that unlike RAM could be safely used as a write cache.

It seems like there would be a clever way to treat the SSD plus the regular hard drive as one unit so that the hard drive could be spun down for hours of normal working situations,

Untested performance...

[smitty97 (995791)]

Unfortunately there's no comparisons of battery life and speed tests with fragmented files.

Re:Untested performance...

[Ethanol-fueled (1125189)]

...And the picture won't be complete until we have real-world failure data for the solid-state drives.

Definitely not enough data

[DrYak (748999)]

...And the survivability of mechanical drives in the ultra-portable form factor (more likely to be droped or tossed, more concentrated heat problems, etc.)

Although some data from the Palm LifeDrive (featuring a mecanical Microdrive CF module) could answer the drop-survivability in small form factor.

So, in short, they managed to produce only 1 single data i.e. bulk speed (well, not exactly. They also mentioned random access from a synthetic test, but no actual real-world application) when users would need ab

Re:And some drop tests, and airport scaner tests,

[CommanderData (782739)]

Well, I can supply my own experiences for you, after using a 32GB Samsung SSD for a year, and a 64GB Samsung SSD for several months...

1) Mine have been formatted NTFS, running Windows XP (and additionally Apple HFS Journaled recently when experimenting with OS X). I do not defragment the SSD, there is no point. Read speeds have always been better than write speed, but I see no difference in performance over time.
2) Both of the drives I have are fully functional, even though I abused the 32GB one mercilessly. That laptop has only 1GB of RAM and I would run so many programs that things were swapping constantly for the past year.
3) The 32GB SSD has been through airport scanners approximately 50 times now, no problems. The 64GB is too new, only travelled a few times so far.
4) My laptops are always on the go, brought into many factories as a consultant. While in my bag it has taken falls down sets of stairs. The laptop itself (a Fujitsu P1610) has been dropped from a height of 3.5 to 4 feet onto a metal catwalk while running with no adverse affects (other than a few scuffs and dents on the corners).
5) Not sure how well they stand up to static, but it has stood up well to a variety of high EM fields, and high/low temperatures. No data loss. I have had regular hard disks die from working next to large transformers (and their magnetic fields) for an afternoon.

Hope that helps you. For my line of work, they have been incredible. I used to go through 3 or 4 laptop hard disks per year due to various issues. Now the only reason I bought the 64GB SSD is increased storage capacity.

Re:

[MightyYar (622222)]

But does this justify the extra money... no.

That is one thing that cannot be tested - the value of better battery life and faster seek times is subjective. The market will make the best test of whether these things are worth the price.

Re:

[plague3106 (71849)]

Well, if it takes a full minute more for the SSD vs. the HDD, you may lose any battery savings... since you're powering the SSD for more than one minute.

Noise? Heat?

[pipatron (966506)]

Dunno about the author of this article, but got an "SSD" (hello buzzword) to get rid of the noise, the heat, and the annoying spin-up delay. A compactflash card doesn't cost eleventy billion dollars either.

Re:

[NeutronCowboy (896098)]

Not to mention shock-insensitivity and power consumption. Write speed to me is fairly irrelevant by now.

Re:

[winkydink (650484)]

I haven't used any swapspace for years on my desktops, memory is so cheap now that there's no point. On my servers, of course, but then again it's 99.9% unused.

For example, this thinkpad has 1.25GB RAM, and I've seen at most 300MB used. Then again, I don't run Vista.

You don't run Firefox either then..

Buzz

[esocid (946821)]

It's nice to know all that buzz is worth ignoring since I just bought a fancy new 750gig sata hdd. Even 16mb caches beat them solidly, I wonder how 8 and 32 would compare. It's worth noting they didn't mention seek times, although I'm not sure how that would transfer into ssd terms.

Not very good reasons...

[MrKevvy (85565)]

Computerworld compared four disks, two popular solid state drives and two Seagate mechanical drives, for read/write performance, bootup speed, CPU utilization and other metrics.

But of course not the metrics that really matter, which SSD's vastly excel at and make them worth the price for many people: MTBF, power consumption, ruggedness and noise level.

Re:Not very good reasons...

[Mordok-DestroyerOfWo (1000167)]

If I remember correctly the first LCD monitors were exorbitantly expensive and couldn't hold a candle to their CRT brothers. But since they saved so much space and energy, within a few years those problems vanished. I'd say it's still too early to close the books on SSDs.

I know it's not a car analogy, I humbly beg the forgiveness of the /. community.

Re:

[MightyYar (622222)]

I know it's not a car analogy, I humbly beg the forgiveness of the /. community.

SSDs are just heated mirrors in a fancy 2.5" form factor.

Power Consumption

[Ironsides (739422)]

Too bad he didn't include power consumption. If I'm going to use an SSD for anytime soon, it will be in a laptop where power is my key concern. Performance is more of a desktop/high end issue right now.

Re:

[NormalVisual (565491)]

In addition to power usage, some measure of how warm they get under load would be useful too.

Performance is not the key to SSD

[avdp (22065)]

IMHO, performance is not the critical factor regarding SSD. Power usage, and mostly no-moving-part (quiet and rugged) is why you want SSD in your laptop.

But on the performance front, they compared with 7200RPM hard drives, last time I checked (admittedly a while ago) most laptop are outfitted with 5400RPM drives.

Re:Performance is not the key to SSD

[Sancho (17056)]

http://www.appleinsider.com/articles/08/02/07/macbook_air_hdd_and_ssd_battery_benchmarks.html [appleinsider.com] indicates that the battery usage (at least compared to the HDD shipped with the Macbook Air) is negligible. No moving parts is nice, though manufacturers have addressed some of the ruggedness issues by including drop sensors. Actual, real world wear hasn't had a chance to surface yet--I'll definitely be curious to find out if SSDs live up to the speculation.

Re:

[esocid (946821)]

Most probably were, but the two they compared the to are laptop hdds. Since the comparison is talking about Macbook Air, I looked at the specs:

Apple MacBook Air - 1.6GHz OS X 10.5.1 Leopard; Intel Core 2 Duo 1.6GHz; 2,048MB DDR2 SDRAM 667MHz; 144MB Intel GMA X3100; 80GB Samsung 4,200rpm

The stock hdd is 4200rpm so even that 5400 figure you had was over the stock drive speed. So they should have compared those two options as well as what they did to get a good idea. As well as including drives with 8mb and

Why a "drive"?

[Ossifer (703813)]

Am I the only one questioning why these devices are implemented using a mechanical drive interface? Maybe it's a negligible cost, but to me it would seem that a memory bus optimized for flash memory would be a better way to go, than trying to piggy-back a mechanical drive's bus. How much faster could these be if their existence was planned into, say Intel's chipsets?

Re:

[Wesley Felter (138342)]

We'll find out soon, since Intel is adding a flash controller to its chipsets.

Re:Why a "drive"?

[Alioth (221270)]

Well, the IDE bus isn't mechanically oriented anyway - we don't actually use cylinders, heads and sectors (and haven't for years), we use block addressing and the drive electronics has figured out how to move the mechanics. Block addressing isn't all that far off from addressing an individual byte in memory anyway - except you're addressing a whole block rather than a single byte (and for mass storage, whether it's mechanical or flash, you're going to want to do it that way so you don't have an absurdly wide address bus). Parallel ATA uses a 16 bit wide data bus.

Re:

[Ossifer (703813)]

Thanks for the information and insight, but I wonder, why wouldn't we want a (maybe not "absurdly") wide address bus? A 16-bit wide bus seems a bit underscaled, considering core memory buses are 128 bit, and with block addressing we're obviously reading/writing much more than that. The core memory bus is already 16 times bigger than the smallest addressable unit. Granted, with say a 512-byte block, I'm not suggesting a 64k bit wide bus (16 * 512 * 8), but it would seem that 16 bit is simply not a good ch

Stupid Test

[phantomcircuit (938963)]

They only tested burst speeds, there was no random access testing.

SSD works best when accessing files randomly.

Re:

[Sleepy (4551)]

+1

This is like a hybrid vehicle vs normal gas shootout, with each vehicle towing something. It's irrelevant.

He boiled down all the variables and performance profiles into just one - the one that favors traditional drives. There is NO WAY this should have been published as-is.

I can't attribute this to malice, but basically Bill O'Brien of Computerworld DOESN'T KNOW WHAT HE'S DOING, and neither does his editor for letting this slide. This was probably a case of a traditional drive maker whispering in his ear

I've seen this before.

[jskline (301574)]

You really have to look deep into the advertising sometimes. Only a trained person willing to do the math on these would be able to see the differences. Clearly, these devices have a legitimate purpose and place, but at this point in time, its not in the client computer. The speeds need to come up to be really practical.

Now a good purpose for these might be in desktop bound short-stack storage arrays instead of that large tera-byte drive array. They're just quick enough for data retention backups off of the mechanical drives in the client PC.

Another use is small-scale server apps that usually are bound into hardware in some form of internet controllable appliance. Speed isn't really a major factor here for this and these would potentially work well.

Just my opinion. Subject to change.

SSDs are ideal for servers

[ncw (59013)]

As any sysadmin knows, on a busy server what creams the disk isn't Megabytes per second, it is IO transactions per second.

According to the article the Crucial SSD has an access time of 0.4 ms which equates to 2500 IOs/s as compared to the Barracuda HDD with 13.4 ms access time which equates to a mere 75 IOs/s.

So for servers SSDs are 33 times better!

Bring them on ;-)

Re:

[Bill, Shooter of Bul (629286)]

Exactly. I guess the point of this article was to examine weather or not it made sense in the case of a laptop,as many are now starting to offer one as an option. But it would have been nice to point out the real awesome potential they have for servers.

Re:

[Uncle Focker (1277658)]

Have fun changing out the drives every year as you've surpassed the maximum number of writes.

Re:

[mapsjanhere (1130359)]

Well, they would be if they had unlimited read-write cycles. But flash is rather more limited in that regard, some estimates are as low as 100,000 cycles.
If your 2500 IOs/s hit the same sector, your server SSD is fried in 7 min. SSD are distinctively NOT server suitable if you have a lot of write cycles (probably less of an issue if it's just answering read requests).

What about the power usage?

[wiredog (43288)]

That's the (potentially)biggest benefit of using SSDs over HDDs. No moving parts==less power used==longer battery life.

Re:

[Overzeetop (214511)]

That's true, but is almost a technicality with today's processors and video cards. With anything but the slowest ultra-portables, having a hd running just doesn't suck up much juice. A Seagate Momentus (5400rpm) takes between 1.9 and 2.3W when reading/writing/seeking, and only 0.8 watts when idle (not standby - that's .2W). Given a typical laptops with between 50 and 80 Wh batteries and a 2 to 3 hour charge life, you're HD comprises about 3% of the average draw at idle, and about 7-8% at full tilt - for th

it's all about the battery

[Khopesh (112447)]

SSD's performance boost is in battery life due to its lower power consumption from zero moving parts. Flash-based storage has always had a problem with writing; don't forget about the fact that it can only be written to ~1000 times.

Furthermore, SSD is just temporary relief for batteries; I envision a laptop with both SSD and HDD that almost never writes to the SSD; on Windows, C:\WINDOWS and C:\Program Files would live in SSD while C:\Documents & Settings would live on HDD and C:\WINDOWS\Temp (or whe

Re:

[Alioth (221270)]

That's not correct: even NOR flash (what you use for ROM, rather than mass storage) has been rated at 10,000 erase/write cycles for years - per sector (rather than the whole device). The typical flash mass storage is up to 100K erase/writes.

Swap is the main concern here - the solution is to give the machine enough RAM that you can turn swap off.

Re:

[Uncle Focker (1277658)]

Flash-based storage has always had a problem with writing; don't forget about the fact that it can only be written to ~1000 times.

You're a few orders of magnitude off. It's around 400-500 thousand reads for average flash drives. The more expensive, high performance stuff can max out at a few million writes.

Not surprising or bad to me.

[alan_dershowitz (586542)]

Two things: first, booting is ideally going to be largely sequential reads because OS X caches files used in the boot process in order to speed up the boot by removing random access. SSD's have an advantage over hard drives in random reads because there's comparatively no seek time. So I wouldn't expect to see a huge advantage. Secondly, I'm not going to be using my macbook air's tiny SSD drive for analog video capture or something anyway, so high write speed is really not that relevant to me. On the other hand the thing is supposed to be light and use little battery, so SSD seems like it wins for the reasons it was used. Also, the tests bear out a higher average read speed, which is also what I would have expected. I don't see anything surprising here.

What about battery life?

[dpbsmith (263124)]

I would have thought that in a laptop, solid state drives would have a noticeable advantage in terms of power consumption leading to increased battery life.

Admittedly the article described itself as a performance showdown, but I'm disappointed that the reviewer made no attempt to compare power consumption and battery life.

If nothing else, I would have thought a solid state drive would eliminate that annoying pause when a hard drive awakes from sleep and spins up, and that this would feel like a worthwhile "

Seek Times Make the Difference

[pancrace (243587)]

We installed one of these for processing millions of small, read-only database transactions. The database only gets written once a day, but is too big for efficient cacheing. Even with a U320 15k drive we were still suffering, only being able to run about 700/min. With a flash drive, we're running over 25,000/min, peaking at 50,000/min. But the weekly copy of the database takes about 20 minutes, vs the 3 or 4 minutes it used to take.

- p

Vista for performance testing?

[Matthew Weigel (888)]

That just seems silly. I'd like to see performance tests on a system where the disk's performance affects the end result, rather than all of the results being homogenized by the operating system's poor I/O capability. Given Vista's adoption, it's not even a test of what disk performance will be like "in the real world."

How Flash SSDs Work and How They Can Work Better

[DDumitru (692803)]

My apologies for a long post. There will be some adverts embedded, but I will try to keep things informative.

The reason that Flash SSDs act "wierd" in benchmarks is that they have asymmetric performance patterns when reading and writing. Particularly with random operations, this asymmetry is huge. Here are a couple of example "drives":

* Mtron 7000 series: >14,000 4K random reads. ~130 4K random writes.
* SanDisk 5000 series: ~7,000 4K random reads. 13 4K random writes.
* Cheap CF card or USB stick: ~2,500 4K random reads. 3.3 4K random writes.

This is a 100:1 performance deficit when doing random writes versus the random reads. This has some really weird impacts on system performance. For example, if you run Outlook and tell it to "index" your system, it will build a 1-4 GB index file in-place with 100% random writes. If you do this on a hard disk, the job takes a long time and drags down your laptop, but the operation is still pretty smooth. Do the same think on an SSD and the system slugs to molasses. One of our customers described it as "totally unusable" with 2+ minutes to bring up task manager. What happens is that the fast reads allow the application to dirty write buffer faster and this then swamps system RAM, you get a 100+ deep write queue (at 13/sec), and you want to throw the machine off of a bridge.

This fix as some have described it is not some magic new controller glue or putting the flash closer to the CPU. It is organizing the write patterns to more closely match what the Flash chips are good at. Numerous embedded file systems like JFFS do this, but they are really designed for very small devices and are more concerned with wear and lifespan issue than performance.

Now here comes the advert (flames welcome). A little over 2 years ago, I wrote a "block translation" layer for use with Flash storage devices. It is somewhat similar to a LogFS, but it is not really a file system and it does not play be all of the rules of a LogFS. It does however remap blocks and linearize writes. Thus it plays well with Flash. It also appears to be an "invention", and thus my patent lawyer is well paid.

The working name of the driver layer itself is "Fast Block Device" (fbd) and the marketing name is "Manged Flash Technology". And what this does is to transparently map one block device into another view. You can then put whatever file system you want into the mix.

In terms of performance, it is all about bandwidth. Build a little raid-5 array with 4 Mtron drives and you will get over 200 MB/sec of sustained write throughput. With MFT in place, this directly translates into 50,000 4K random writes/sec. Even better, you tend to end up with something that is much closer to symmetric in terms of random read/write performance.

MFT is production on Linux (it has actually been shipping since last summer) and is in Beta test on Windows. It works with single drives as well as small to medium sized arrays. It does work with large arrays, but the controllers don't tend to keep up with the drives, so large arrays are useful for capacity but don't really help performance a lot. Once you get to 50,000 IOPS it is hard for the controllers to go much faster.

Consumer testing with MFT tends to produce some laughable results. We ran PCMark05's disk test on it and produced numbers in the 250K range. This was with a single Mtron 3025. Our code is fast, but we fooled the benchmark in this case.

There are several white papers on MFT posted in the news link of our website:

    http://managedflash.com/ [managedflash.com]

My apologies for the advert, but I see a lot of talk about SSDs without actually knowing what is going on inside.

I am happy to answer any questions on-line of off.

Doug Dumitru
EasyCo LLC
610 237-2000 x43
http://easyco.com/ [easyco.com]
http://managedflash.com/ [managedflash.com]
http://mtron.easyco.com/ [easyco.com]

2nd Gen SSD benchmarks.

[v(*_*)vvvv (233078)]

All the brand notebooks with SSD options use first generation SSDs. These have the shattering access speeds, high durability, no noise, and power efficient benefits, but read/write performance is still mediocre.

The second generation SSDs would cost you more than a whole notebook, but have significant performance improvements:

Memoright GT vs Mtron vs Raptor vs Seagate [benchmarkreviews.com]

Memoright nails it. It is easily twice as fast as what Mac puts in their notebooks.

If you *really* want an SSD, buy one separately and install it yourself. You will not be disappointed.

BTW the file indexing that causes SSDs to slow cause HDDs to slow as well. Many people have reported unbearable slowdown, and that is with HDDs. I am sure anything slower than that would make you want to return the whole thing, but this can be fixed. Most people will tell you to just turn it off [4sysops.com]. Google has also complainted about Microsoft pre-installing an indexing system that sucks [nwsource.com].

Re:

[alan_dershowitz (586542)]

For files that aren't huge, the operating system write caching should already speed up this operation. Regarding what you asked about, that almost sounds like it could be a specialized modification of RAID-1, which would be cool.

Re:

[T-Bone-T (1048702)]

There are already drives that have platters and flash. They cache frequently used files in flash and bootup files when you shut down.

Re:

[Belial6 (794905)]

Huh. I've always thought that the cache on Hard drives was amazingly small. 16MB? Heck, give me a drive with at least a gigabyte of cache. When I boot up my computer, it should just start reading any sectors that have been used frequently.

FUD

[MushMouth (5650)]

Wrong, this myth simply will not go away. All modern drives have write leveling technology built in. Also unlike a mechanical drive which generally fails on read, SSDs fail on write which allows the drive itself to trap all failures, and redirect the bytes to another unused sector. Anyone who care about performance shuts off atime as it is.