USB Flash Drive Comparison Part 2 — FAT32 Vs. NTFS 198
Dampeal writes "Ok, a little while back I ran a somewhat large USB Flash Drive Comparison with 21 drives compared, today I got part two of that comparison. I've taken the 8gig and 4 gig drives, nine in total, and formatted them FAT32, NTFS and ExFAT and ran all of the tests over again for a comparison of how the file systems work on the drives." Good news — after some exhaustively graphed testing scenarios, the author comes to a nice conclusion for lazy people, writing "[I]n my opinion the all around best choice is FAT32, or the default for most all USB drives out there today, it seems to give us the best average performance overall."
Great (Score:4, Informative)
Re: (Score:2, Funny)
I'm too lazy to even care.
Re: (Score:2, Funny)
I'm too lazy to even care.
Morla, is that you?
Re:Great (Score:4, Funny)
Wow... Neverending Story reference on Slashdot?
Way to make me feel old, asshole. ;)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Hell, I'm too lazy to even read your posts.
Re:Great (Score:5, Insightful)
What about ext2 and other filesystems then?
Installing the ext2 driver? (Score:5, Informative)
What about ext2 and other filesystems then?
Ninety percent of desktop PCs run Windows, and for interchange among the public, file systems that most PCs running Windows cannot read aren't worth testing. If you format your USB drive as ext2 and carry it to someone else's PC, you'll need to 1. carry a CD or a second USB drive with the ext2 driver [fs-driver.org] and 2. get admin rights in order to install it on someone else's PC. It'd be like the Windows 9x days, when you needed to carry a floppy disk with the USB mass storage class driver whenever you used someone else's computer.
You can partition flash drives (Score:4, Interesting)
Re: (Score:2)
Don't bother with vfat, use what is best for your computer. And as an extension of what is stated bellow you can always install drivers for ext2 + a bootable Linux on the flash drive. A whopping 50MB would be needed.
Re: (Score:3, Interesting)
I use USB-pens to securly transfere my data from A -> B, gpg keys, documents, etc. Just because you use your USB-pens to spread viruses between windows pcs doesn't mean everybody does! I'd be quite interested to see ext2 vs reiserfs vs jfs vs fat.
Sync user names? (Score:2)
The biggest difficulty with FAT is the loss of file permissions. 95% of my use of USB drives, is for a quick backup of the day's work, and for moving things around between laptop, desktop, and work machines. I've given up playing tar games, and now just format it ext2. It works transparently on the various linuxies and life is so much simpler.
How do you keep user names/numbers synchronized across different Linux installations well enough for this to work?
Re: (Score:2)
Unfortunately FAT32 is the only universally supported file system. You can be sure pretty much any machine you put your USB flash drive in will read and write it. Most embedded systems only support FAT/FAT32 as well (e.g. TVs, cameras, car head units etc.)
The reason it's unfortunate is that FAT32 is not journalled, so not exactly ideal for a removal storage device.
NTFS probably comes second, since obviously Windows 2000/XP/Vista fully support it and you can at least read, if not write it on Linux/Mac.
Re: (Score:3, Interesting)
Re: (Score:2)
Is there a simple way to format a USB drive as UDF in Windows? Normally you only get FAT, FAT32, NTFS and if on Vista exFAT.
Re: (Score:2)
Re: (Score:2)
Ah, okay, it does not seem to be supported under XP or XP x64 (2003 kernel).
Re: (Score:3, Funny)
Thus Microsoft has the perfect way to EOF XP... Support UDF, Microsoft! It will force people to upgrade! s/force/encourage
Re: (Score:2)
No data points here, but when I formatted my 8GB flash disk as EXT3 (was FAT32), I saw an almost ten-fold increase in transfer speed.
Re:Great (Score:4, Informative)
Define "best". The manufacturers will have selected FAT32 based on compatibility. The test shows that it's a good choice for performance too.
Re: (Score:2)
No JFFS2? (Score:4, Insightful)
Re: (Score:2)
Since interoperability is key in this context, anything besides FAT32 is hopelessly esoteric. So why not test the OSS solution as well?
And I want to know how RAID 9 performs when I plugin my 27 USB sticks. How about that? Why doesn't anybody think about these useful situations?!
Two problems (Score:2)
First: The drives are likely optimized for FAT32. I would not be surprised if they contained very specific optimizations based on knowledge of the internal FAT datastructures.
Second: JFFS2 requires that you actually be able to access the flash device, not some mass storage layer on top of it. And isn't there something newer anyway?
Same applies to SSDs? (Score:5, Interesting)
Don't install your OS on FAT32... (Score:5, Informative)
The question about filesystems has come up a few times over on the Dell Mini forums. Basically the question is which is better to use on machines with SSDs? If you're not dealing with >4GB files, several people have suggested that you're better off formatting the drive as FAT32. I'll need to take a better look at this article when I get a chance, but it seems to be suggesting the same thing.
FAT32 is fine for a USB stick, but you shouldn't install an OS on it. The problem is that FAT32 has no concept of file ownership. So your operating system will be unable to restrict access to files based on the user, which is one of the building blocks of security on any modern OS. This way, any (malicious) process running on the system can overwrite critical system files to do arbitrary damage.
Even if you run windows XP as adminstrator, not all processes on your system run as administrator so you will still be (slightly) decreasing security by having it on a FAT32 filesystem.
Re: (Score:2, Insightful)
Permissions on XP are screwed and hurt more than they help. Being unable to delete/move some files even as Administrator in single user mode is bullshit.
Re: (Score:2)
You might want to scan your computer for SecuROM, then, considering one of it's first priority tasks is to usurp your Administrative privileges.
Re: (Score:2)
Agreed, I had two files left over from installing Bioshock that couldn't be moved if I used a sledgehammer, for all I know. Nothing I did worked and I ended up giving up trying to move or remove them.
Re:Don't install your OS on FAT32... (Score:4, Informative)
Google "unlocker". Very useful tool.
Re: (Score:2)
unlocker (if you use Vista, make sure to set it to run as administrator by default in its properties tab) is great for -unlocking- files that are in use... e.g. some program or service has a file handle open on it.
it does crap all for permissions issues.. so do the actually permissions tools in Windows if the permissions table itself is corrupt (had to remove two folders recently because vista wouldn't even let me change the owner.. teehee)
a boot CD (UBCD / UBCD4WIN) can be *very* useful for these types of
Re: (Score:2)
Boot CDs can corrupt the volume shadow copies because they don't correctly deal with them.
This means you can lose your system restore functionality in one fell swoop.
Re: (Score:2)
Impeach: 1. To make an accusation against.
2. To charge (a public official) with improper conduct in office before a proper tribunal.
We can still Impeach Bush. Doesn't matter if he's sitting President or not.
Re: (Score:2)
No, we can IMPEACH. I can accuse publicly all the fuck I want. Should the judges act on my accusations, THEN they would indict.
Semantics won't work on me. Electronic Arts is finding this out the HARD WAY.
Re: (Score:2, Informative)
This.
While all my computers are part of a domain (so my user name works on all of them and has full rights), I sometimes have problems with hard drives that I connect from other (people brought me to reinstall Windows). Now, ideally I would connect the drive to my PC, if the drive has enough free space left (>3GB), I would just move all current directories to a new one, say c:\__old, then install Windows. The owner of that PC would save what files are important to him and delete the rest of __old. Howeve
Re: (Score:2)
Taking ownership alone may not be sufficient, because the ACL for a file can specify "deny write" for the owner as well (just like it can on any Unix system). So you need to take ownership, and then to give yourself full rights for the file (which is something that you can only do as an owner), and only then you will definitely be able to delete it. Some Vista syste
Re: (Score:2)
Another issue for a lot of people is that FAT32 does not support Unicode for file names. In other words, if your Windows system is English you can't save files with Japanese names on a FAT32 drive.
NTFS and ext2 fully support Unicode. I usually use Unicode on my flash drives, and despite what the article suggests it does not seem to affect performance noticeably.
Re: (Score:2)
Why does this have to be ingrained into the file system? Why can't it just be as simple as not allowing non-system processes to write to system directories like C:\Windows?
Re: (Score:2)
The differences between filesystems is not that surprising and you can see a common trend across all of the USB flash drives. This is a good heads-up comparison of the filesystems.
I have a great interest in the differences between manufacturers and models of the flash-drives. You can clearly see who is using faster chips and who is using the dregs out of a bucket full of memory chips. The filesystem comparisons are dwarfed by the hardware speed.
Once a USB flash-drive is put in a convenient plastic case no-o
not so fast (Score:5, Informative)
Re: (Score:2)
You mean like exFAT? Which, as far as I'm aware, is basically just FAT64. I.e. it's got all the "benefits" of FAT32 without the filesize limit, probably at the cost of a bit of performance.
Re: (Score:3, Informative)
Re: (Score:2)
I'd wager that it's more compatible than NTFS, though.
Still, it's not ideal and I agree with what you're saying.
Re:not so fast (Score:4, Informative)
Re: (Score:2)
NTFS patten? (Score:3, Interesting)
Re: (Score:2)
Do you mean "patent"?
Re:NTFS patten? (Score:5, Funny)
Re:NTFS patten? (Score:5, Funny)
He did, unfortunately there is a patten on that word.
Re: (Score:2)
It only has a patent on it if you say it like the British do: "pay-tent". If you say it like a true American -- "pah-tent", then there's no law broken.
Re: (Score:2)
thats patently ridiculous. patent(law) and patent(obvious) are totally different words. The law is said pah-tent the obvious is said pay-tent
Re:NTFS patten? (Score:5, Funny)
You clearly mean treadmark. Which may have been left by a Patton, if he ran over your flash drive with his Jeep.
Re: (Score:2)
Actually I did write Patton the first time, and then I changed it to patten.
Which is apparently a type of shoe.
Question (Score:4, Funny)
Re:Question (Score:4, Funny)
Better question: Will the USB drive die faster with ReiserFS?
Re:Question (Score:4, Funny)
You might have trouble finding your files on ReiserFS.
Nah, you just have to dig around a bit in the directories. They're rarely very far from where you last saw them.
Re: (Score:2, Funny)
Another Linux-related question: If I format the USB drive with ReiserFS, am I restricted to using it only in a chroot jail?
Re: (Score:2)
Size matters (Score:2)
Did he run tests with 16GB files?
Re:Size matters (Score:5, Informative)
FTA: "I've taken the 8gig and 4 gig drives, nine in total"
FTA: "I used a 350MB
More importantly, he couldn't use a 16GB file, since FAT32 doesn't support single files over 4GB.
Re:Size matters (Score:5, Funny)
Did he run tests with 16GB files?
...
More importantly, he couldn't use a 16GB file, since
FAT32 doesn't support single files over 4GB.
And because 4GB drives don't support files over 4GB.
Re: (Score:2)
Actually, with an appropriate filesystem they might - sort-of. I believe that newer filesystems can record the presence of zero-filled blocks without allocating the blocks. So, you could have a 1TB file full of zeros that takes just one inode or something along those lines.
Re: (Score:2)
Sparse files have existing since forever.
Re: (Score:2)
I understand, but then you are using the fs to do transparent compression. That argument fails in this case because filesize=size_on_disc. Otherwise you could argue that a 3mb mp3 is really a 30MB .wav file...but it's not, it is a compressed file.
Re: (Score:2)
Did he run tests with 16GB files?
FTA: "I've taken the 8gig and 4 gig drives, nine in total"
FTA: "I used a 350MB .AVI Video file for all testing.".
More importantly, he couldn't use a 16GB file, since
FAT32 doesn't support single files over 4GB.
Which is a real shame since I was really looking forward to seeing his technique for fitting those 16GB files on 8 or 4GB drives. Curse you Microsoft !
Re: (Score:3, Interesting)
True, but it will happily install (at least using the Linux Kernel's driver for it) on any size drive. I did that a few years ago for a backup drive that had to be accessible from Linux as well as Windows. Windows would only allow the FS to format to 32GB; while the Linux driver let it take up the whole drive (120GB? can't quite remember). The real funny thing was that Windows was happy to work with the drive afterwards and didn't complain whatsoever about the l
incomplete tests (Score:4, Interesting)
Re: (Score:2)
I have seen a couple of problems with FAT based flash drives.
What happened in both cases was that the files got "locked", and couldn't be deleted on OSX and Linux, but a fsck fixed the issue.
Re: (Score:2)
I've been around a while. Let me tell you, there are many ways to screw up a FAT-formatted volume, most especially the computer powering off in the middle of a write. I've had far fewer problems in that regard with NTFS, probably because NTFS is journaled.
Re: (Score:2)
Over all, I'm a little embarrassed to be talking about which is better: NTFS or FAT32. ext3 is bett
Re: (Score:2)
Ugh... FAT32 is so much more likely to lose data compared to NTFS (which is journaled). (My only data loss due to a screwed up FS is due to FAT32 going crazy.)
(Either way, I always setup my flash drive
What about UFS? (Score:2)
Would one of the UFS variations be suitable for flash drives? And also better portability (almost all OS's support UFS by now). Would performance be better?
Re: (Score:2)
Actually I meant UDF.
Read vs Write (Score:3, Interesting)
I wonder what makes NTFS so slow for writes? The journaling alone reduces it that far?
Re: (Score:2)
Re: (Score:3, Interesting)
I'd guess it's because NTFS sucks on a removable device. On Windows, by default, hot pluggable devices are mounted with write through caching. NTFS supports this but not very efficiently.
FAT32 and exFAT are simple enough that you can do safe access to a disk even without much write caching. FAT (and probably exFAT) actually defines a way to mark the volume as dirty in the first FAT entry at the start of each transaction where the FAT will be modified.
If someone pulls the drive right in the middle of writing
Important for me (Score:5, Interesting)
I'm currently on site at a customer's office. I have one of their PCs and one of ours; legal restrictions mean I can't copy our source onto their machines or their source onto ours.
The solution to this is to put a copy of our source onto a USB stick and plug it into their machine, and then use a NTFS junction point (aka a symlink) to let their Windows-based build system see our source. This works very nicely, and I can just unplug the USB stick whenever I leave and the lawyers are happy.
However:
- I have to use NTFS. This is because the two machines are set to use different time zones, and frickin' FAT stores timestamps in the local time, which means that if I were to touch a file on one machine and the move the USB stick, the build system will go horribly wrong.
- I have 'optimise for performance' turned on; the non-Windows world calls this write caching. This boosts performance on NTFS *hugely*. I see no mention of this in the review. I now have to remember to unmount the stick on the Windows machine before pulling it, but it's worth it.
- You have to use the command line format.exe to format a removable drive as NTFS, because frickin' Windows doesn't let you do it from the GUI.
- If you turn NTFS compression on, you get a tiny bit more speed boost. But while Linux will read compressed NTFS files, it won't write them.
- You need to do something obscure with NTFS file permissions if you're going to move the stick between two Windows machines, because otherwise you'll be creating files on one machine you won't be allowed to edit on the other. Linux, of course, just ignores NTFS ACLs.
I have investigated the Windows ext2 driver, but while it does work reasonably well, it's still pretty clunky, and ext2 isn't much better than NTFS. What I'd really like is a decent Windows JFS or XFS driver --- NTFS is *so* last century.
You have to use the command line format.exe (Score:4, Informative)
Select the usb drive right click/hardware/policies select optimize for performance and the GUI formatter will now have NTFS as an option.
After formatting you can reset the policy as needed.
I personally turn optimize for performance off on USB drives as many times explorer or some other program will lock the drive preventing a safe removal.
Re: (Score:2)
How do you figure? Run diskmgmt.msc, right click on drive in question, "Format..." etc. Defaults to NTFS for me.
Slashdotted (Score:2)
Since the article is /.ed and I can't RTFA anyway, a question: I'm about to have a user start backing her files up to a 32GB USB stick. Probably no huge movie files. Should I format the stick as NTFS or exFAT (she's running Vista SP1)?
Re: (Score:2)
According to the benchmarks, exFAT. If you trust it not to die a horrible death and to be readable anywhere else.
NTFS Permissions/Speed (Score:2)
Filesystem for Slashdotters (Score:3, Interesting)
I don't care for compatibility with Windows. I use exclusively free *nixes and so does all my friends (otherwise they wouldn't be real friends, would they?). So having this richer buffet of file systems than just the two in the article, what should I choose? I have heard someone say that ext2 means less wear on the drive than ext3 (something with journaling?).
Re: (Score:2)
FAT32 and MS Backup (Score:2, Informative)
Since many folks use their usb devices as backup media, it should be noted since fat32 has a file size limitation of about 4gb, fat32 is not an option if you wish to use MS Backup utility to create backup images larger than that.
The first two things I look for in a jump drive (Score:2, Interesting)
(2) Can I attach it to my keyring? (no silly lanyard clips please)
Both far more important to me in daily use than a 20% speed difference between one drive and another.
It's not like I'm running terabyte database sorts on these little guys.......
Re: (Score:2)
Very strange use of colours in the graphs (Score:2)
I'm sure i cant be the only person who noticed this, but in many of the graphs TWO of the bars were coloured white with the other being red/green or whatever, not just that but they colouring seemed to be switched at random.
That's a huge usability failure!
VFAT? (Score:2)
Why not VFAT? Or are these only windows formated filesystem types?
Re: (Score:2)
VFAT is FAT16 with long file names. FAT16 is limited to 2GB partitions and I'm sure the max filesize is much less than that.
So unless you're sticking with really small USB sticks, that's right out.
Flash comes in =CLASSES= (Score:2)
Different grades of flash memory are available, visible to the consumer as the "Class" rating on SDHC cards (SD above 2 GB capacity). You can buy unrated, Class 2, 4, 6 and sometimes 8 MB/s nominal serial block write speed. These rating are very important for digital camera performance.
Did you try any of the Classed SD cards in a fast USB adapter (not all are fast) to establish some watermarks for what class flash chips the labels are hiding?
Re: (Score:2)
Re: (Score:2)
Given a big enough partition table, I could put 125 ProDOS partitions on that (4 GB / 32 MiB).
Re: (Score:2)
Given this comment, I certainly hope your username is meant to be ironic.
Re: (Score:2)
What, you think an Apple II can't use USB? [engadget.com]
Re: (Score:2)
BECAUSE IT'S THERE!
Obviously.
Re:Choose NTFS for the life of your drive (Score:4, Informative)
Flash drives have a flash translation layer that makes the flash look like a regular disk despite having special properties. This layer handles the wear-leveling, garbage collection, and bad block detection so the standard filesystem (that was designed for magnetic disks, probably) doesn't have to consider them. Regardless of the filesystem used, the wear of the device should be related to the total amount of data written, not the location of the data.
Re: (Score:2)
Accesses don't wear flash significantly compared to writes. Heavily read pages of NAND flash do need to be rewritten occasionally, but I can't imagine this alone would ever cause a device to reach its wear limit in normal use. NTFS does write more than FAT32, so you're still correct that FAT is better for reducing wear. FAT's fault tolerance is notoriously bad though.... would you rather lose your data or have to replace a $20 usb stick (which will probably be $2 by the time you wear it out)