Most CF Cards Fail DMA Transfers 140
Anomalyst writes "In his quest to create an open source video camera, Andrey Filippov of elphel.com has determined that most Compact Flash devices, although claiming to be DMA capable, do not perform Direct Memory Access transfers correctly. This means successful movement of data to and from the device takes much more time with DMA disabled." The culprit appears to be the controller chip packaged with most of the CF cards Filippov tried. We last visited Elphel and their work on open source digital cameras in 2002. Filippov gave a Tech Talk at Google last year.
Creative (Score:4, Insightful)
Re:Creative (Score:4, Informative)
It's pretty fascinating how the company that appears to be the market leader is also the worst in terms of actually delivering a good sound card. Then again, maybe it shouldn't surprise me since they're also the biggest liars. I got bitten twice.
NEVER AGAIN
Re: (Score:2)
Re: (Score:2)
You wouldn't have been happy if you bought the Audigy LS when it was new and then Creative didn't make drivers that worked with XP SP2 until Vista was released. Not to mention the fact that after those drivers came out, it wasn't compatible with 2.1 speakers in hardware mode; it would only do surround sound.
Repeated contact with Creative changed nothing; their only answer was reseat the card, reinstall drivers and so forth. I did all of that many times, and they never cared to do anything about it.
Now I hav
Re: (Score:2)
You wouldn't have been happy if you bought the Audigy LS when it was new and then Creative didn't make drivers that worked with XP SP2
That's why I bought the Audigy SE for $30, I noticed it was more akin to the Live! series then anything else. So I knew what to expect and I really couldn't justify spending any more on features I wouldn't use or a handful of frames per second I won't notice.
Re: (Score:3, Informative)
Market leader? (Score:2)
Re: (Score:3, Interesting)
It's like the difference between an onboard video setup and a "real" one. People who need more features always have to pay a little more for them.
Re: (Score:1)
No.. there is a difference. Onboard video isn't powerful enough to play most new games at any decent frame rate. My onboard sound doesn't prevent me from playing any games.
I think it is more for audiophiles now.
Re: (Score:2)
For gamers, there is a massive difference.
DICE's Battlefield 2 uses EAX to provide detailed positional audio on X-Fi cards.
I have played a fair amount of Battlefield 2, around 400 hours. About half way through this, I upgraded from onboard audio to an X-Fi Fatal1ty. My Kill to Death ratio went up by about 25% within a few days.
For me, the stats speak for themselves. Same applies to Race Driver GRID currently... there is no need to use the mirrors if you have reasonable hearing.
I understand this can be done
Re:Market leader? (Score:5, Funny)
I upgraded from onboard audio to an X-Fi Fatal1ty. My Kill to Death ratio went up by about 25% within a few days.
NEVER underestimate the power of.... Celebrity Endorsement !
Get the Fatal1ty mousepad to go up another percent.
Re: (Score:2)
Yeah, the celebrity endorsement nearly put me off.
I was looking at the lower end cards, but discovered the lowest two X-Fi card do NOT have the real X-Fi chipset, so do not support the hardware acceleration for gaming!
Personally I do not like glass-style mousemats, I prefer the old fabric ones, so use an Everglide Titan with a Logitech G5 mouse set to a LOWER DPI. I find this is actually more accurate than a smaller surface with high DPI.
Funnily enough, in actual gaming, I seem to recall Fatal1ty actually p
Re: (Score:2)
Re: (Score:2)
Yep, I agree - I use the cheaper stereo version of the Medusa headset with the X-Fi card set to headphone mode. I have tried the 5.1 version of the Medusa headset, and do not find it that much better for the money.
This does actually provide excellent virtual surround, which is why I think I need the X-Fi.
I had to go back to my onboard Realtek HD-Audio, and tried it in AC97 mode too a few weeks ago. It was not a nice experience.
Re: (Score:2)
Re: (Score:2)
Part of the serious difference is related to the fact I mainly play Infantry Only these days.
The downside to IO is that often you are getting sniped without being able to see where from. In this situation, being able to hear whether the sniper is above you and often exactly where they are is a massive advantage. It's enough that I have been accused of cheating a lot more since getting X-Fi.
The other main situation where it helps which I can tell the difference between software and EAX is you hear boats and
Re: (Score:2)
Yes, I thought this for a few years until discovering Battlefield 2. It took about 3 months for me to get quick enough to be competitive again, so I think you can actually regain these skills.
Admittedly, BF2 is strategy heavy too though, so it is possible to compensate to for slow reactions to some extent.
Real twitch games like Unreal Tournament 3 and Quake 3 are still a little beyond my reactions.
I have found recent racing games are excellent for older gaming - my clan has gamers up to 60 years old. We hav
Re: (Score:2)
Or if you want to do any recording. Try playing with Audacity - motherboard sound frequently isn't up to letting you record a track while playing back another.
It's more than a little annoying that a 1998 PCI sound card beats 2008 motherboard sound hardware.
Re: (Score:2)
Re: (Score:2)
>>Who are these people who buy sound cards?
Offloading the sound processing to the SB X-Fi bought me about 10-20 fps in games when I benchmarked it immediately before and after installation. On-board sound requires your CPU to do math, and if you have a lot of stuff going on, with various filters being applied to them, it makes a noticeable difference. More importantly, it stopped the occasional hitches and slowdowns I'd get, especially with winamp running in the background.
Plus, the sound that comes o
Re: (Score:2)
Re: (Score:2)
>>So if you offload the sound processing to the sound card, and the graphics processing to the graphics card, what exactly is left for your CPU to do?
Stuff.
But no, seriously, whatever it is that pegs my CPU when running Crysis or Age of Conan.
Offloading the sound processing to the card makes a very noticeable difference.
Re: (Score:2)
DRM!
Re: (Score:2)
Well, some people like myself have a speaker set up that doesn't have digital inputs, and the analog outputs on the motherboard are noticably noiser. And besides, few onboard sound cards have powerful enough amps to drive a good set of headphones at a decent volume.
Of course, you are probably right about the market. My sound card is an Aureal Vortex that I bought for my K6 system back in the days before onboard sound became ubiquitous. Quite possibly the oldest component in my computer, and I don't remem
Re: (Score:2)
Why is that surprising? The same is true in printers, and probably a whole slew of other products.
Re: (Score:2)
"Which in this thread [creative.com] is being discussed around X-Fi hardware."
I have an X-fi (the full version with the faceplate) and I had the 'crackle', but you assume end users know what their 'crackle' causes actually IS, most users I imagine are quite doltish, although some might genuinely have problems but I imagine it's a small group. For me and I found out the crackle was actually because of the soundblaster faceplate 'IDE cable' that connects the card to the faceplate for audio out.
Once I moved i
Lexar and Sandisk should be good (Score:4, Informative)
Re:Lexar and Sandisk should be good (Score:5, Interesting)
How do you know that it indeed works in a full-fledged UDMA mode and not in some half-assed workaround mode, used specifically because of the problems in question existing in the cards' controllers. Did you reverse engineer the camera's firmware?
Re:Lexar and Sandisk should be good (Score:5, Insightful)
Also, the article said that the Sandisk card they tried worked. They did not mention anything about Lexar but did mention problems with Transcend, which is not certified for my camera.
Re: (Score:2)
To see if you get real UDMA, put the card in a ATA->CF adapter and see if you can use UDMA.
Since you then are using it as a regular IDE-device, you can easily verify it.
Re: (Score:3, Informative)
I can't vouch for cameras, but I created a CF-based hard drive to boot my Windows XP tablet PC using one of these [addonics.com]. It has two CF slots, and my tablet's IDE controller supports UDMA. In Windows, you can check what UDMA/PIO mode your disks are in by clicking the Advanced Settings tab on the IDE adapter's property page in Device Manager.
The first device I tried was the cheapest UDMA CF card I could get my hands on (233x 16gb Ritek), and after a few disk driver errors, it dropped out of UDMA mode and the laptop
Try Transcend, but watch for voltage (Score:3, Informative)
Like the previous poster, I use a Transcend CF card to run XP and Ubuntu on a laptop. I recently "upgraded" to the 16GB 300x version, since it was supposed to run at UDMA5. I wrote the review here [newegg.com].
Short story: According to Transcend, the card has to run at 3.3V in order to run in UDMA5 mode. I'm also using that Addonics 2-card CF-to-IDE adapter, and it doesn't offer voltage choices, so I'm stuck at 5V and the slower speeds -- au
Re: (Score:1)
I wonder how often voltage (5V vs. 3.3V) is a factor in UDMA problems...
A lot less often than you think, probably ;) TFA is about UDMA failing altogether, not a failure in differentiating between 4 and 5. My tablet only supports UDMA4 to begin with, so I didn't experience the issue you described with the Transcend card. I'd be extremely interested to know if you see any speed difference whatsoever between 4 and 5 though, as the physical specs of the card seem to max out at the speeds allowed by UMDA4.
Also, I found the connector of the Addonics card to be so extremely tight-fitt
Re: (Score:1, Interesting)
Something interesting to note is that I can't get anything approaching the speed of the Addonics IDE-CF apapter out of any USB CF adapter I could find. They generally run fast, just not as fast.
Strangely Hard drives connected through a USB adapter run slower than those connected through the IDE interface. Hmm, this couldn't have anything to do with USB, could it? </sarcasm>
Basically what I'm saying this isn't really interesting if you know USB is crap for data transfer, which I thought most people here knew. Though if you didn't already know this, I can see why you thought it interesting.
CF ~= IDE (Score:2)
Easy !
Compact Flash form factor is really a down-sized PC-Card 16bits / PCMCIA form factor.
And PC-Card 16bits is nothing more than cousin of ATAPI which is external and supports hot swapping.
(Just as PC-Card 32bits is a PCI cousin with hotswapping, and Card-Express has both PCIe and USB2.0 pins).
There are CF IDE adapters which are mostly passive pin-adapter without any logic, that let you access a CF card using an IDE bus (minus the hot plugging).
So just plug your compact flash into one of such card adapter
Re: (Score:1)
From the utterly irrelevant department (Score:3, Funny)
What's next, some USB mice fail at implementing the USB 2.0 standard? Or some random printer which claims to support PCL really doesn't?
Geesh, talk about a slow news day.
Re: (Score:1)
On a slow news day, the oddest stories get posted and people often get interpreted in an excessively literal fashion.
Re: (Score:2)
This news is actually extremely important to me; I bought a CF to IDE adapter to mess with and am thinking of converting two of my machines to use compactflash cards:
1. Laptop
2. PC in garage
The PC will probably get the first set-up; no need to run the aging 80 gig hard drive into the ground. Especially in the harsh conditions there. The laptop will be a project "if I get around to it" but would be cool to do, what with all of the SSD talk nowadays.
Anyone have any ideas on Linux on CF (limiting writes et
Re: (Score:1)
Anyone have any ideas on Linux on CF (limiting writes etc?)
Here are some links:
Also most other eee laptop configuration guides you can find.
Re: (Score:1, Informative)
Try this for tips:
http://www.cyrius.com/debian/nslu2/linux-on-flash.html
Re: (Score:1)
Anyone have any ideas on Linux on CF (limiting writes etc?)
Look at what Puppy Linux does: Don't use a swap file. Mount your temporary file systems in RAM.
As for the commonly expressed fear of hitting some claimed limit of 10,000 writes per sector, that fear is overblown. The controller chips in modern CF and SD cards should be able to use the 7.4 percent difference between 2 GB and 2 GiB to spread the writes around the physical sectors [wikipedia.org]. And if you can find SLC (single level cell) flash, its speed and durability might be worth it.
Re: (Score:2)
Well, it is important to point out that there are differences in memory cards people might want to consider. Most people I know consider all memory cards to be functionally equilivent and just buy the cheapest one they can find at the size they want.
Re: (Score:2)
SanDisk cards are usually a safe bet. (Score:4, Interesting)
I can vouch from personal experience with their engineers that their cards rated for 30MB/s or higher all support UDMA 4 or higher, and I've done tests of my own to verify this. Not all ExtremeIII cards support UDMA though; the ones that don't specify a speed of 30MB/s are instead rated for 20MB/s, which can be quite easily achieved using PIO6 (although less efficiently.) These cards might support UDMA, but since there's no *need* for it, there are no guarantees.
Also, I'm pretty sure Lexar cards rated for UDMA do perform as advertised. I can't vouch for other manufacturers. Additionally, be wary of fake cards (ebay is especially prone to fake card sales) as they're never going to perform to your expectations.
Re: (Score:3, Informative)
Re: (Score:2)
Are you sure you had it in Fixed Disk mode? Most OSs will fail to boot if the card is in Removable mode. All CF cards share this characteristic, and most are in Removable mode by default. A good CF-IDE adapter can (and should) put the card in fixed disk mode, but not all will do so.
Open source?? (Score:1)
In his quest to create an open source video camera...
What the hell is an open source video camera? I've heard of open source software, but what the hell is open source hardware??
Re: (Score:2, Informative)
Perhaps hardware which is extensively documented, with all documentations/plans/schematics licensed under the GFDL or similar?
Just my $0.02
Re: (Score:1)
You could just call it "Programmable Hardware" or "Documented Hardware".
IMHO, "Open Source Hardware" is just a clever phrase used by many hardware people to leverage advantage of the well-marketed "Open Source" phrase.
Re: (Score:2)
If the schematic files are available in source format, and possibly the CAM information (Gerber files, drill files, etc), I'd call that open source, since that's the material used to generate the boards. It's one thing to print a schematic. It's quite another to publish the board layout in an editable form.
I haven't looked at what this project is doing, but it sounds like the latter.
--Joe
Re: (Score:2, Informative)
Re: (Score:2)
FWIW, Cadsoft Eagle [cadsoft.de] is a proprietary schematic capture/layout program that has a free version that anybody can use to view or print (but not edit) design files written by the full versions.
Also, Cadsoft has a much lower price (around $150) if you're using the full version for non-commercial activites. Eagle seems to be quite popular for the hobbiest market because of this.
Re: (Score:3, Interesting)
Elphel would put some $50K in the pool (if there was one) to buy a serious PCB CAD software no make it GPL-ed.
Re: (Score:2, Informative)
Re: (Score:2)
Um, if I were to guess, this would be a hardware video camera with open source firmware, or a reference platform for building a functional video camera like a PC, where you'd plug together lenses, buttons and sensors in a case. It probably would look like RED [red.com].
Re: (Score:1, Funny)
I asked the same question, and was able to educate myself in about 30 seconds with Google. Try that next time...
Minimig (Score:2)
Compact Flash (Score:1)
Re: (Score:2, Informative)
Compactflash cards are available in larger sizes, work as IDE devices (which SD cards do not afaik) and are faster.
Re: (Score:3, Informative)
Compact flash is/was the standard on the high end. SD is making some inroads, but for a long time, fancy cameras had CF slots and that was your choice.
Re:Compact Flash (Score:5, Informative)
Re: (Score:2, Informative)
As of February 2008, the specifications version 4.3 (dated nov 2007) can be requested from the MMCA, and after registering downloaded free-of-charge.
Re: (Score:2)
Physical size might be another reason why CF is seen on higher end cameras. Microdrives used to be a lot more popular back before flash became so cheap, and for Microdrives you need a CF slot as the SD form factor is way too small.
Re:Compact Flash (Score:5, Informative)
Re: (Score:2)
You can get the Simplified SD spec [sdcard.org], which is basically the normal spec minus the DRM and some other unimportant details.
Re: (Score:2)
While the primary SD interface is kinda complex, SD cards are required to support an SPI interface, which is pretty much the most brain-dead simple interface imaginable.
Most microcontrollers will support it natively, and it's incredibly simple to implement in hardware and software. It's what I usually use when I need to back a PIC with lots of storage.
Transcend 133x works well with UDMA for embedded (Score:2)
I run an 8 GB Transcend 133x [transcendusa.com] in my Alix board as a router/firewall on FreeBSD, and the BIOS and OS pick it up as UDMA33 without a problem. I get sustained reads of 33 MB/s and writes of about 9.5 MB/s.
Andrey Filippov (Score:2, Funny)
God damn it, why can't I have that last name?
Re: (Score:2, Funny)
I imagine you could, if you really wanted to.
IDE Compatibility Issues (Score:5, Informative)
As far as I can tell (without a bus analyzer,) there's something hinky happening during device auto-detection and initialization. Many times, the CF card will be detected as the Master device, but no Slave device will be detected. Swap to a different brand CF card, and the symptom will change - both devices will auto-detect, but the IDE bus will throw timeout errors during boot. Swapping in just about any not-a-CF-card device, and everything is fine.
Re: (Score:2)
I agree, they probably assume that it's going to be used in a single drive bus. I think I have IDE to CF adapters that allow the user to set which is master and which is slave. I haven't tried to use a non-CF device with a CF device on the same bus.
I doubt they consider embedded use at all. Digital cameras are probably still the leading use of CF cards by far, but that's being pushed out a bit as no point and shoot seems to use it, and even low end dSLRs are switching over to SD.
Re:IDE Compatibility Issues (Score:4, Insightful)
A while ago I built my mythtv frontend, (based off a T-Online vision s100 box) and elected to use a CF card for storage within the unit - the box is entirely free of moving parts, so CF made sense.
I bought one of those IDE to CF adapters off ebay, and found that when I turned on DMA, the IDE bus would basically lock up, and pretty much end up useless.
After a lot of fiddling and digging around, I discovered that the adapter did not connect the required pins for DMA transfers to work. Old-skool CF never had DMA, so this extra pin is only a recent addition to the standard.
Anyway, I soldered in a short wire to hook up this pin, and now I get respectable dma transfers.
The moral of the story - it might not be the CF card that is causing DMA failure, but the adapter it's hooked into.
Re: (Score:2)
Re: (Score:2)
I also have a few no-moving-parts machines running with various cheap Chinese CF-to-IDE adapters, some of which are a few years old. They are all, unilaterally, quite slow. For what they're doing (a web browser for Thottbot, a processor for audio, and an antique 386 laptop running antique Slackware), speed isn't important -- and the 386 will obviously not work with DMA anyway -- but it'd be nice if they booted faster.
Which pin should I be investigating at to see if this might be part of the problem? Look
Re: (Score:2)
I've also seen this behaviour.
One or two CF-cards on one IDE-bus: No problems
One CF-card and anything else on the same bus: The CF-card fails to enter ATA-mode, which means that it tries to talk to the IDE-bus as if it's a CF or PCMCIA-port.
Haven't seen any card that doesn't show this problem, but I've only tried about 8 - 10 different cards.
CF inside the cameras do not use "True IDE" mode (Score:5, Informative)
We last visited Elphel and their work... (Score:1)
Are you sure? Wasn't it just a week ago?
http://mobile.slashdot.org/article.pl?sid=08/07/05/1711221 [slashdot.org]
Re: (Score:2)
Give the editors a break, will you? They don't remember what stories they posted yesterday. They can't spell, they have no grammar skills and now you want them to understand time?
This is sure a tough place...
Get off my lawn! (Score:2)
Re: (Score:2)
I guess FTP isnt good enough for you?
Re: (Score:3, Insightful)
Re:Good work (Score:4, Informative)
I think the OP was tricked into thinking that the crappy software that came with the camera was actually required to use the camera. The instructions that come with these cameras do tend to make it sound like installing the software is a mandatory step, and fail to mention that you can just access the pictures using Explorer. I guess they want to get their little bit of AdWare on your system. Or maybe they really are worried that Aunt Tillie doesn't know how to use Explorer.
Re: (Score:2)
Actually, it uses either PTP or MTP to talk to you camera over USB. Your USB hard drive is a mass storage device which most likely uses SCSI commands over USB.
In either case, the OS presents it to you like its an external hard drive.
Re: (Score:2)
Re: (Score:2)
I had a Sony camera circa 2003 that *required* drivers installed first. Cthulhu help you if you connected the camera w/o installing drivers, because XP couldn't see it and despite my best efforts, it never would after that. Good job we had another computer.
Re: (Score:1)
Try it. DigiKam (using gphoto as the backend) and iPhoto never had any trouble with it. No idea on the Windows side, though.
Re: (Score:2, Informative)
Re: (Score:1)
No, I'm stuck with it identifying itself as a camera which won't let me cut & paste.
HP cameras at least give you the choice between showing as a camera or mass storage.
Re: (Score:2)
I have an A630 as well, and it fucks up all the time when using the automated XP windows photo downloader thingy. It gets an error while trying to read from the camera, and starts skipping photos. No problems under Vista, though.
However, nothing stops me from just popping the memory card out and reading the photos off that way, and it goes much faster as well.
Re: (Score:2)
Just about every camera I've looked at recently has a bog standard mini-USB connector and didn't require custom software to see the camera's contents as a drive, at least not with OSX.
Re: (Score:2)
I hope you do understand that posts on slashdot can actually be replies to other posts, not just to the article itself.
Re: (Score:1)
I hope you do understand that posts on slashdot can actually be replies to other posts, not just to the article itself.
Comments below the 50 top rated usually aren't even downloaded. Because of this, it's easier to get comments understood if you Quote Parent.
Re: (Score:2)
Maybe I have more money than you and can look at more cameras?
Probably. I'm just a code monkey these days.
Re: (Score:3, Informative)
"disclaimer: only tested on OS X, not tested on animals, no DLLs were harmed in the making of this message, age 45 and older excluded, milage may vary depending on driving conditions, poster assumes slashdot readers are capable of understanding the concept of 'context', emoticons are optional and may require a surcharge."
Snort. (Score:2)
Maybe you need to look at more cameras, then. The last couple I've owned have done that.
Re: (Score:2)
Maybe one day I'll see a camera with a bog standard USB connector that doesn't need a specific driver just to see the camera's contents as a drive?
Why would you want to do that anyway when you'll get a much higher transfer rate with a proper card reader than with the crappy USB controller that's on board the camera ?
Fixed that for you (Score:1)
I, the orginal and only Anonymous Coward, have a 2 inch junk!
This reply is GPLv3 licensed.
Original comment available on request.
Re: (Score:2)
it's not just about the CF to IDE (or CF to SATA) adapters but also the controller chip within the CF card as stated in the article.
Re: (Score:2)