Slashdot is powered by your submissions, so send in your scoop

 



Forgot your password?
typodupeerror
×
Data Storage IT

Backblaze Hard Drive Stats Q3 2020 (backblaze.com) 37

Backblaze's Q3 2020 hard drive stats: As of September 30, 2020, Backblaze had 153,727 spinning hard drives in our cloud storage ecosystem spread across four data centers. Of that number, there were 2,780 boot drives and 150,947 data drives. This review looks at the Q3 2020 and lifetime hard drive failure rates of the data drive models currently in operation in our data centers and provides a handful of insights and observations along the way. [...] There are several models with zero drive failures in the quarter. That's great, but when we dig in a little we get different stories for each of the drives.

The 18TB Seagate model (ST18000NM000J) has 300 drive days and they've been in service for about 12 days. There were no out of the box failures which is a good start, but that's all you can say.
The 16TB Seagate model (ST16000NM001G) has 5,428 drive days which is low, but they've been around for nearly 10 months on average. Still, I wouldn't try to draw any conclusions yet, but a quarter or two more like this and we might have something to say.
The 4TB Toshiba model (MD04ABA400V) has only 9,108 drive days, but they have been putting up zeros for seven quarters straight. That has to count for something.
The 14TB Seagate model (ST14000NM001G) has 21,120 drive days with 2,400 drives, but they have only been operational for less than one month. Next quarter will give us a better picture.
The 4TB HGST (model: HMS5C4040ALE640) has 274,923 drive days with no failures this quarter.

This discussion has been archived. No new comments can be posted.

Backblaze Hard Drive Stats Q3 2020

Comments Filter:
    • What's your methodology? Using this dataset, I'm seeing that backups are not necessary provided you have thousands of drives.
    • by ShanghaiBill ( 739463 ) on Tuesday October 20, 2020 @05:50PM (#60629572)

      make backups.

      That is not what the data says.

      The data says that HDDs are more reliable than ever.

      • make...backups!!!
      • The data says that HDDs are more reliable than ever.

        True... but the data indicates they are not perfect. Make backups.

        • Nothing is perfect.
          There is a chance of 1 in 10^58 that all your atoms miss all the floor atoms and you just fall through the floor.
          The chance of you dying today, is much, MUCH higher.

      • I don't think the data says that at all. It looks like it's just simply looking at whether the drives are basically a dud pulling out of the box. My understanding is that most of the drives have been only running for a few days, and you have to divide the drive days by the number of drives. There are plenty of drives listed in the article that have AFR of more than 1%.

        • The summary says that. Backblaze's data is actually far more detailed and includes far more than 5 models of drives. That data actually has shown that drives have gotten more reliable since Backblaze has started publishing meaningful data.

      • You know what we called clients who did not do regular backups? Good profit margins for our company!
      • by antdude ( 79039 )

        Still make back ups. Things can fail at any time. Even bad luck.

      • by AmiMoJo ( 196126 )

        The data says HDDs still fail sometimes, so make backups.

        Unless the failure rate is guaranteed to be zero, make backups. And even then don't trust it, make backups.

    • by GuB-42 ( 2483988 )

      It certainly is Backblaze opinion.

      Other than that, drive failures are more of a case for RAID than backups. Backups are important for more reasons than drive failure: accidental deletion, malware attacks, bugs, disasters, etc... but they are not ideal if you just consider drive failure. Restoring from backup has a cost: you may still lose some recent data, and your data is unavailable during the restoration process.

      A proper RAID-type system is much better at dealing with drive failure. It is essentially tra

  • This is only about spinning drives. Why not SSDs? Is there a reason these "slower" drives are used rather than SSDs? Do they have SSDs in their inventory but just don't report them?

    • by dukeZ ( 974621 )
      Can you imagine how much an 18TB SSD would cost? SSDs are too small and too expensive to be charging only $6/month for unlimited backup...
      • 18 TB SSD would cost 1800 dollars or the cost of my first pair of 80 Meg SCSI HDs
        • the cost of my first pair of 80 Meg SCSI HDs

          You and the other 999 customers from that time can have a party with the 1000 people that would spend $1800 on 18TB in 2020.

    • by dukeZ ( 974621 )
      Or just ask the guy who wrote it himself! He has a webcast on Thursday at 10 AM... https://www.brighttalk.com/web... [brighttalk.com]
    • Re:Question (Score:5, Informative)

      by Anaerin ( 905998 ) on Tuesday October 20, 2020 @07:01PM (#60629714)
      They're a cloud backup company, which means they need lots of storage, but don't particularly need high-speed. They're not a CDN, or a cloud computing provider. Their data is moving at internet speeds, not LAN speeds, and any inherent slowness is taken care of by the RAIDing of the drives together. At the moment, spinning hard-drives are still at least 5x cheaper per terabyte than flash-based SSDs (Seagate Exos X16 14TB HDD Enterprise [amazon.com] @ $20/TB vs. SAMSUNG 870 QVO-Series 4TB SSD [amazon.com] @ $110/TB).
      • by recjhl ( 840587 )

        LTO tapes are cheaper still @ $7 / TB.
        For backup tapes are perfect, you can move them to an other place, the do not need any power.

        • by Anaerin ( 905998 )
          Hard-Drives and SSDs don't require power to move either, I'm not sure what your point is there. And while LTO tapes are (comparatively) cheap, the drives, libraries and storage robot systems for anytime on-line access are most definitely not. It's also part of the 3-2-1 typical backup strategy: at least 3 copies in at least 2 formats, at least 1 off-site.
          • Uuum, 3-3-3-3 would make more sense.

            3 sites, each running 3 as-different-as-possible systems with with triple-redundant drives, read and written by 3 separately developed, completely independent implementations.

            Ideally, the higher the number, the higher the sigma of statistical reliability.

            • by Anaerin ( 905998 )
              Yes, the higher the number the better. But there comes a point where you're running into diminishing returns. The 3-2-1 system, while not perfect, is reasonably cheap and easy to implement, and gives the best "Bang for your buck". If something has happened where all 3 copies are unusable, despite being on 2 different media types and with one backup stored offsite, you have a much larger problem than data loss.
        • LTO tapes are cheaper still @ $7 / TB.

          But don't support random access making them completely useless in any application other than for making backups.

          "Cloud backup" Is not about duplicating data. It's about data redundancy which can be accessed randomly. Hell just the other day I accidentally nuked a file by overwiting it with the wrong data.
          Option A: Get most recent LTO tape, go through incredibly long process finding the data on the tape, and recovering it, and hoping that the backup is less than 1 day old (it wouldn't have been, my offline b

      • by AmiMoJo ( 196126 )

        It's also worth noting that their data is based on datacentre conditions, i.e. air conditioned racks full of actively cooled drives that are spinning 24/7.

        A home NAS probably spins the drives down and back up several times a day. Cooling may be better, it may be worse (remember to clean your fans). Power in the data centre is probably a lot cleaner than in your home.

        The spin up/down cycles in particular can be a cause of failure. It puts strain on the motor and causes the drive to thermally cycle between ho

  • by RandySC ( 9804 )

    Are they avoiding Western Digital?

    • Re:WD (Score:4, Informative)

      by R.Mo_Robert ( 737913 ) on Wednesday October 21, 2020 @01:15AM (#60630346)

      Are they avoiding Western Digital?

      Only because it doesn't meet their criteria; nothing particular against WD itself. From a comment [disq.us] on their Q2 stats, where someone noticed the same:

      We buy drives based on price and availability. We didn't stop buying WD drives, they just couldn't meet one or both of these criteria. We do buy HGST drives, which is owned by WD, but as on the end of Q2 we did have have any of the WD branded drives in operation.

  • They are HGST internally.
    Which is the former IBM division by the way.
    They made a 180 degree turn after their debacle with the last IBM-branded ones.
    Yes, they are very reliable nowadays, as far as I can tell.

  • ...for preserving the angular momentum of all those spinning disks! Do not allow them to shed that precious resource...
    • You're making assumptions that they didn't take this into consideration and mount every other drive upside down.

  • The numbers don't make any sense.

    If you have 150,XXX drives with 2XX,XXX drive-days, it seems you installed the drives the day before yesterday.

    What am I missing??

  • "The 4TB HGST (model: HMS5C4040ALE640) has 274,923 drive days with no failures this quarter."

    Does this mean they have 274,923 of these drives and not a single one died in 4 months?
    I didn't think that degree of reliability was possible.

    • by nikclev ( 590173 ) *
      No, it doesn't mean that. If they had all those drives for the entire quarter, then they have somewhere around 2290 drives. (assuming 120 days for the quarter)

      274,923 drive days ~= 2290 drives for 120 days

      And of those 2290, they had no failures. Still impressive, imho.

Scientists will study your brain to learn more about your distant cousin, Man.

Working...