Before we go into specifics, consider your use case. Are you storing photos, MP3's and DVD rips? If so, you might not care whether you permanently lose a single block from the array. On the other hand, if it's important data, this might be a disaster.

The statement that RAIDZ-1 is "not good enough for real world failures" is because you are likely to have a latent media error on one of your surviving disks when reconstruction time comes. The same logic applies to RAID5.

ZFS mitigates this failure to some extent. If a RAID5 device can't be reconstructed, you are pretty much out of luck; copy your (remaining) data off and rebuild from scratch. With ZFS, on the other hand, it will reconstruct all but the bad chunk, and let the administrator "clear" the errors. You'll lose a file/portion of a file, but you won't lose the entire array. And, of course, ZFS's parity checking means that you will be reliably informed that there's an error. Otherwise, I believe it's possible (although unlikely) that multiple errors will result in a rebuild apparently succeeding, but giving you back bad data.

Since ZFS is a "Rampant Layering Violation," it also knows which areas don't have data on them, and can skip them in the rebuild. So if your array is half empty you're half as likely to have a rebuild error.

You can reduce the likelihood of these kinds of rebuild errors on any RAID level by doing regular "zpool scrubs" or "mdadm checks"of your array. There are similar commands/processes for other RAID's; e.g., LSI/dell PERC raid cards call this "patrol read." These go read everything, which may help the disk drives find failing sectors, and reassign them, before they become permanent. If they are permanent, the RAID system (ZFS/md/raid card/whatever) can rebuild the data from parity.

Even if you use RAIDZ2 or RAID6, regular scrubs are important.

One final note - RAID of any sort is not a substitute for backups - it won't protect you against accidental deletion, ransomware, etc. Although regular ZFS snapshots can be part of a backup strategy.

Answer from Dan Pritts on serverfault.com
Top answer
1 of 3
35

Before we go into specifics, consider your use case. Are you storing photos, MP3's and DVD rips? If so, you might not care whether you permanently lose a single block from the array. On the other hand, if it's important data, this might be a disaster.

The statement that RAIDZ-1 is "not good enough for real world failures" is because you are likely to have a latent media error on one of your surviving disks when reconstruction time comes. The same logic applies to RAID5.

ZFS mitigates this failure to some extent. If a RAID5 device can't be reconstructed, you are pretty much out of luck; copy your (remaining) data off and rebuild from scratch. With ZFS, on the other hand, it will reconstruct all but the bad chunk, and let the administrator "clear" the errors. You'll lose a file/portion of a file, but you won't lose the entire array. And, of course, ZFS's parity checking means that you will be reliably informed that there's an error. Otherwise, I believe it's possible (although unlikely) that multiple errors will result in a rebuild apparently succeeding, but giving you back bad data.

Since ZFS is a "Rampant Layering Violation," it also knows which areas don't have data on them, and can skip them in the rebuild. So if your array is half empty you're half as likely to have a rebuild error.

You can reduce the likelihood of these kinds of rebuild errors on any RAID level by doing regular "zpool scrubs" or "mdadm checks"of your array. There are similar commands/processes for other RAID's; e.g., LSI/dell PERC raid cards call this "patrol read." These go read everything, which may help the disk drives find failing sectors, and reassign them, before they become permanent. If they are permanent, the RAID system (ZFS/md/raid card/whatever) can rebuild the data from parity.

Even if you use RAIDZ2 or RAID6, regular scrubs are important.

One final note - RAID of any sort is not a substitute for backups - it won't protect you against accidental deletion, ransomware, etc. Although regular ZFS snapshots can be part of a backup strategy.

2 of 3
5

There is a little bit of a misconception at work here. A lot of the advice you're seeing is based on an assumption which may not be true. Specifically, the unrecoverable bit error rate of your drive.

A cheap 'home user' disk has 1 per 10^14 unrecoverable error rate.

http://www.seagate.com/gb/en/internal-hard-drives/desktop-hard-drives/desktop-hdd/#specs

This is at a level where your're talking a significant likelihood of an unrecoverable error during a RAID rebuild, and so you shouldn't do it. (A quick and dirty calculation suggests that 5x 2TB disks RAID-5 set will actually have around a 60% chance of this)

However this isn't true for more expensive drives: http://www.seagate.com/gb/en/internal-hard-drives/enterprise-hard-drives/hdd/enterprise-performance-15k-hdd/#specs

1 per 10^16 is 100x better - meaning 5x 2TB is <1% chance of failed rebuild. (Probably less, because for enterprise usage, 600GB spindles are generally more useful).

So personally - I think both RAID-5 and RAID-4 are still eminently usable, for all the reasons RAID-0 is still fairly common. Don't forget - the problem with RAID-6 is it's hefty write penalty. You can partially mitigate this with lots of caching, but you've still got some pain built in, especially when you're working with slow drives in the first place.

And more fundamentally - NEVER EVER trust your RAID to give you full resilience. You'll lose data more often to an 'oops' than a drive failures, so you NEED a decent backup strategy if you care about your data anyway.

🌐
TrueNAS Community
forums.truenas.com › resources
The problem with RAIDZ - Resources - TrueNAS Community Forums
This resource was originally created by user: Jamberry on the TrueNAS Community Forums Archive. Please DM this account or comment in this thread to claim it. The problem with RAIDZ or why you probably won’t get the storage efficiency you think you will get.​ Work in progress, probably contains ...
Published: April 16, 2024
Discussions

RaidZ1 performance ZFS on host vs VM | Proxmox Support Forum
Hi, I am currently testing my RaidZ1 setup. The plan was actually to create the ZFS pool (4x1TB PCIe NVME SSD) with Proxmox and then pass it as a disk to a VM, among others. In my benchmarks with fio, however, I noticed that the performance on the host was significantly higher (approx. 50%)... More on forum.proxmox.com
🌐 forum.proxmox.com
February 11, 2024
The problem with RAIDZ or why you probably won't get the storage efficiency you think you will get | Proxmox Support Forum
I wrote something down on Github and would love to hear your feedback. More on forum.proxmox.com
🌐 forum.proxmox.com
February 26, 2024
Improving performance of RaidZ1 | Proxmox Support Forum
Don't use raidZ1 for active virtual ...zfs-raidz-for-my-vms.159923/ ... - 3x consumer drives in a different configuration? Will it make a difference if we mirror our existing raidZ1 pool, or are we bound to hit another brick wall? Click to expand... A stripe of two raidZ1 could improve performance but it will be very unbalanced between the consumer and the enterprise drives. And did I mention yet that raidZ1 is bad for ... More on forum.proxmox.com
🌐 forum.proxmox.com
May 28, 2026
ZFS raidz1 and snapshots, again | Proxmox Support Forum
Sorry to ask again but I could use some definitive advice. I have a couple of Proxmox servers that have a zfs mirror for the os and a 4 disk storage array in zfs raidz1. Everything works as expected or so I thought. When I take a snapshot of any VM it seems to increase the storage used on... More on forum.proxmox.com
🌐 forum.proxmox.com
July 2, 2026
People also ask

Can you convert a ZFS mirror to RAIDZ?
Not in place. TrueNAS's pool documentation states that you cannot change the original data VDEV configuration, so mirror vdevs stay mirrors. The practical route is a new RAIDZ pool on separate disks, replication of every dataset to it, then retiring the old pool. Budget enough drive bays to run both at once.
🌐
truenasguide.com
truenasguide.com › home › zfs fundamentals › zfs raidz vs mirror: capacity, iops, and resilver risk
ZFS RAIDZ vs Mirror: Capacity, IOPS, and Resilver Risk
Is RAIDZ1 safe with large hard drives?
Not by TrueNAS's own standard. The TrueNAS ZFS primer says RAIDZ1 is not recommended for drives over 1 TiB, because a resilver on large disks takes long and a second failure during it loses data. If you run RAIDZ1 on big drives anyway, keep a tested backup elsewhere, or use RAIDZ2 or mirrors instead.
🌐
truenasguide.com
truenasguide.com › home › zfs fundamentals › zfs raidz vs mirror: capacity, iops, and resilver risk
ZFS RAIDZ vs Mirror: Capacity, IOPS, and Resilver Risk
How many disks do you need for RAIDZ1 in TrueNAS?
Three. TrueNAS documents minimums of three disks for RAIDZ1, four for RAIDZ2 and five for RAIDZ3. OpenZFS itself only requires one more disk than the parity level, but recommends 3 to 9 disks per RAIDZ group, and the TrueNAS ZFS primer advises against more than 12 disks in one vdev.
🌐
truenasguide.com
truenasguide.com › home › zfs fundamentals › zfs raidz vs mirror: capacity, iops, and resilver risk
ZFS RAIDZ vs Mirror: Capacity, IOPS, and Resilver Risk
🌐
TrueNAS Community
truenas.com › forums › community discussion › community forum › off-topic
What's the stigma behind using RAIDZ1? | TrueNAS Community
July 9, 2023 - In a 6-drive RAIDZ1, you will lose your pool as soon as a second drive goes bad, a 6-drive striped mirrors can suffer up to 3 drive failures so long as the drives aren't in the same vdev.
🌐
Proxmox
forum.proxmox.com › home › forums › proxmox virtual environment › proxmox ve: installation and configuration
RaidZ1 performance ZFS on host vs VM | Proxmox Support Forum
February 11, 2024 - My per VM defaults on latest Prox 8.X has: volsize 1M volblocksize 8K I'm not sure this really matters as such. ... "Raidz1(/2/3) has to wait for the slowest drive (because it has to wait for all drives and since they are different makes and models the "slowest one" might change during the work-load)" - only when a ZIL is not in use by the way I've described here, that will circumvent this behaviour in a major way.
Top answer
1 of 2
2

I think it was a misunderstanding in the old thread. I was comparing the chance of failure for two disks in a row when using either Z1 parity raid or no RAID (as you stated in the comments in the other thread). In my eyes it was never about Z1 vs. striped pool of basic vdevs, because that game is essentially over after the first fault anyway, so Z1 is of course better.

But if you just compare multiple independent pools against a single pool with a single Z1 vdev, then the problem of increased load while recalculating the parity information persists.

On the comparison of Z1 vs Z2, which the answer by Michael was mainly about, the other two points apply. I should have been more clearly in the comments, but they are limited in space unfortunately. I hope this answer clears some of this.

I thought the same thing, but I didn't realize that a URE isn't just a bit flip, it spoils the entire pool.

If we simplify the whole thing, you have your disk with its controller chip on the bottom and your hardware (RAID controller) or software (e. g. ZFS) on the top.

If any error happens in the hardware and a sector cannot be read, the chip first tries to correct it on its own if possible (for example by reading the problem sector multiple times). If it still can't make anything out of it, it gives up (on normal disks, this can take minutes and stalls the complete system which waits for "successful" or "failure" message regarding the IO operation that is pending.

Some disks have a feature called TLER (time limited error recovery), which is a hard timeout that limits this error correction time to 6-9 seconds, because traditionally, most hardware RAID controllers dropped the whole disk after 9 seconds, so a single bad sector should not make the whole disk unavailable, but be corrected by a "good" sector on the other disks (a feature that a single disk on a desktop system could not rely on, so a long timeout would be preferable).

Now, let's look at the software side: if you configure your raid controller or ZFS file system with redundancy, for example by using mirrored disks or a mirror vdev as basis for your pool, your URE can be corrected. If you do not use redundancy, the data on this sector will be gone, which may be data you care about or just random old temp data or nothing, depending on your luck. The same applies to bit flips, although the chance of them happening seems to be more dependent on outside effects (like cosmic radiation).

Since RAID0 is not subject to UREs, the question is "what is more likely, a URE in RAIDZ or a disk failure in RAID0?"

I haven't accepted this answer because I don't think it adequately explains the relevant points, but I was planning on creating my own answer once I understand why UREs destroy the whole pool, if no one else gets to it first.

I suggest you read a basic explanation of ZFS pool layout. To summarize the most important bits:

  • You can create virtual devices (vdevs) from disks, partitions or files. Each vdev can be created with different redundancy: basic (no redundancy), mirrored (1 to N disks can fail), parity raid Z1/Z2/Z3 (1/2/3 disks can fail). All redundancy works on the vdev level.
  • You create storage pools from one or more vdevs. They are always striped, therefore the loss of a single vdev means the loss of the whole pool.
  • You can have any number of pools, which are independent. If one pool is lost, the other pools continue to function.

Therefore you can reason the following:

  • If possible, prefer Z2 over Z1 because of the increased load and big window of (negative) opportunity when rebuilding large drives (large being anything over 1 TB approximately)
  • If having to choose between Z1 and multiple basic vdevs, prefer Z1 because of bit error correction which is not possible with basic vdevs
  • If you can accept partial pool loss, segment your pool into multiple smaller pools backed by a single vdev each, so that you get checksum information and faster rebuild times on fatal faults

In any of the above cases, you need to have a backup. If you cannot or don't want to afford any backup, it is about what you are more comfortable to lose - some parts of the pool with higher probability or everything with lower probability. I personally would choose the first option, but you may decide otherwise.

2 of 2
1

What is implied in answer you quoted is that with increasing storage capacity chance of failure increases accordingly, not only for rebuilding operation but for normal activity as well. So, statistically speaking, RAIDZ1 is no more fault tolerant than Raid 0 when talking about modern 4TB drives, even though case is made prima facie that it is.

So some argue that RAIDZ1 is, in fact, not an increase in protection against data loss for large-capacity hard disk drives. This has less to do with mechanical failure of the drive(s), or at least not with critical failure. URE is, to put it simply (and very simplistically) is failure to read. Be it due to prolonged read from bad sector of the drive, disk running out of spare sectors - or any other cause - it's not really an issue. It will happen, like it or not. Let's then take the bad sector example - Normally this is handled by drive internally, but if there's enough of them or the drive will take it's sweet while to fix that the RAIDZ controller might interpret the delay as drive failure and eject the drive. Now, let's imagine it's the SECOND hard drive in the pool, and it happened while rebuilding... The only viable solution is to scrub the array for those errors - if caught early, the error will be just a burp - pool will recover the data easily. But this means putting quite a big load on drives, which then increases drastically the statistical chance of URE (remember: age, writes, volume of data all increase it a lot already, without increasing the reads by order of magnitude from normal operations; all for each drive separately).

Thus the answer to your question (is a RAIDZ1 an incremental improvement on no fault tolerance) is: not really. If we use logic of the quote you face 50% chance (I think) of enough disk failures for data to be unrecoverable within first two years of said disks operation..

That is why when in our company we were faced with the dilemma of server availability or storage capacity we bit the bullet and went for RAID6 on SSDs. Should be enough for couple of years and then probably upgrade, if needed.

🌐
Zima Store
shop.zimaspace.com › home › support & tips › how to choose between raid 5, raid 6, raidz, and mirrored drives
How to Choose Between RAID 5, RAID 6, RAIDZ, and Mirrored Drives – Zima Store Online
July 8, 2026 - RAIDZ1, RAIDZ2, and mirrors are not just capacity choices. They are long-term topology choices. Most bad RAID decisions happen because capacity is easy to see and rebuild risk is invisible until a drive fails.
Find elsewhere
🌐
TrueNASGuide
truenasguide.com › home › zfs fundamentals › zfs raidz vs mirror: capacity, iops, and resilver risk
ZFS RAIDZ vs Mirror: Capacity, IOPS, and Resilver Risk
May 11, 2026 - Avoid RAIDZ1 on modern multi-terabyte drives — the rebuild window is long enough that a second failure is not negligible. To see the real usable figure for a specific width and disk size, after parity, ashift padding, the ZFS slop reserve, ...
🌐
Proxmox
forum.proxmox.com › home › forums › proxmox virtual environment › proxmox ve: installation and configuration
The problem with RAIDZ or why you probably won't get the storage efficiency you think you will get | Proxmox Support Forum
February 26, 2024 - That leads beginners to believe, that because they don’t need the performance, they will get away with the increased efficiency. They would say stuff like „I only run 5 VMs“ or „only Plex files“ but don’t understand how big of a role geometry plays or what advantages a dataset could offer to them.
🌐
Proxmox
forum.proxmox.com › home › forums › proxmox virtual environment › proxmox ve: installation and configuration
Improving performance of RaidZ1 | Proxmox Support Forum
May 28, 2026 - Hi! One of the nodes I'm using Proxmox in is experiencing high IOwait from time to time, and I'm very confident this is because physical disk bandwidth limitation. The storage being affected is a 3 disk raidZ1 pool, all of them 2.5" SSDs (Mix of crucial and Samsung drives). All of them are...
🌐
Proxmox
forum.proxmox.com › home › forums › proxmox virtual environment › proxmox ve: installation and configuration
ZFS raidz1 and snapshots, again | Proxmox Support Forum
July 2, 2026 - It looks like setting thin provisioning ... I just took the info for one disk for this thread. These servers have 4 disk bays so no option to add more or increase the raid level. Which is why we have 3 backups of all VMs ... I would ...
🌐
Reddit
reddit.com › r/zfs › raidz1 queston
r/zfs on Reddit: RAIDz1 Queston
April 3, 2023 -

As a noob, I keep hearing and reading about the dangers of running a RAIDz1 and losing all your data during the resilver process when a second drive fails. Here's my question. Who has actually experienced this? How often has it happened? I believe most people on this reddit are data driven folks and can weigh the real against the hype. I'd like know how often does a second drive fail?

🌐
ProxmoxR
proxmoxr.com › home › blog › raid configuration for proxmox ve
RAID Configuration for Proxmox VE | ProxmoxR Blog
March 8, 2026 - This makes them ideal for VM storage. RAIDZ1/Z2 suffer from the "RAID 5 write penalty" — every small random write requires reading the old data and parity, computing new parity, and writing both.
🌐
Reddit
reddit.com › r/sysadmin › [deleted by user]
[deleted by user] : r/sysadmin
March 22, 2017 - RAIDZ1 is safer but possibly inconvenient, because while it can tell whether data is correct, it doesn't have a lot of things it can try before it has to give up and declare the data gone, and something like a RAID-6 array would be able to do more before asking you to restore from backups.
🌐
Proxmox
forum.proxmox.com › home › forums › proxmox virtual environment › proxmox ve: installation and configuration
[TUTORIAL] - FabU: Can I use ZFS RaidZ for my VMs? | Proxmox Support Forum
July 9, 2026 - Beginners often confuse hardware RAID5/6 with BBU (which can cache sync writes) with ZFS RaidZ1/2 (with unfortunate block size alignment on consumer drives) just because both can deal with one/two missing drive(s). The performance behavior is indeed completely different (as well as the supported feature set) and RaidZ, as you already explained, is mostly unsuitable for VMs.
🌐
Proxmox
forum.proxmox.com › home › forums › proxmox virtual environment › proxmox ve: installation and configuration
Avoid IO Delay: RAIDz1 vs RAID5 | Proxmox Support Forum
December 21, 2024 - I am currently running a RAIDz1 with 8 classic 3.5 HDDs and 128GB RAM on my Proxmox server. I only run LXCs. These are located on a separate NVMe. ZFS datasets are integrated in various LXCs via mount points. Depending on the data activity on the ZFS datasets, there are always quite high IO...
🌐
Proxmox
forum.proxmox.com › home › forums › proxmox virtual environment › proxmox ve: installation and configuration
ZFS RAIDZ Pool tied with VM disks acts strange | Proxmox Support Forum
January 29, 2025 - (d)RAIDz1/2/3 is also often disappointing for running VMs on as people expect hardware RAID5/6 performance but due to the padding, check-sums and additional features of ZFS it gives much less IOPS.
🌐
Proxmox
forum.proxmox.com › home › forums › proxmox virtual environment › proxmox ve: installation and configuration
About ZFS, RAIDZ1 and disk space | Proxmox Support Forum
June 4, 2022 - And this padding overhead is indirect and only effects zvols. It basically means that everything you will store in a zvol will consume 166% space on the pool. To minimize that padding overhead you will need to increase your volblocksize but this comes with other problems like really bad performance of IO that reads/writes blocks that are smaller than the volblocksize. When using a 6 disk raidz1 with a ashift=12 you would need to increase the volblocksize to atleast 32K to only loose 20% instead of 50% of your raw capacity.
🌐
Proxmox
forum.proxmox.com › home › forums › proxmox virtual environment › proxmox ve: installation and configuration
[SOLVED] - Installation raidz-1 | Proxmox Support Forum
July 8, 2024 - Please be aware that RAIDz1 is terrible for running VMs on because of the low IOPS, massive padding (when volblocksize is small) and huge write amplification (which will wear your consumer drives quickly without PLP) .
🌐
TrueNAS Community
truenas.com › forums › truenas core › general discussion
The problem with RAIDZ | TrueNAS Community
December 13, 2023 - 25% storage efficiency (expected ... and shows what happens if the volblocksize is bigger than the filesize we write. Storage efficiency is very bad, we get IO amplification and fragmentation....
🌐
Reddit
reddit.com › r/zfs › raidz1 vs mirror on nvme
r/zfs on Reddit: RAIDZ1 vs mirror on NVMe
February 2, 2021 -

I'm planning to get 2 or 3 Samsung PM9A1 drives. They're supposed to be extremely fast (7000MB read, 5200 write at 1M IOPS read, 850k IOPS write).

On those I'd be holding mostly running VM disks, the root operating system and possibly source code / compilation artifacts for a container.

Is RAIDZ1 going to somehow tank performance as opposed to mirroring or is ZFS fast enough to saturate the disks in either config?

The way I understand, you'd get perf of a single disk in either configuration, no?

I'm hoping to set up 3 separate EFI partitions, one on each drive, so that any one of them dying won't mean the machine can't boot anymore.

Top answer
1 of 5
25
Is RAIDZ1 going to somehow tank performance as opposed to mirroring or is ZFS fast enough to saturate the disks in either config? You shouldn't expect to get the maximum rated speed out of those NVMe disks with ZFS either way. At SATA SSD speeds, the extra housekeeping ZFS does isn't a scale problem, even with itty bitty (x86) CPUs. At NVMe speeds, it starts being a factor. Beyond that... yes, you will see performance differences between RAIDz1 and mirrors, even on NVMe. Particularly when you're running VMs, which usually means small-blocksize operations. That's just not what striped parity RAID is good at. Keep in mind that the real killer stat here isn't throughput, anyway, it's latency. When you want to write a 64K record to mirrors, it goes in 64K chunks, on each disk in the vdev. When you want to write the same record to a 3-disk RAIDz1, it gets split up into two data chunks and one parity chunk. That's actually not too bad on a 3-disk RAIDz1, because you're still talking about 32K chunks, and you don't have any padding needed since 32K is evenly divisible by either 4K or 8K sector sizes. Still, now you're doing 32K ops instead of 64K ops, and you need to complete those ops on three separate devices instead of two before the op is complete. You're also tying up two of those three devices with every 64K read, where the mirror would only need to query one—and, again, you're waiting for both devices to return data before the read is complete, where you were only waiting on one device with the mirror. It's entirely possible that the NVMe will be fast enough to satisfy you either way. But there will absolutely be a difference in performance.
2 of 5
8
I think the principal values of ZFS are reliability, fault tolerance, and easy disaster recovery. If you're worried about speed, there are file systems that emphasize that more than others. I have two NVMe drives in a mirror and read/write performance has never been a sticking point. The biggest advantage of SSDs is massive reduction in random I/O latency and throughput relative to spinning disks. I also have three spinning disks in a raidz1 configuration. Performance is about as expected for spinning disks, and does not appear to be hindered by the ZFS arrangement. Regarding the ESP: if you're running Linux, you can configure the ESPs in an mdraid mirror. Use metadata version 0.9 or 1.0 because those versions put metadata at the end of the devices; newer versions put it at the beginning. With metadata at the end, your firmware will see all three partitions as independent, valid file systems. Your operating system, on the other hand, will treat them as a mirror and keep the contents in sync.