Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ZFS hang on high load during simultaneous local + nfs client iozone #417

Closed
b333z opened this issue Sep 30, 2011 · 2 comments
Closed

ZFS hang on high load during simultaneous local + nfs client iozone #417

b333z opened this issue Sep 30, 2011 · 2 comments
Milestone

Comments

@b333z
Copy link
Contributor

b333z commented Sep 30, 2011

Hi All,

Have a problem with ZFS hanging on high load ( local iozone 64 threads at same time remote NFS3 client running 128 threads ).

ZFS Server is running Ubuntu LTS 10.04
Kernel: 2.6.38-11-server #50~lucid1-Ubuntu SMP Tue Sep 13 22:10:53 UTC 2011 x86_64 GNU/Linux
ZFS is from PPA: https://launchpad.net/~zfs-native/+archive/stable - version: 0.6.0.33

The ZFS server has hyperthreading disabled, 48GB RAM, drives are JBOD's on 2 megaraid_sas controllers, the raid2z is sata 2TB, the ZIL drives on the other controller are sas.

The nfs client is a similar server, and they are connected via 10Gb NICS ( ixgbe )

Locally am running:

while true; do iozone -l 64 -o -O -s 32m -r 4k; sleep 1; done

At the same time, another server is running this to a different zfs filesystem ( same pool ) via nfs client:

while true; do iozone -l 128 -o -O -s 32m -r 4k; sleep 1; done

During testing load average sits at about 80, lots of space free on the pool.

Test runs for about an 1 hour before the local iozone causes:

Sep 30 12:44:43 melstg04 kernel: [10158.875901] CPU 1
Sep 30 12:44:43 melstg04 kernel: [10158.875908] Modules linked in: zfs(P) zcommon(P) znvpair(P) zavl(P) zunicode(P) spl zlib_deflate nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc ixgbe lp parport mdio i7core_edac psmouse ioatdma joydev edac_core serio_raw ghes hed raid10 raid456 async_pq async_xor xor async_memcpy async_raid6_recov ses enclosure usbhid hid raid6_pq async_tx igb raid1 dca megaraid_sas raid0 multipath linear
Sep 30 12:44:43 melstg04 kernel: [10158.876162]
Sep 30 12:44:43 melstg04 kernel: [10158.876183] Pid: 5664, comm: iozone Tainted: P            2.6.38-11-server #50~lucid1-Ubuntu Supermicro X8DT3/X8DT3
Sep 30 12:44:43 melstg04 kernel: [10158.876247] RIP: 0010:[<ffffffffa02e8d18>]  [<ffffffffa02e8d18>] tsd_hash_search+0x98/0xe0 [spl]
Sep 30 12:44:43 melstg04 kernel: [10158.876310] RSP: 0018:ffff880504e01bb8  EFLAGS: 00010286
Sep 30 12:44:43 melstg04 kernel: [10158.876338] RAX: dead000000100100 RBX: ffff88056af07540 RCX: 0000000000000037
Sep 30 12:44:43 melstg04 kernel: [10158.876369] RDX: dead000000100100 RSI: 1000000000000000 RDI: ffff88060e0ea5b0
Sep 30 12:44:43 melstg04 kernel: [10158.876401] RBP: ffff880504e01bd8 R08: ffffffff4f002c40 R09: 0000000000001000
Sep 30 12:44:43 melstg04 kernel: [10158.876432] R10: 0000000000000001 R11: 0000000000000000 R12: ffff88060e0ea5b0
Sep 30 12:44:43 melstg04 kernel: [10158.876464] R13: 0000000000000002 R14: 0000000000001620 R15: 0000000000008000
Sep 30 12:44:43 melstg04 kernel: [10158.876496] FS:  00007fa529da5700(0000) GS:ffff8800bb420000(0000) knlGS:0000000000000000
Sep 30 12:44:43 melstg04 kernel: [10158.876544] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Sep 30 12:44:43 melstg04 kernel: [10158.876572] CR2: 00007f0b08dbb000 CR3: 000000026d34a000 CR4: 00000000000006e0
Sep 30 12:44:43 melstg04 kernel: [10158.876604] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Sep 30 12:44:43 melstg04 kernel: [10158.876636] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Sep 30 12:44:43 melstg04 kernel: [10158.876668] Process iozone (pid: 5664, threadinfo ffff880504e00000, task ffff88060c548000)
Sep 30 12:44:43 melstg04 kernel: [10158.876735]  0000000000000009 0000000000009002 ffff8807de0cc830 0000000000001000
Sep 30 12:44:43 melstg04 kernel: [10158.876791]  ffff880504e01be8 ffffffffa02e92cd ffff880504e01c68 ffffffffa03fa411
Sep 30 12:44:43 melstg04 kernel: [10158.876846]  000000004e852d1b 0000002c000e91b0 ffff880c0b6fe000 ffff88060c743c80
Sep 30 12:44:43 melstg04 kernel: [10158.876931]  [<ffffffffa02e92cd>] tsd_get+0x3d/0x50 [spl]
Sep 30 12:44:43 melstg04 kernel: [10158.877000]  [<ffffffffa03fa411>] zfs_log_write+0xa1/0x340 [zfs]
Sep 30 12:44:43 melstg04 kernel: [10158.877064]  [<ffffffffa0407859>] zfs_write+0x919/0xc90 [zfs]
Sep 30 12:44:43 melstg04 kernel: [10158.877097]  [<ffffffff8110ba8b>] ? filemap_fault+0x8b/0x4b0
Sep 30 12:44:43 melstg04 kernel: [10158.877160]  [<ffffffffa0419382>] zpl_write_common+0x52/0x70 [zfs]
Sep 30 12:44:43 melstg04 kernel: [10158.877223]  [<ffffffffa0419408>] zpl_write+0x68/0xa0 [zfs]
Sep 30 12:44:43 melstg04 kernel: [10158.877254]  [<ffffffff81164058>] vfs_write+0xc8/0x190
Sep 30 12:44:43 melstg04 kernel: [10158.877282]  [<ffffffff81164211>] sys_write+0x51/0x90
Sep 30 12:44:43 melstg04 kernel: [10158.877311]  [<ffffffff8100c042>] system_call_fastpath+0x16/0x1b
Sep 30 12:44:43 melstg04 kernel: [10158.877613]  RSP <ffff880504e01bb8>
Sep 30 12:44:43 melstg04 kernel: [10158.877895] ---[ end trace f6a9e4a2a6bc14a8 ]---

Here is another, this once has matching arcstat below:

    Sep 30 15:20:15 melstg04 kernel: [ 1008.277218] CPU 0
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277224] Modules linked in: nfsd exportfs nfs lockd fscache nfs_acl auth_rpcgss sunrpc zfs(P) zcommon(P) znvpair(P) zavl(P) zunicode(P) spl zlib_deflate lp parport psmouse ixgbe i7core_edac mdio edac_core serio_raw ioatdma joydev ghes hed raid10 raid456 async_pq async_xor xor async_memcpy async_raid6_recov ses enclosure usbhid hid raid6_pq async_tx raid1 raid0 megaraid_sas multipath igb dca linear
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277477]
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277498] Pid: 3492, comm: iozone Tainted: P            2.6.38-11-server #50~lucid1-Ubuntu Supermicro X8DT3/X8DT3
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277563] RIP: 0010:[<ffffffffa013ad18>]  [<ffffffffa013ad18>] tsd_hash_search+0x98/0xe0 [spl]
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277626] RSP: 0018:ffff880386967bb8  EFLAGS: 00010286
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277654] RAX: dead000000100100 RBX: ffff880550ceea20 RCX: 0000000000000037
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277686] RDX: dead000000100100 RSI: d200000000000000 RDI: ffff880c0bc08cf0
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277717] RBP: ffff880386967bd8 R08: ffffffff92e01b48 R09: 0000000000001000
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277749] R10: 0000000000000001 R11: 0000000000000000 R12: ffff880c0bc08cf0
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277780] R13: 0000000000000002 R14: 0000000000000da4 R15: 0000000000008000
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277812] FS:  00007fdc87752700(0000) GS:ffff8800bb400000(0000) knlGS:0000000000000000
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277860] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277888] CR2: 00007f5443280000 CR3: 0000000386958000 CR4: 00000000000006f0
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277920] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277951] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
    Sep 30 15:20:15 melstg04 kernel: [ 1008.277983] Process iozone (pid: 3492, threadinfo ffff880386966000, task ffff880386968000)
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278051]  0000000000000009 0000000000009002 ffff8805fe06b7d0 0000000000001000
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278106]  ffff880386967be8 ffffffffa013b2cd ffff880386967c68 ffffffffa0380411
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278161]  000000004e85518f 0000002c0006b7db ffff8805e8109000 ffff8806063fb080
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278247]  [<ffffffffa013b2cd>] tsd_get+0x3d/0x50 [spl]
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278321]  [<ffffffffa0380411>] zfs_log_write+0xa1/0x340 [zfs]
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278386]  [<ffffffffa038d859>] zfs_write+0x919/0xc90 [zfs]
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278419]  [<ffffffff8108bf50>] ? __srcu_read_lock+0x0/0x30
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278481]  [<ffffffffa039f382>] zpl_write_common+0x52/0x70 [zfs]
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278545]  [<ffffffffa039f408>] zpl_write+0x68/0xa0 [zfs]
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278576]  [<ffffffff81164058>] vfs_write+0xc8/0x190
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278605]  [<ffffffff811641b2>] sys_pwrite64+0x92/0xa0
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278635]  [<ffffffff8100c042>] system_call_fastpath+0x16/0x1b
    Sep 30 15:20:15 melstg04 kernel: [ 1008.278938]  RSP <ffff880386967bb8>
    Sep 30 15:20:15 melstg04 kernel: [ 1008.279209] ---[ end trace d22dcd07fd3672e1 ]---

Some arstats at the time of failure:

    time  mtxmis  arcsz  mrug  l2hit%  mh%  l2miss%  read     c  mfug  miss  dm%  dhit  pread  dread  pmis  l2miss  l2bytes  pm%  mm%  hits   mfu  l2read  mmis  rmis  mhit  dmis   mru  ph%  eskip  l2size  l2hits  hit%  miss%  dh%  mread  phit
15:19:35       0    16G     0       0  100        0  5.8K   48G     0     0    0  5.8K      0   5.8K     0       0        0    0    0  5.8K  5.8K       0     0     0    13     0  2.0K    0      0       0       0   100      0  100    13
   0
15:19:36       0    17G     0       0  100        0  5.1K   48G     0     0    0  5.1K      0   5.1K     0       0        0    0    0  5.1K  5.1K       0     0     0    14     0  1.7K    0      0       0       0   100      0  100    14     0
15:19:37       0    17G     0       0  100        0  7.0K   48G     0     0    0  7.0K      0   7.0K     0       0        0    0    0  7.0K  7.0K       0     0     0    14     0  2.4K    0      0       0       0   100      0  100    14     0
15:19:38       0    17G     0       0  100        0  4.8K   48G     0     0    0  4.8K      0   4.8K     0       0        0    0    0  4.8K  4.8K       0     0     0    14     0  1.6K    0      0       0       0   100      0  100    14     0
15:19:39       0    17G     0       0  100        0  5.1K   48G     0     0    0  5.1K      0   5.1K     0       0        0    0    0  5.1K  5.1K       0     0     0    23     0  1.8K    0      0       0       0   100      0  100    23     0
15:19:40       0    17G     0       0  100        0  5.7K   48G     0     0    0  5.7K      0   5.7K     0       0        0    0    0  5.7K  5.7K       0     0     0    13     0  2.0K    0      0       0       0   100      0  100    13     0
15:19:41       0    17G     0       0  100        0  6.6K   48G     0     0    0  6.6K      0   6.6K     0       0        0    0    0  6.6K  6.6K       0     0     0    15     0  2.2K    0      0       0       0   100      0  100    15     0
15:19:42       0    17G     0       0  100        0  5.1K   48G     0     0    0  5.1K      0   5.1K     0       0        0    0    0  5.1K  5.1K       0     0     0    16     0  1.8K    0      0       0       0   100      0  100    16     0
15:19:43       0    17G     0       0  100        0  3.9K   48G     0     0    0  3.9K      0   3.9K     0       0        0    0    0  3.9K  3.9K       0     0     0    14     0  1.4K    0      0       0       0   100      0  100    14     0
15:19:44       0    17G     0       0  100        0    13   48G     0     0    0    13      0     13     0       0        0    0    0    13    13       0     0     0    13     0     9    0      0       0       0   100      0  100    13     0
15:19:45       0    17G     0       0  100        0     6   48G     0     0    0     6      0      6     0       0        0    0    0     6     6       0     0     0     6     0     6    0      0       0       0   100      0  100     6     0
15:19:46       0    17G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:47       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:48       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:49       0    15G     0       0  100        0   138   48G     0     0    0   138      0    138     0       0        0    0    0   138   138       0     0     0    24     0   122    0      0       0       0   100      0  100    24     0
    time  mtxmis  arcsz  mrug  l2hit%  mh%  l2miss%  read     c  mfug  miss  dm%  dhit  pread  dread  pmis  l2miss  l2bytes  pm%  mm%  hits   mfu  l2read  mmis  rmis  mhit  dmis   mru  ph%  eskip  l2size  l2hits  hit%  miss%  dh%  mread  phit
15:19:50       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:51       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:52       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:53       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:54       0    15G     0       0  100        0    16   48G     0     0    0    16      0     16     0       0        0    0    0    16    16       0     0     0    13     0    12    0      0       0       0   100      0  100    13     0
15:19:55       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:56       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:57       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:58       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:19:59       0    15G     0       0  100        0    17   48G     0     0    0    17      0     17     0       0        0    0    0    17    17       0     0     0    14     0    13    0      0       0       0   100      0  100    14     0
15:20:00       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:01       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:02       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:03       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:04       0    15G     0       0  100        0   131   48G     0     0    0   131      0    131     0       0        0    0    0   131   131       0     0     0    23     0   117    0      0       0       0   100      0  100    23     0
15:20:05       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:06       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:07       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:08       0    15G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:09       0    16G     0       0  100        0    63   48G     0     0    0    63      0     63     0       0        0    0    0    63    63       0     0     0    13     0    57    0      0       0       0   100      0  100    13     0
15:20:10       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
    time  mtxmis  arcsz  mrug  l2hit%  mh%  l2miss%  read     c  mfug  miss  dm%  dhit  pread  dread  pmis  l2miss  l2bytes  pm%  mm%  hits   mfu  l2read  mmis  rmis  mhit  dmis   mru  ph%  eskip  l2size  l2hits  hit%  miss%  dh%  mread  phit
15:20:11       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:12       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:13       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:14       0    16G     0       0  100        0    57   48G     0     0    0    57      0     57     0       0        0    0    0    57    57       0     0     0    15     0    51    0      0       0       0   100      0  100    15     0
15:20:15       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:16       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:17       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:18       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:19       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:20       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:21       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:22       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:23       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:24       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:25       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:26       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:27       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:28       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:29       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:30       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0
15:20:31       0    16G     0       0    0        0     0   48G     0     0    0     0      0      0     0       0        0    0    0     0     0       0     0     0     0     0     0    0      0       0       0     0      0    0     0     0

The pool consists of:

sudo zpool status
  pool: tank
 state: ONLINE
 scan: none requested
config:

        NAME        STATE     READ WRITE CKSUM
        tank        ONLINE       0     0     0
          raidz2-0  ONLINE       0     0     0
            sde     ONLINE       0     0     0
            sdf     ONLINE       0     0     0
            sdg     ONLINE       0     0     0
            sdh     ONLINE       0     0     0
            sdi     ONLINE       0     0     0
            sdj     ONLINE       0     0     0
            sdk     ONLINE       0     0     0
        logs
          mirror-1  ONLINE       0     0     0
            sda     ONLINE       0     0     0
            sdb     ONLINE       0     0     0
          mirror-2  ONLINE       0     0     0
            sdc     ONLINE       0     0     0
            sdd     ONLINE       0     0     0

Once the issue has occured, there is no further io, will respond to pings, no new ssh, nfs client hangs, existing ssh still alive but would not reboot, have to press button.

Am able to replicate the failure, happy to provide info or assist.

@behlendorf
Copy link
Contributor

Is this still an issue in the latest code?

@behlendorf
Copy link
Contributor

Closing as a likely duplicate of openzfs/spl#174 which was fixed by openzfs/spl@6ef94aa in spl-0.6.0-rc14.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants