SPLError: 6166:0:(zfs_znode.c:305:zfs_inode_set_ops()) SPL PANIC

[mschirmacher]

Hey, i hope this is not a duplicate of #27. Unfortunately i have no clue about debugging c-problems ;-)
The system is debian testing with 2.6.38-2-amd64. Furthermore i'm running 0.6.0-RC4.
Here are the whole stacktraces:

[30145.704756] VERIFY(sa_lookup(ITOZ(ip)->z_sa_hdl, SA_ZPL_RDEV(zsb), &rdev, sizeof (rdev)) == 0) failed
[30145.704767] SPLError: 6166:0:(zfs_znode.c:305:zfs_inode_set_ops()) SPL PANIC
[30145.704770] SPL: Showing stack for process 6166
[30145.704774] Pid: 6166, comm: updatedb.mlocat Tainted: P O 2.6.38-2-amd64 #1
[30145.704777] Call Trace:
[30145.704790] [] ? spl_debug_dumpstack+0x26/0x2c [spl]
[30145.704797] [] ? spl_debug_bug+0x7f/0xc8 [spl]
[30145.704821] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[30145.704843] [] ? zfs_zget+0x169/0x194 [zfs]
[30145.704867] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[30145.704891] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[30145.704915] [] ? zfs_dirlook+0x131/0x193 [zfs]
[30145.704936] [] ? zfs_lookup+0x272/0x2ba [zfs]
[30145.704942] [] ? __d_rehash+0x19/0x4d
[30145.704961] [] ? zpl_lookup+0x47/0x80 [zfs]
[30145.704966] [] ? d_alloc_and_lookup+0x43/0x60
[30145.704970] [] ? do_lookup+0x22c/0x27b
[30145.704975] [] ? acl_permission_check+0x54/0x7b
[30145.704979] [] ? link_path_walk+0x23c/0x3a7
[30145.704983] [] ? path_init_rcu+0x9e/0x174
[30145.704988] [] ? do_path_lookup+0x42/0xfc
[30145.704992] [] ? user_path_at+0x46/0x78
[30145.704996] [] ? cp_new_stat+0xe6/0xfa
[30145.705000] [] ? vfs_fstatat+0x38/0x65
[30145.705004] [] ? sys_newlstat+0x11/0x2d
[30145.705008] [] ? system_call_fastpath+0x16/0x1b
[30145.705048] SPL: Dumping log to /tmp/spl-log.1305266443.6166
[30360.676066] INFO: task updatedb.mlocat:6166 blocked for more than 120 seconds.
[30360.676071] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[30360.676074] updatedb.mlocat D ffff880202fa57c0 0 6166 6160 0x00000000
[30360.676080] ffff880202fa57c0 0000000000000086 0000000000000000 ffff88022746ca40
[30360.676086] 0000000000013700 ffff880114aabfd8 ffff880114aabfd8 0000000000013700
[30360.676091] ffff880202fa57c0 ffff880114aaa010 ffff880100040004 0000000114aab7f0
[30360.676097] Call Trace:
[30360.676110] [] ? spl_debug_bug+0xc6/0xc8 [spl]
[30360.676134] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[30360.676156] [] ? zfs_zget+0x169/0x194 [zfs]
[30360.676180] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[30360.676204] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[30360.676228] [] ? zfs_dirlook+0x131/0x193 [zfs]
[30360.676249] [] ? zfs_lookup+0x272/0x2ba [zfs]
[30360.676255] [] ? __d_rehash+0x19/0x4d
[30360.676273] [] ? zpl_lookup+0x47/0x80 [zfs]
[30360.676278] [] ? d_alloc_and_lookup+0x43/0x60
[30360.676283] [] ? do_lookup+0x22c/0x27b
[30360.676287] [] ? acl_permission_check+0x54/0x7b
[30360.676292] [] ? link_path_walk+0x23c/0x3a7
[30360.676296] [] ? path_init_rcu+0x9e/0x174
[30360.676300] [] ? do_path_lookup+0x42/0xfc
[30360.676304] [] ? user_path_at+0x46/0x78
[30360.676308] [] ? cp_new_stat+0xe6/0xfa
[30360.676312] [] ? vfs_fstatat+0x38/0x65
[30360.676316] [] ? sys_newlstat+0x11/0x2d
[30360.676320] [] ? system_call_fastpath+0x16/0x1b
[30480.676077] INFO: task updatedb.mlocat:6166 blocked for more than 120 seconds.
[30480.676081] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[30480.676084] updatedb.mlocat D ffff880202fa57c0 0 6166 6160 0x00000000
[30480.676090] ffff880202fa57c0 0000000000000086 0000000000000000 ffff88022746ca40
[30480.676097] 0000000000013700 ffff880114aabfd8 ffff880114aabfd8 0000000000013700
[30480.676102] ffff880202fa57c0 ffff880114aaa010 ffff880100040004 0000000114aab7f0
[30480.676108] Call Trace:
[30480.676121] [] ? spl_debug_bug+0xc6/0xc8 [spl]
[30480.676145] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[30480.676168] [] ? zfs_zget+0x169/0x194 [zfs]
[30480.676192] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[30480.676216] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[30480.676239] [] ? zfs_dirlook+0x131/0x193 [zfs]
[30480.676261] [] ? zfs_lookup+0x272/0x2ba [zfs]
[30480.676266] [] ? __d_rehash+0x19/0x4d
[30480.676285] [] ? zpl_lookup+0x47/0x80 [zfs]
[30480.676290] [] ? d_alloc_and_lookup+0x43/0x60
[30480.676294] [] ? do_lookup+0x22c/0x27b
[30480.676299] [] ? acl_permission_check+0x54/0x7b
[30480.676303] [] ? link_path_walk+0x23c/0x3a7
[30480.676308] [] ? path_init_rcu+0x9e/0x174
[30480.676312] [] ? do_path_lookup+0x42/0xfc
[30480.676316] [] ? user_path_at+0x46/0x78
[30480.676320] [] ? cp_new_stat+0xe6/0xfa
[30480.676324] [] ? vfs_fstatat+0x38/0x65
[30480.676328] [] ? sys_newlstat+0x11/0x2d
[30480.676333] [] ? system_call_fastpath+0x16/0x1b
[30600.676075] INFO: task updatedb.mlocat:6166 blocked for more than 120 seconds.
[30600.676079] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[30600.676082] updatedb.mlocat D ffff880202fa57c0 0 6166 6160 0x00000000
[30600.676088] ffff880202fa57c0 0000000000000086 0000000000000000 ffff88022746ca40
[30600.676094] 0000000000013700 ffff880114aabfd8 ffff880114aabfd8 0000000000013700
[30600.676100] ffff880202fa57c0 ffff880114aaa010 ffff880100040004 0000000114aab7f0
[30600.676105] Call Trace:
[30600.676118] [] ? spl_debug_bug+0xc6/0xc8 [spl]
[30600.676142] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[30600.676164] [] ? zfs_zget+0x169/0x194 [zfs]
[30600.676188] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[30600.676212] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[30600.676236] [] ? zfs_dirlook+0x131/0x193 [zfs]
[30600.676257] [] ? zfs_lookup+0x272/0x2ba [zfs]
[30600.676263] [] ? __d_rehash+0x19/0x4d
[30600.676282] [] ? zpl_lookup+0x47/0x80 [zfs]
[30600.676287] [] ? d_alloc_and_lookup+0x43/0x60
[30600.676291] [] ? do_lookup+0x22c/0x27b
[30600.676295] [] ? acl_permission_check+0x54/0x7b
[30600.676300] [] ? link_path_walk+0x23c/0x3a7
[30600.676304] [] ? path_init_rcu+0x9e/0x174
[30600.676308] [] ? do_path_lookup+0x42/0xfc
[30600.676312] [] ? user_path_at+0x46/0x78
[30600.676316] [] ? cp_new_stat+0xe6/0xfa
[30600.676320] [] ? vfs_fstatat+0x38/0x65
[30600.676324] [] ? sys_newlstat+0x11/0x2d
[30600.676329] [] ? system_call_fastpath+0x16/0x1b
[30720.676076] INFO: task updatedb.mlocat:6166 blocked for more than 120 seconds.
[30720.676081] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[30720.676084] updatedb.mlocat D ffff880202fa57c0 0 6166 6160 0x00000000
[30720.676090] ffff880202fa57c0 0000000000000086 0000000000000000 ffff88022746ca40
[30720.676096] 0000000000013700 ffff880114aabfd8 ffff880114aabfd8 0000000000013700
[30720.676101] ffff880202fa57c0 ffff880114aaa010 ffff880100040004 0000000114aab7f0
[30720.676107] Call Trace:
[30720.676120] [] ? spl_debug_bug+0xc6/0xc8 [spl]
[30720.676145] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[30720.676167] [] ? zfs_zget+0x169/0x194 [zfs]
[30720.676191] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[30720.676215] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[30720.676238] [] ? zfs_dirlook+0x131/0x193 [zfs]
[30720.676260] [] ? zfs_lookup+0x272/0x2ba [zfs]
[30720.676265] [] ? __d_rehash+0x19/0x4d
[30720.676284] [] ? zpl_lookup+0x47/0x80 [zfs]
[30720.676289] [] ? d_alloc_and_lookup+0x43/0x60
[30720.676293] [] ? do_lookup+0x22c/0x27b
[30720.676298] [] ? acl_permission_check+0x54/0x7b
[30720.676302] [] ? link_path_walk+0x23c/0x3a7
[30720.676306] [] ? path_init_rcu+0x9e/0x174
[30720.676311] [] ? do_path_lookup+0x42/0xfc
[30720.676315] [] ? user_path_at+0x46/0x78
[30720.676319] [] ? cp_new_stat+0xe6/0xfa
[30720.676323] [] ? vfs_fstatat+0x38/0x65
[30720.676326] [] ? sys_newlstat+0x11/0x2d
[30720.676331] [] ? system_call_fastpath+0x16/0x1b
[30840.676076] INFO: task updatedb.mlocat:6166 blocked for more than 120 seconds.
[30840.676080] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[30840.676084] updatedb.mlocat D ffff880202fa57c0 0 6166 6160 0x00000000
[30840.676090] ffff880202fa57c0 0000000000000086 0000000000000000 ffff88022746ca40
[30840.676096] 0000000000013700 ffff880114aabfd8 ffff880114aabfd8 0000000000013700
[30840.676101] ffff880202fa57c0 ffff880114aaa010 ffff880100040004 0000000114aab7f0
[30840.676107] Call Trace:
[30840.676120] [] ? spl_debug_bug+0xc6/0xc8 [spl]
[30840.676145] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[30840.676167] [] ? zfs_zget+0x169/0x194 [zfs]
[30840.676190] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[30840.676214] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[30840.676238] [] ? zfs_dirlook+0x131/0x193 [zfs]
[30840.676259] [] ? zfs_lookup+0x272/0x2ba [zfs]
[30840.676265] [] ? __d_rehash+0x19/0x4d
[30840.676284] [] ? zpl_lookup+0x47/0x80 [zfs]
[30840.676288] [] ? d_alloc_and_lookup+0x43/0x60
[30840.676293] [] ? do_lookup+0x22c/0x27b
[30840.676297] [] ? acl_permission_check+0x54/0x7b
[30840.676302] [] ? link_path_walk+0x23c/0x3a7
[30840.676306] [] ? path_init_rcu+0x9e/0x174
[30840.676310] [] ? do_path_lookup+0x42/0xfc
[30840.676314] [] ? user_path_at+0x46/0x78
[30840.676318] [] ? cp_new_stat+0xe6/0xfa
[30840.676322] [] ? vfs_fstatat+0x38/0x65
[30840.676326] [] ? sys_newlstat+0x11/0x2d
[30840.676331] [] ? system_call_fastpath+0x16/0x1b
[30960.676075] INFO: task updatedb.mlocat:6166 blocked for more than 120 seconds.
[30960.676079] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[30960.676083] updatedb.mlocat D ffff880202fa57c0 0 6166 6160 0x00000000
[30960.676088] ffff880202fa57c0 0000000000000086 0000000000000000 ffff88022746ca40
[30960.676094] 0000000000013700 ffff880114aabfd8 ffff880114aabfd8 0000000000013700
[30960.676100] ffff880202fa57c0 ffff880114aaa010 ffff880100040004 0000000114aab7f0
[30960.676105] Call Trace:
[30960.676118] [] ? spl_debug_bug+0xc6/0xc8 [spl]
[30960.676142] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[30960.676165] [] ? zfs_zget+0x169/0x194 [zfs]
[30960.676188] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[30960.676212] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[30960.676236] [] ? zfs_dirlook+0x131/0x193 [zfs]
[30960.676257] [] ? zfs_lookup+0x272/0x2ba [zfs]
[30960.676263] [] ? __d_rehash+0x19/0x4d
[30960.676282] [] ? zpl_lookup+0x47/0x80 [zfs]
[30960.676287] [] ? d_alloc_and_lookup+0x43/0x60
[30960.676291] [] ? do_lookup+0x22c/0x27b
[30960.676295] [] ? acl_permission_check+0x54/0x7b
[30960.676300] [] ? link_path_walk+0x23c/0x3a7
[30960.676304] [] ? path_init_rcu+0x9e/0x174
[30960.676308] [] ? do_path_lookup+0x42/0xfc
[30960.676312] [] ? user_path_at+0x46/0x78
[30960.676316] [] ? cp_new_stat+0xe6/0xfa
[30960.676320] [] ? vfs_fstatat+0x38/0x65
[30960.676324] [] ? sys_newlstat+0x11/0x2d
[30960.676329] [] ? system_call_fastpath+0x16/0x1b
[31080.676064] INFO: task updatedb.mlocat:6166 blocked for more than 120 seconds.
[31080.676068] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[31080.676071] updatedb.mlocat D ffff880202fa57c0 0 6166 6160 0x00000000
[31080.676077] ffff880202fa57c0 0000000000000086 0000000000000000 ffff88022746ca40
[31080.676083] 0000000000013700 ffff880114aabfd8 ffff880114aabfd8 0000000000013700
[31080.676089] ffff880202fa57c0 ffff880114aaa010 ffff880100040004 0000000114aab7f0
[31080.676094] Call Trace:
[31080.676107] [] ? spl_debug_bug+0xc6/0xc8 [spl]
[31080.676130] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[31080.676153] [] ? zfs_zget+0x169/0x194 [zfs]
[31080.676177] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[31080.676200] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[31080.676224] [] ? zfs_dirlook+0x131/0x193 [zfs]
[31080.676245] [] ? zfs_lookup+0x272/0x2ba [zfs]
[31080.676251] [] ? __d_rehash+0x19/0x4d
[31080.676269] [] ? zpl_lookup+0x47/0x80 [zfs]
[31080.676274] [] ? d_alloc_and_lookup+0x43/0x60
[31080.676279] [] ? do_lookup+0x22c/0x27b
[31080.676283] [] ? acl_permission_check+0x54/0x7b
[31080.676288] [] ? link_path_walk+0x23c/0x3a7
[31080.676292] [] ? path_init_rcu+0x9e/0x174
[31080.676296] [] ? do_path_lookup+0x42/0xfc
[31080.676300] [] ? user_path_at+0x46/0x78
[31080.676304] [] ? cp_new_stat+0xe6/0xfa
[31080.676308] [] ? vfs_fstatat+0x38/0x65
[31080.676312] [] ? sys_newlstat+0x11/0x2d
[31080.676317] [] ? system_call_fastpath+0x16/0x1b
[31200.676075] INFO: task updatedb.mlocat:6166 blocked for more than 120 seconds.
[31200.676079] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[31200.676082] updatedb.mlocat D ffff880202fa57c0 0 6166 6160 0x00000000
[31200.676088] ffff880202fa57c0 0000000000000086 0000000000000000 ffff88022746ca40
[31200.676095] 0000000000013700 ffff880114aabfd8 ffff880114aabfd8 0000000000013700
[31200.676100] ffff880202fa57c0 ffff880114aaa010 ffff880100040004 0000000114aab7f0
[31200.676106] Call Trace:
[31200.676119] [] ? spl_debug_bug+0xc6/0xc8 [spl]
[31200.676143] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[31200.676165] [] ? zfs_zget+0x169/0x194 [zfs]
[31200.676189] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[31200.676213] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[31200.676236] [] ? zfs_dirlook+0x131/0x193 [zfs]
[31200.676258] [] ? zfs_lookup+0x272/0x2ba [zfs]
[31200.676264] [] ? __d_rehash+0x19/0x4d
[31200.676282] [] ? zpl_lookup+0x47/0x80 [zfs]
[31200.676287] [] ? d_alloc_and_lookup+0x43/0x60
[31200.676291] [] ? do_lookup+0x22c/0x27b
[31200.676296] [] ? acl_permission_check+0x54/0x7b
[31200.676300] [] ? link_path_walk+0x23c/0x3a7
[31200.676304] [] ? path_init_rcu+0x9e/0x174
[31200.676309] [] ? do_path_lookup+0x42/0xfc
[31200.676313] [] ? user_path_at+0x46/0x78
[31200.676317] [] ? cp_new_stat+0xe6/0xfa
[31200.676320] [] ? vfs_fstatat+0x38/0x65
[31200.676324] [] ? sys_newlstat+0x11/0x2d
[31200.676329] [] ? system_call_fastpath+0x16/0x1b
[31320.676075] INFO: task updatedb.mlocat:6166 blocked for more than 120 seconds.
[31320.676079] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[31320.676082] updatedb.mlocat D ffff880202fa57c0 0 6166 6160 0x00000000
[31320.676088] ffff880202fa57c0 0000000000000086 0000000000000000 ffff88022746ca40
[31320.676094] 0000000000013700 ffff880114aabfd8 ffff880114aabfd8 0000000000013700
[31320.676100] ffff880202fa57c0 ffff880114aaa010 ffff880100040004 0000000114aab7f0
[31320.676105] Call Trace:
[31320.676118] [] ? spl_debug_bug+0xc6/0xc8 [spl]
[31320.676143] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[31320.676165] [] ? zfs_zget+0x169/0x194 [zfs]
[31320.676189] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[31320.676212] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[31320.676236] [] ? zfs_dirlook+0x131/0x193 [zfs]
[31320.676257] [] ? zfs_lookup+0x272/0x2ba [zfs]
[31320.676263] [] ? __d_rehash+0x19/0x4d
[31320.676282] [] ? zpl_lookup+0x47/0x80 [zfs]
[31320.676287] [] ? d_alloc_and_lookup+0x43/0x60
[31320.676291] [] ? do_lookup+0x22c/0x27b
[31320.676295] [] ? acl_permission_check+0x54/0x7b
[31320.676300] [] ? link_path_walk+0x23c/0x3a7
[31320.676304] [] ? path_init_rcu+0x9e/0x174
[31320.676308] [] ? do_path_lookup+0x42/0xfc
[31320.676312] [] ? user_path_at+0x46/0x78
[31320.676316] [] ? cp_new_stat+0xe6/0xfa
[31320.676320] [] ? vfs_fstatat+0x38/0x65
[31320.676324] [] ? sys_newlstat+0x11/0x2d
[31320.676329] [] ? system_call_fastpath+0x16/0x1b
[31440.676073] INFO: task updatedb.mlocat:6166 blocked for more than 120 seconds.
[31440.676077] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[31440.676081] updatedb.mlocat D ffff880202fa57c0 0 6166 6160 0x00000000
[31440.676086] ffff880202fa57c0 0000000000000086 0000000000000000 ffff88022746ca40
[31440.676092] 0000000000013700 ffff880114aabfd8 ffff880114aabfd8 0000000000013700
[31440.676098] ffff880202fa57c0 ffff880114aaa010 ffff880100040004 0000000114aab7f0
[31440.676103] Call Trace:
[31440.676116] [] ? spl_debug_bug+0xc6/0xc8 [spl]
[31440.676140] [] ? zfs_znode_alloc+0x38a/0x476 [zfs]
[31440.676162] [] ? zfs_zget+0x169/0x194 [zfs]
[31440.676186] [] ? zfs_dirent_lock+0x3e2/0x41f [zfs]
[31440.676209] [] ? zfs_zaccess_aces_check+0x1d5/0x203 [zfs]
[31440.676233] [] ? zfs_dirlook+0x131/0x193 [zfs]
[31440.676254] [] ? zfs_lookup+0x272/0x2ba [zfs]
[31440.676260] [] ? __d_rehash+0x19/0x4d
[31440.676278] [] ? zpl_lookup+0x47/0x80 [zfs]
[31440.676283] [] ? d_alloc_and_lookup+0x43/0x60
[31440.676287] [] ? do_lookup+0x22c/0x27b
[31440.676292] [] ? acl_permission_check+0x54/0x7b
[31440.676296] [] ? link_path_walk+0x23c/0x3a7
[31440.676301] [] ? path_init_rcu+0x9e/0x174
[31440.676305] [] ? do_path_lookup+0x42/0xfc
[31440.676309] [] ? user_path_at+0x46/0x78
[31440.676313] [] ? cp_new_stat+0xe6/0xfa
[31440.676317] [] ? vfs_fstatat+0x38/0x65
[31440.676320] [] ? sys_newlstat+0x11/0x2d
[31440.676325] [] ? system_call_fastpath+0x16/0x1b

[behlendorf]

Actually it's a duplicate of zfs issue #216 which was just fixed (post 0.6.0-rc4). You can pull the latest master source or cherry pick the fix from master. The fix will appear in 0.6.0-rc5 and already exists in Darik's PPA.