198892 2007-11-12 06:03 0000 boot w/ mdadm fails to find device nodes and also flunks multiple devices 2008-02-14 06:10:54 0000 1 1 1 Unclassified Gentoo Hosted Projects genkernel unspecified All Linux RESOLVED FIXED P2 major --- 1 robbat2@gentoo.org genkernel@gentoo.org javier@miqueleiz.com robbat2@gentoo.org 2007-11-12 06:03:23 0000 Booting on my G5, with domdadm. I have 3 MD devices, md0 = /boot, md1 = /, md2 = LVM. >> Detected real_root as a md device. Setting up the device node... mdadm: error opening /dev/md/0: No such file or directory mdadm: failed to open array mdadm: error opening /dev/md/1: No such file or directory mdadm: failed to open array mdadm: error opening /dev/md/2: No such file or directory mdadm: failed to open array >> ... I changed the /etc/mdadm.conf in the initramfs to use the /dev/mdX names instead of /dev/md/X, and then I found that it only starts the first device listed in the mdadm.conf file. The /etc/mdadm.conf was generated with the busybox mdadm in the first place, so I guess it fails for the lack of the /dev/md/ directory. wolf31o2@gentoo.org 2007-11-13 22:50:45 0000 OK. How do I fix it, then? javier@miqueleiz.com 2007-11-18 22:44:35 0000 Seems a bug with busybox mdadm patch. The function "int mdassemble_main()" expects the "/dev/md" string (without the trailing /). This function is called to assemble the arrays. In contrast, the function "brief_examine_super1()" writes "ARRAY /dev/md/". This function is invoked in order to examine the devices (the output of /etc/mdadm.conf comes from this one). I tried deleting the slash in "brief_examine_super1()". Now works for me. The array is assembled. There seems to be another bug in the function "int mdassemble_main()". The if condition for creating the node should be based on errno instead of the return value of strtoul(). This function returns a long value (the minor number), not an error condition. Want to test with more than one array to verify things. But seems pretty clear. The patch to mdadm is trivial, but can provide it anyway. javier@miqueleiz.com 2007-11-20 12:35:01 0000 Created an attachment (id=136482) Additional patch for busybox mdadm javier@miqueleiz.com 2007-11-20 12:53:50 0000 Attached the patch. Have tested it creating up to 3 different arrays. All of them are started ok. Have found problems if the metadata version is 1.1 or 1.2 (haven't tried with the old version 0.9). Only version 1.0 arrays are started. BTW, sys-fs/mdadm was also affected by a bug similar to this (was fixed in release 2.6.3 though). Perhaps both bugs are related. robbat2@gentoo.org 2007-11-20 14:03:18 0000 I'll try it in 12 hours or so. I have 0.9, 1.0 and 1.1 metadata arrays. Some mdadm/kernel versions have a glitch that causes them to behave weirdly with metadata 1.0 arrays as well. wolf31o2@gentoo.org 2007-11-24 15:59:52 0000 Robin: any word? robbat2@gentoo.org 2007-11-24 20:57:16 0000 Ok, it generates the mdadm.conf correctly now, 0.9 metadata works fine, v1.1 is detected, but not assembled: 'no devices found' javier@miqueleiz.com 2007-11-26 20:04:32 0000 Thank you for testing, Robin ;-). You confirm we still have some bugs with versions 1.1 and 1.2. Versions 0.9 and 1.0 are working ok. I will have a look at busybox mdadm and try to propose a patch. I expect to do it this week. BTW, could you be more explicit about that bug regarding some mdadm/kernel versions? robbat2@gentoo.org 2007-11-26 23:35:30 0000 For the main mdadm/kernel bugs, boot one of the pre-release 2007.1 media (I ran into the bug on the ppc64 media that I was testing for rangerpb), and try to create a 1.0 array. It will be created, but mdadm will fail to start it. If you then try to assemble it manually using the sysfs interface, you'll get a backtrace in the kernel, and the box hangs in some cases. That's why my md3 is v1.1 actually. I prefer 1.0 and 0.9, since the superblocks are at the end of the device, so they don't block unmodified booting of a RAID1 device. I was using real disk, and I'm not sure if it happens with loop devices offhand (it should tho). (see "man md" for the exact details). 0.9 - superblock located in the last 64-128K of device, 64Kb in size. 1.0 - superblock located in the last 8-12K of device. 1.1 - at start of device. 1.2 - starting at 4K in the device. wolf31o2@gentoo.org 2007-11-28 21:46:49 0000 I've gone ahead and added this. I'd rather we support *some* of the versions than none. wolf31o2@gentoo.org 2007-11-28 22:32:08 0000 This should be done in 3.4.9_pre10 which will be hitting the tree soon. javier@miqueleiz.com 2007-11-29 19:46:15 0000 Seems reasonable to me. We only gain functionality since it doesn't work now. A fully working version supporting all 4 metadata types could be released in another genkernel revision. Just my opinion. I would like to hear Robin about this. robbat2@gentoo.org 2007-11-29 20:22:12 0000 we're only moving forward by including it, no objections from me. getting there in small steps is a help when doing a big step in one go isn't available. javier@miqueleiz.com 2008-02-11 06:59:48 0000 Attached a new patch against sys-kernel/genkernel-3.4.9 to support all 4 metadata versions (i.e., 0.9, 1.0, 1.1 and 1.2). The patch is based on some changes from full mdadm-2.6.2 to mdadm-2.6.3 (so credit should go to Neil Brown). Have reasonably tested and think it should work fine. javier@miqueleiz.com 2008-02-11 07:01:36 0000 Created an attachment (id=143185) Additional patch to support 1.1 and 1.2 metadata versions wolf31o2@gentoo.org 2008-02-14 06:10:54 0000 OK, I added the mdadm3 patch to SVN, so it'll show up in 3.4.10_pre2... 136482 2007-11-20 12:35 0000 Additional patch for busybox mdadm busybox-1.1.3+gentoo-mdadm-r1.patch text/plain ZGlmZiAtdXIgYnVzeWJveC0xLjEuMytnZW50b28vbWRhZG0vbWRhc3NlbWJsZS5jIGJ1c3lib3gt MS4xLjMrZ2VudG9vLW1kYWRtLXIxL21kYWRtL21kYXNzZW1ibGUuYwotLS0gYnVzeWJveC0xLjEu MytnZW50b28vbWRhZG0vbWRhc3NlbWJsZS5jCTIwMDctMTEtMjAgMTE6MzM6NTIuMDAwMDAwMDAw ICswMTAwCisrKyBidXN5Ym94LTEuMS4zK2dlbnRvby1tZGFkbS1yMS9tZGFkbS9tZGFzc2VtYmxl LmMJMjAwNy0xMS0yMCAxMToyNDo0OC4wMDAwMDAwMDAgKzAxMDAKQEAgLTg4Myw3ICs4ODMsOSBA QAogCQlmb3IgKDsgYXJyYXlfbGlzdDsgYXJyYXlfbGlzdCA9IGFycmF5X2xpc3QtPm5leHQpIHsK IAkJCW1kdV9hcnJheV9pbmZvX3QgYXJyYXk7CiAJCQlpZiAoIXN0cm5jbXAoIi9kZXYvbWQiLCBh cnJheV9saXN0LT5kZXZuYW1lLCA3KSkgewotCQkJCWlmICghKG1pbm9yID0gc3RydG91bChhcnJh eV9saXN0LT5kZXZuYW1lICsgNywgTlVMTCwgMCkpKSB7CisJCQkgICAJZXJybm8gPSAwOworCQkJ CW1pbm9yID0gc3RydG91bChhcnJheV9saXN0LT5kZXZuYW1lICsgNywgTlVMTCwgMCk7CisJCQkJ aWYgKCFlcnJubykgewogCQkJCQlta25vZChhcnJheV9saXN0LT5kZXZuYW1lLCBTX0lGQkxLfDA2 MDAsIG1ha2VkZXYoTURfTUFKT1IsIG1pbm9yKSk7CiAJCQkJfQogCQkJfQpkaWZmIC11ciBidXN5 Ym94LTEuMS4zK2dlbnRvby9tZGFkbS9zdXBlcjEuYyBidXN5Ym94LTEuMS4zK2dlbnRvby1tZGFk bS1yMS9tZGFkbS9zdXBlcjEuYwotLS0gYnVzeWJveC0xLjEuMytnZW50b28vbWRhZG0vc3VwZXIx LmMJMjAwNy0xMS0yMCAxMTozMzo1Mi4wMDAwMDAwMDAgKzAxMDAKKysrIGJ1c3lib3gtMS4xLjMr Z2VudG9vLW1kYWRtLXIxL21kYWRtL3N1cGVyMS5jCTIwMDctMTEtMjAgMTE6MjQ6NDguMDAwMDAw MDAwICswMTAwCkBAIC0xNTYsNyArMTU2LDcgQEAKIAllbHNlCiAJCW5tID0gIj8/IjsKIAotCXBy aW50ZigiQVJSQVkgL2Rldi9tZC8lcyBsZXZlbD0lcyBtZXRhZGF0YT0xIG51bS1kZXZpY2VzPSVk IFVVSUQ9IiwKKwlwcmludGYoIkFSUkFZIC9kZXYvbWQlcyBsZXZlbD0lcyBtZXRhZGF0YT0xIG51 bS1kZXZpY2VzPSVkIFVVSUQ9IiwKIAkgICAgICAgbm0sCiAJICAgICAgIGM/YzoiLXVua25vd24t IiwgX19sZTMyX3RvX2NwdShzYi0+cmFpZF9kaXNrcykpOwogCWZvciAoaT0wOyBpPDE2OyBpKysp IHsK 143185 2008-02-11 07:01 0000 Additional patch to support 1.1 and 1.2 metadata versions busybox-1.1.3+gentoo-mdadm3.patch text/plain ZGlmZiAtdXIgYnVzeWJveC0xLjEuMytnZW50b28vbWRhZG0vc3VwZXIxLmMgYnVzeWJveC0xLjEu MytnZW50b28tbWRhZG0tcjIvbWRhZG0vc3VwZXIxLmMKLS0tIGJ1c3lib3gtMS4xLjMrZ2VudG9v L21kYWRtL3N1cGVyMS5jCTIwMDgtMDItMTAgMTk6MDc6NTEuMDAwMDAwMDAwICswMTAwCisrKyBi dXN5Ym94LTEuMS4zK2dlbnRvby1tZGFkbS1yMi9tZGFkbS9zdXBlcjEuYwkyMDA4LTAyLTA1IDIy OjE5OjMyLjAwMDAwMDAwMCArMDEwMApAQCAtMTQ1LDYgKzE0NSw3IEBACiB7CiAJc3RydWN0IG1k cF9zdXBlcmJsb2NrXzEgKnNiID0gc2J2OwogCWludCBpOworCXVuc2lnbmVkIGxvbmcgbG9uZyBz Yl9vZmZzZXQ7CiAJY2hhciAqbm07CiAJY2hhciAqYz1tYXBfbnVtKHBlcnMsIF9fbGUzMl90b19j cHUoc2ItPmxldmVsKSk7CiAKQEAgLTE1Niw5ICsxNTcsMTUgQEAKIAllbHNlCiAJCW5tID0gIj8/ IjsKIAotCXByaW50ZigiQVJSQVkgL2Rldi9tZCVzIGxldmVsPSVzIG1ldGFkYXRhPTEgbnVtLWRl dmljZXM9JWQgVVVJRD0iLAotCSAgICAgICBubSwKLQkgICAgICAgYz9jOiItdW5rbm93bi0iLCBf X2xlMzJfdG9fY3B1KHNiLT5yYWlkX2Rpc2tzKSk7CisJcHJpbnRmKCJBUlJBWSAvZGV2L21kJXMg bGV2ZWw9JXMgIiwgbm0sIGM/YzoiLXVua25vd24tIik7CisJc2Jfb2Zmc2V0ID0gX19sZTY0X3Rv X2NwdShzYi0+c3VwZXJfb2Zmc2V0KTsKKwlpZiAoc2Jfb2Zmc2V0IDw9IDQpCisJCXByaW50Zigi bWV0YWRhdGE9MS4xICIpOworCWVsc2UgaWYgKHNiX29mZnNldCA8PSA4KQorCQlwcmludGYoIm1l dGFkYXRhPTEuMiAiKTsKKwllbHNlCisJCXByaW50ZigibWV0YWRhdGE9MS4wICIpOworCXByaW50 ZigibnVtLWRldmljZXM9JWQgVVVJRD0iLCBfX2xlMzJfdG9fY3B1KHNiLT5yYWlkX2Rpc2tzKSk7 CiAJZm9yIChpPTA7IGk8MTY7IGkrKykgewogCQlpZiAoKGkmMyk9PTAgJiYgaSAhPSAwKSBwcmlu dGYoIjoiKTsKIAkJcHJpbnRmKCIlMDJ4Iiwgc2ItPnNldF91dWlkW2ldKTsK