PDA

View Full Version : [ubuntu] 9.10 dist-upgrade w/ raid1/5 grub errors



trouserless
February 12th, 2010, 07:36 PM
Greetings All,
Recently I performed a remote upgrade from 9.04 to 9.10 (server). It was a dist-upgrade that I tested on smaller/different systems without problems. The upgrade went well until the reboot, where the default kernel booted to busybox as it could not mount my raid volumes and then after ~10 seconds froze


title Ubuntu 9.10, kernel 2.6.31-19-generic-pae
root (hd0,0)
kernel /vmlinuz-2.6.31-19-generic-pae root=/dev/md2 ro quiet splash
initrd /initrd.img-2.6.31-19-generic-pae


I was able to revert to the previous working kernel:


title Ubuntu 9.10, kernel 2.6.28-17-server
root (hd0,0)
kernel /vmlinuz-2.6.28-17-server root=/dev/md2 ro quiet splash
initrd /initrd.img-2.6.28-17-server

and with busybox was able to start/mount my raid devices with mdadm -A --scan

My raid configuration is all software with md. I have three individual disks where the first slice of each disk is /boot in raid1, the 2nd slice of each disk is swap in raid1 and the third slice of each disk is / in raid5.

What it looks like is that grub2


ii grub 0.97-29ubuntu59 GRand Unified Bootloader
ii grub-common 1.97~beta4-1ubuntu4.1 GRand Unified Bootloader, version 2 (common

was installed and is not able to mount the / partition. I have read a number of posts about problems with grub2 and md. What is the long-term fix for this? I've not updated this server yet as I'm waiting to solve this problem first. I've searched around the forums and see a lot of posts about fakeraid (which I am not using), but nothing specifically addressing what I'm seeing. I did see the post (http://ubuntuforums.org/showthread.php?t=1352046) but my grub menu is setup properly according to that post.

Any help would be greatly appreciated!

** I might add I'm running ext4 and had previously (well before 9.10 upgrade) copied (dd'd) my MBR to all three drives in the event that the first drive failed.


** after reading other posts, I've run boot_info script:

============================= Boot Info Summary: ==============================

=> Grub 0.97 is installed in the MBR of /dev/sda and looks on the same drive
in partition #1 for /grub/stage2 and /grub/menu.lst.
=> Grub 0.97 is installed in the MBR of /dev/sdb and looks on the same drive
in partition #1 for /grub/stage2 and /grub/menu.lst.
=> Grub 0.97 is installed in the MBR of /dev/sdc and looks on the same drive
in partition #1 for /grub/stage2 and /grub/menu.lst.
sda1: __________________________________________________ _______________________

File system: linux_raid_member
Boot sector type: -
Boot sector info:

sda2: __________________________________________________ _______________________

File system: linux_raid_member
Boot sector type: -
Boot sector info:

sda3: __________________________________________________ _______________________

File system: linux_raid_member
Boot sector type: -
Boot sector info:

sdb1: __________________________________________________ _______________________

File system: linux_raid_member
Boot sector type: -
Boot sector info:

sdb2: __________________________________________________ _______________________

File system: linux_raid_member
Boot sector type: -
Boot sector info:

sdb3: __________________________________________________ _______________________

File system: linux_raid_member
Boot sector type: Unknown
Boot sector info:

sdc1: __________________________________________________ _______________________

File system: linux_raid_member
Boot sector type: -
Boot sector info:

sdc2: __________________________________________________ _______________________
File system: linux_raid_member
Boot sector type: -
Boot sector info:

sdc3: __________________________________________________ _______________________

File system: linux_raid_member
Boot sector type: Unknown
Boot sector info:

md0: __________________________________________________ _______________________

File system: ext4
Boot sector type: -
Boot sector info:
Operating System:
Boot files/dirs: /grub/menu.lst

md1: __________________________________________________ _______________________

File system: swap
Boot sector type: -
Boot sector info:

md2: __________________________________________________ _______________________

File system: ext4
Boot sector type: -
Boot sector info:
Operating System: Ubuntu 9.10
Boot files/dirs: /etc/fstab

=========================== Drive/Partition Info: =============================

Drive: sda ___________________ __________________________________________________ ___

Disk /dev/sda: 146.8 GB, 146815733760 bytes
255 heads, 63 sectors/track, 17849 cylinders, total 286749480 sectors
Units = sectors of 1 * 512 = 512 bytes
Disk identifier: 0xeb1eeb20

Partition Boot Start End Size Id System

/dev/sda1 * 63 1,959,929 1,959,867 fd Linux raid autodetect
/dev/sda2 1,959,930 17,591,174 15,631,245 fd Linux raid autodetect
/dev/sda3 17,591,175 286,744,184 269,153,010 fd Linux raid autodetect


Drive: sdb ___________________ __________________________________________________ ___
Disk /dev/sdb: 146.8 GB, 146815733760 bytes
255 heads, 63 sectors/track, 17849 cylinders, total 286749480 sectors
Units = sectors of 1 * 512 = 512 bytes
Disk identifier: 0xeb1eeb20

Partition Boot Start End Size Id System

/dev/sdb1 * 63 1,959,929 1,959,867 fd Linux raid autodetect
/dev/sdb2 1,959,930 17,591,174 15,631,245 fd Linux raid autodetect
/dev/sdb3 17,591,175 286,744,184 269,153,010 fd Linux raid autodetect


Drive: sdc ___________________ __________________________________________________ ___

Disk /dev/sdc: 146.8 GB, 146815733760 bytes
255 heads, 63 sectors/track, 17849 cylinders, total 286749480 sectors
Units = sectors of 1 * 512 = 512 bytes
Disk identifier: 0xeb1eeb20

Partition Boot Start End Size Id System

/dev/sdc1 * 63 1,959,929 1,959,867 fd Linux raid autodetect
/dev/sdc2 1,959,930 17,591,174 15,631,245 fd Linux raid autodetect
/dev/sdc3 17,591,175 286,744,184 269,153,010 fd Linux raid autodetect


blkid -c /dev/null: __________________________________________________ __________

Device UUID TYPE LABEL

/dev/md0 78b29bb7-0b36-4743-ac98-392143009c78 ext4
/dev/md1 swap
/dev/md2 19247821-a140-4973-bde9-41be606fcf09 ext4
/dev/sda1 8cdd30f0-39c5-a94e-0efc-144a9ad7adcb linux_raid_member
/dev/sda2 b530feac-b904-9a8a-b1bf-9177e3b623df linux_raid_member
/dev/sda3 049b47d1-4aac-33d3-64b4-2b7b3eeae576 linux_raid_member
/dev/sdb1 8cdd30f0-39c5-a94e-0efc-144a9ad7adcb linux_raid_member
/dev/sdb2 b530feac-b904-9a8a-b1bf-9177e3b623df linux_raid_member
/dev/sdb3 049b47d1-4aac-33d3-64b4-2b7b3eeae576 linux_raid_member
/dev/sdc1 8cdd30f0-39c5-a94e-0efc-144a9ad7adcb linux_raid_member
/dev/sdc2 b530feac-b904-9a8a-b1bf-9177e3b623df linux_raid_member
/dev/sdc3 049b47d1-4aac-33d3-64b4-2b7b3eeae576 linux_raid_member

============================ "mount | grep ^/dev output: ===========================

Device Mount_Point Type Options

/dev/md2 / ext4 (rw,relatime,errors=remount-ro)
/dev/md0 /boot ext4 (rw,relatime)

============================== md0/grub/menu.lst: ==============================

# menu.lst - See: grub(8), info grub, update-grub(8)
# grub-install(8), grub-floppy(8),
# grub-md5-crypt, /usr/share/doc/grub
# and /usr/share/doc/grub-doc/.

## default num
# Set the default entry to the entry number NUM. Numbering starts from 0, and
# the entry number 0 is the default if the command is not used.
#
# You can specify 'saved' instead of a number. In this case, the default entry
# is the entry saved with the command 'savedefault'.
# WARNING: If you are using dmraid do not use 'savedefault' or your
# array will desync and will not let you boot your system.
default 4

## timeout sec
# Set a timeout, in SEC seconds, before automatically booting the default entry
# (normally the first entry defined).
timeout 3

## hiddenmenu
# Hides the menu by default (press ESC to see the menu)
hiddenmenu

# Pretty colours
#color cyan/blue white/blue

## password ['--md5'] passwd
# If used in the first section of a menu file, disable all interactive editing
# control (menu entry editor and command-line) and entries protected by the
# command 'lock'
# e.g. password topsecret
# password --md5 $1$gLhU0/$aW78kHK1QfV3P2b2znUoe/
# password topsecret

#
# examples
#
# title Windows 95/98/NT/2000
# root (hd0,0)
# makeactive
# chainloader +1
#
# title Linux
# root (hd0,1)
# kernel /vmlinuz root=/dev/hda2 ro
#

#
# Put static boot stanzas before and/or after AUTOMAGIC KERNEL LIST

### BEGIN AUTOMAGIC KERNELS LIST
## lines between the AUTOMAGIC KERNELS LIST markers will be modified
## by the debian update-grub script except for the default options below

## DO NOT UNCOMMENT THEM, Just edit them to your needs

## ## Start Default Options ##
## default kernel options
## default kernel options for automagic boot options
## If you want special options for specific kernels use kopt_x_y_z
## where x.y.z is kernel version. Minor versions can be omitted.
## e.g. kopt=root=/dev/hda1 ro
## kopt_2_6_8=root=/dev/hdc1 ro
## kopt_2_6_8_2_686=root=/dev/hdc2 ro
# kopt=root=/dev/md2 ro

## default grub root device
## e.g. groot=(hd0,0)
# groot=(hd0,0)

## should update-grub create alternative automagic boot options
## e.g. alternative=true
## alternative=false
# alternative=true

## should update-grub lock alternative automagic boot options
## e.g. lockalternative=true
## lockalternative=false
# lockalternative=false

## additional options to use with the default boot option, but not with the
## alternatives
## e.g. defoptions=vga=791 resume=/dev/hda5
# defoptions=quiet splash

## should update-grub lock old automagic boot options
## e.g. lockold=false
## lockold=true
# lockold=false

## Xen hypervisor options to use with the default Xen boot option
# xenhopt=

## Xen Linux kernel options to use with the default Xen boot option
# xenkopt=console=tty0

## altoption boot targets option
## multiple altoptions lines are allowed
## e.g. altoptions=(extra menu suffix) extra boot options
## altoptions=(recovery) single
# altoptions=(recovery mode) single

## controls how many kernels should be put into the menu.lst
## only counts the first occurence of a kernel, not the
## alternative kernel options
## e.g. howmany=all
## howmany=7
# howmany=all

## specify if running in Xen domU or have grub detect automatically
## update-grub will ignore non-xen kernels when running in domU and vice versa
## e.g. indomU=detect
## indomU=true
## indomU=false
# indomU=detect

## should update-grub create memtest86 boot option
## e.g. memtest86=true
## memtest86=false
# memtest86=true

## should update-grub adjust the value of the default booted system
## can be true or false
# updatedefaultentry=false

## should update-grub add savedefault to the default options
## can be true or false
# savedefault=false

## ## End Default Options ##

title Ubuntu 9.10, kernel 2.6.31-19-generic-pae
root (hd0,0)
kernel /vmlinuz-2.6.31-19-generic-pae root=/dev/md2 ro quiet splash
initrd /initrd.img-2.6.31-19-generic-pae

title Ubuntu 9.10, kernel 2.6.31-19-generic-pae (recovery mode)
root (hd0,0)
kernel /vmlinuz-2.6.31-19-generic-pae root=/dev/md2 ro single
initrd /initrd.img-2.6.31-19-generic-pae

title Ubuntu 9.10, kernel 2.6.31-19-generic
root (hd0,0)
kernel /vmlinuz-2.6.31-19-generic root=/dev/md2 ro quiet splash
initrd /initrd.img-2.6.31-19-generic

title Ubuntu 9.10, kernel 2.6.31-19-generic (recovery mode)
root (hd0,0)
kernel /vmlinuz-2.6.31-19-generic root=/dev/md2 ro single
initrd /initrd.img-2.6.31-19-generic
title Ubuntu 9.10, kernel 2.6.31-16-generic-pae
root (hd0,0)
kernel /vmlinuz-2.6.31-16-generic-pae root=/dev/md2 ro quiet splash
initrd /initrd.img-2.6.31-16-generic-pae

title Ubuntu 9.10, kernel 2.6.31-16-generic-pae (recovery mode)
root (hd0,0)
kernel /vmlinuz-2.6.31-16-generic-pae root=/dev/md2 ro single
initrd /initrd.img-2.6.31-16-generic-pae

title Ubuntu 9.10, kernel 2.6.31-16-generic
root (hd0,0)
kernel /vmlinuz-2.6.31-16-generic root=/dev/md2 ro quiet splash
initrd /initrd.img-2.6.31-16-generic

title Ubuntu 9.10, kernel 2.6.31-16-generic (recovery mode)
root (hd0,0)
kernel /vmlinuz-2.6.31-16-generic root=/dev/md2 ro single
initrd /initrd.img-2.6.31-16-generic

title Ubuntu 9.10, kernel 2.6.28-17-server
root (hd0,0)
kernel /vmlinuz-2.6.28-17-server root=/dev/md2 ro quiet splash
initrd /initrd.img-2.6.28-17-server

title Ubuntu 9.10, kernel 2.6.28-17-server (recovery mode)
root (hd0,0)
kernel /vmlinuz-2.6.28-17-server root=/dev/md2 ro single
initrd /initrd.img-2.6.28-17-server

title Ubuntu 9.10, memtest86+
root (hd0,0)
kernel /memtest86+.bin

### END DEBIAN AUTOMAGIC KERNELS LIST

==================== md0: Location of files loaded by Grub: ====================


.0GB: grub/menu.lst
.0GB: grub/stage2
.0GB: initrd.img-2.6.28-17-server
.0GB: initrd.img-2.6.31-16-generic
.0GB: initrd.img-2.6.31-16-generic-pae
.0GB: initrd.img-2.6.31-19-generic
.0GB: initrd.img-2.6.31-19-generic-pae
.0GB: vmlinuz-2.6.28-17-server
.0GB: vmlinuz-2.6.31-16-generic
.0GB: vmlinuz-2.6.31-16-generic-pae
.0GB: vmlinuz-2.6.31-19-generic
.0GB: vmlinuz-2.6.31-19-generic-pae

================================ md2/etc/fstab: ================================

# /etc/fstab: static file system information.
#
# Use 'vol_id --uuid' to print the universally unique identifier for a
# device; this may be used with UUID= as a more robust way to name devices
# that works even if disks are added and removed. See fstab(5).
#
# <file system> <mount point> <type> <options> <dump> <pass>
proc /proc proc defaults 0 0
# / was on /dev/md2 during installation
UUID=19247821-a140-4973-bde9-41be606fcf09 / ext4 relatime,errors=remount-ro 0 1
# /boot was on /dev/md0 during installation
UUID=78b29bb7-0b36-4743-ac98-392143009c78 /boot ext4 relatime 0 2
# swap was on /dev/md1 during installation
UUID=009481e4-80ae-44d7-8f3f-4537380d54be none swap sw 0 0
/dev/scd0 /media/cdrom0 udf,iso9660 user,noauto,exec,utf8 0 0
/dev/fd0 /media/floppy0 auto rw,user,noauto,exec,utf8 0 0
=========================== Unknown MBRs/Boot Sectors/etc =======================

Unknown BootLoader on sdb3

00000000 00 00 c0 03 10 00 c0 03 20 00 c0 03 e0 5f 00 20 |........ ...._. |
00000010 00 00 05 00 00 00 00 00 00 00 00 00 00 20 a4 14 |............. ..|
00000020 01 00 c0 03 11 00 c0 03 20 02 c0 03 00 80 00 20 |........ ...... |
00000030 00 00 07 00 00 00 00 00 00 00 00 00 00 20 d9 8f |............. ..|
00000040 02 00 c0 03 12 00 c0 03 20 04 c0 03 00 80 00 20 |........ ...... |
00000050 00 00 07 00 00 00 00 00 00 00 00 00 00 20 b7 2e |............. ..|
00000060 03 00 c0 03 13 00 c0 03 20 06 c0 03 00 80 00 20 |........ ...... |
00000070 00 00 07 00 00 00 00 00 00 00 00 00 00 20 6c 8e |............. l.|
00000080 04 00 c0 03 14 00 c0 03 20 08 c0 03 00 80 00 20 |........ ...... |
00000090 00 00 07 00 00 00 00 00 00 00 00 00 00 20 68 2c |............. h,|
000000a0 05 00 c0 03 15 00 c0 03 20 0a c0 03 00 80 00 20 |........ ...... |
000000b0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 b3 8c |............. ..|
000000c0 06 00 c0 03 16 00 c0 03 20 0c c0 03 00 80 00 20 |........ ...... |
000000d0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 dd 2d |............. .-|
000000e0 07 00 c0 03 17 00 c0 03 20 0e c0 03 00 80 00 20 |........ ...... |
000000f0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 06 8d |............. ..|
00000100 08 00 c0 03 18 00 c0 03 20 10 c0 03 00 80 00 20 |........ ...... |
00000110 00 00 07 00 00 00 00 00 00 00 00 00 00 20 d6 29 |............. .)|
00000120 09 00 c0 03 19 00 c0 03 20 12 c0 03 00 80 00 20 |........ ...... |
00000130 00 00 07 00 00 00 00 00 00 00 00 00 00 20 0d 89 |............. ..|
00000140 0a 00 c0 03 1a 00 c0 03 20 14 c0 03 00 80 00 20 |........ ...... |
00000150 00 00 07 00 00 00 00 00 00 00 00 00 00 20 63 28 |............. c(|
00000160 0b 00 c0 03 1b 00 c0 03 20 16 c0 03 00 80 00 20 |........ ...... |
00000170 00 00 07 00 00 00 00 00 00 00 00 00 00 20 b8 88 |............. ..|
00000180 0c 00 c0 03 1c 00 c0 03 20 18 c0 03 00 80 00 20 |........ ...... |
00000190 00 00 07 00 00 00 00 00 00 00 00 00 00 20 bc 2a |............. .*|
000001a0 0d 00 c0 03 1d 00 c0 03 20 1a c0 03 00 80 00 20 |........ ...... |
00000140 0a 00 c0 03 1a 00 c0 03 20 14 c0 03 00 80 00 20 |........ ...... |
00000150 00 00 07 00 00 00 00 00 00 00 00 00 00 20 63 28 |............. c(|
00000160 0b 00 c0 03 1b 00 c0 03 20 16 c0 03 00 80 00 20 |........ ...... |
00000170 00 00 07 00 00 00 00 00 00 00 00 00 00 20 b8 88 |............. ..|
00000180 0c 00 c0 03 1c 00 c0 03 20 18 c0 03 00 80 00 20 |........ ...... |
00000190 00 00 07 00 00 00 00 00 00 00 00 00 00 20 bc 2a |............. .*|
000001a0 0d 00 c0 03 1d 00 c0 03 20 1a c0 03 00 80 00 20 |........ ...... |
000001b0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 67 8a |............. g.|
000001c0 0e 00 c0 03 1e 00 c0 03 20 1c c0 03 00 80 00 20 |........ ...... |
000001d0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 09 2b |............. .+|
000001e0 0f 00 c0 03 1f 00 c0 03 20 1e c0 03 00 80 00 20 |........ ...... |
000001f0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 d2 8b |............. ..|
00000200

Unknown BootLoader on sdc3

00000000 00 00 c0 03 10 00 c0 03 20 00 c0 03 e0 5f 00 20 |........ ...._. |
00000010 00 00 05 00 00 00 00 00 00 00 00 00 00 20 a4 14 |............. ..|
00000020 01 00 c0 03 11 00 c0 03 20 02 c0 03 00 80 00 20 |........ ...... |
00000030 00 00 07 00 00 00 00 00 00 00 00 00 00 20 d9 8f |............. ..|
00000040 02 00 c0 03 12 00 c0 03 20 04 c0 03 00 80 00 20 |........ ...... |
00000050 00 00 07 00 00 00 00 00 00 00 00 00 00 20 b7 2e |............. ..|
00000060 03 00 c0 03 13 00 c0 03 20 06 c0 03 00 80 00 20 |........ ...... |
00000070 00 00 07 00 00 00 00 00 00 00 00 00 00 20 6c 8e |............. l.|
00000080 04 00 c0 03 14 00 c0 03 20 08 c0 03 00 80 00 20 |........ ...... |
00000090 00 00 07 00 00 00 00 00 00 00 00 00 00 20 68 2c |............. h,|
000000a0 05 00 c0 03 15 00 c0 03 20 0a c0 03 00 80 00 20 |........ ...... |
000000b0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 b3 8c |............. ..|
000000c0 06 00 c0 03 16 00 c0 03 20 0c c0 03 00 80 00 20 |........ ...... |
000000d0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 dd 2d |............. .-|
000000e0 07 00 c0 03 17 00 c0 03 20 0e c0 03 00 80 00 20 |........ ...... |
000000f0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 06 8d |............. ..|
00000100 08 00 c0 03 18 00 c0 03 20 10 c0 03 00 80 00 20 |........ ...... |
00000110 00 00 07 00 00 00 00 00 00 00 00 00 00 20 d6 29 |............. .)|
00000120 09 00 c0 03 19 00 c0 03 20 12 c0 03 00 80 00 20 |........ ...... |
00000130 00 00 07 00 00 00 00 00 00 00 00 00 00 20 0d 89 |............. ..|
00000140 0a 00 c0 03 1a 00 c0 03 20 14 c0 03 00 80 00 20 |........ ...... |
00000150 00 00 07 00 00 00 00 00 00 00 00 00 00 20 63 28 |............. c(|
00000160 0b 00 c0 03 1b 00 c0 03 20 16 c0 03 00 80 00 20 |........ ...... |
00000170 00 00 07 00 00 00 00 00 00 00 00 00 00 20 b8 88 |............. ..|
00000180 0c 00 c0 03 1c 00 c0 03 20 18 c0 03 00 80 00 20 |........ ...... |
00000190 00 00 07 00 00 00 00 00 00 00 00 00 00 20 bc 2a |............. .*|
000001a0 0d 00 c0 03 1d 00 c0 03 20 1a c0 03 00 80 00 20 |........ ...... |
000001b0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 67 8a |............. g.|
000001c0 0e 00 c0 03 1e 00 c0 03 20 1c c0 03 00 80 00 20 |........ ...... |
000001d0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 09 2b |............. .+|
000001e0 0f 00 c0 03 1f 00 c0 03 20 1e c0 03 00 80 00 20 |........ ...... |
000001f0 00 00 07 00 00 00 00 00 00 00 00 00 00 20 d2 8b |............. ..|
00000200

meierfra.
February 13th, 2010, 01:47 AM
What it looks like is that grub2


ii grub 0.97-29ubuntu59 GRand Unified Bootloader
ii grub-common 1.97~beta4-1ubuntu4.1 GRand Unified Bootloader, version 2 (common)

was installed


You still have Legacy Grub installed (the grub-common files are used by Legacy Grub and Grub2).

Also since you got to the busy box, it sounds more like a problem with the kernel and not a Grub problem.

trouserless
February 13th, 2010, 08:12 PM
You still have Legacy Grub installed (the grub-common files are used by Legacy Grub and Grub2).

Also since you got to the busy box, it sounds more like a problem with the kernel and not a Grub problem.

Interesting, so the upgrade did not update grub? Is that something that should have happened? Can Karmic work with the old grub?

Also, if the kernel that I reverted to booted to busybox, but could not continue on its own without the mdadm command, would that mean the kernel does indeed work but some part of the raid detection does not?

thanks for your help!