I do not get a bootable ISO image out of this process. Has anyone else? Everything looks right, so I am not sure where to go from here. Any help would be greatly appreciated. Thanks - -cliff email: lang@xxxxxxxxxx PH: 703-787-3649 -----Original Message----- From: Martin Robb [mailto:MartinRobb@xxxxxxxx] Sent: Tuesday, May 25, 2004 5:48 PM To: kickstart-list@xxxxxxxxxx Subject: genhdlist problems solved under RHEL3 -- buildIso script enclosed(sorry, long) Many thanks for the assistance from the list, especially Philip Rowlands and James Martin. My "buildIso" script is now working under both FC2 and RHEL3u2. It may even work to cross-target RHEL from an FC2 environment -- I don't have time left today to check, but since my problems were tracking 1 for 1 between targeting RHEL from RHEL and targeting RHEL from FC2, I think it's likely. For the record, using --withnumbers on the genhdlist command got me past the "/mnt/source" problem but ultimately grub failed at stage 1. Using the pkgorder command got me past the grub problem. I am enclosing the buildIso script for those interested. It is still a work in progress but is reasonably functional. It requires some supporting files which I will explain as I go. This would work a WHOLE lot better as an html message with attachments, but I don't know how well that would encapsulate in the digest or to all list members with plain mail clients. So let me apologize in advance for the lengthy plain text message. It seemed the most portable if not the most elegant. The heart of the script looks at the packages section of the ks.cfg file and expands it into a list of rpms, using the comps.xml file to expand package names into the corresponding rpms. It does NOT recursively find packages within packages. Along the way I found that both FC2 and RHEL3 have a sizeable list of rpms that are included "automagically" even in a minimal install -- even though they don't belong to any packages and aren't even listed in comps.xml. The script looks for the list of implicit rpms in the files "implicit.Fedora" and "implicit.RedHat" respectively. BTW, I obtained the list by doing a minimal install and running "rpm --query --all" and comparing the results to what I was extracting for the Base, Core and Dialup Networking Support packages. I don't know if there are other implicit RPMs for other packages. For my purposes I am always building off a minimal install. If anyone knows a more direct way to obtain this list I'd be interested in learning it. The rpms should be listed one per line, but I will join them together a bit here to save some space: The implicit.Fedora file contains: beecrypt bind-libs bzip2-libs chkconfig comps cracklib cracklib-dicts cyrus-sasl cyrus-sasl-md5 db4 dev device-mapper elfutils elfutils-libelf findutils gawk gdbm glib glib2 glibc-common gmp gnupg grep groff gzip hesiod hwdata info iptables isdn4k-utils kernel-smp krb5-libs krbafs less libacl libattr libselinux libstdc++ libuser libwvstreams libxml2 libxml2-python lockdev lrzsz lvm2 mailx make MAKEDEV mingetty mkinitrd mktemp modutils ncurses net-tools newt nscd openldap openssh openssl pam pcre perl perl-Filter popt portmap ppp procmail psmisc pyOpenSSL python python-optik pyxf86config rhnlib rhpl rmt rpm-python sed slang syslinux tar tzdata usbutils usermode which words yp-tools zlib The implicit.RedHat file contains: ash basesystem bash beecrypt binutils bzip2-libs chkconfig comps coreutils cpio cracklib cracklib-dicts cups cups-libs cyrus-sasl cyrus-sasl-md5 cyrus-sasl-plain db4 dev e2fsprogs ed elfutils elfutils-libelf ethtool expat file filesystem findutils fontconfig freetype gawk gdbm gettext glib glib2 glibc glibc-common gmp gnupg grep groff gzip hdparm hesiod hotplug htmlview hwdata info initscripts iproute iputils isdn4k-utils jfsutils jwhois kbd krb5-libs krbafs krbafs-utils less libacl libattr libgcc libgcj libjpeg libpng libstdc++ libtermcap libtiff libtool-libs libuser libwvstreams lockdev losetup lslk lsof lvm m4 mailx make MAKEDEV mingetty minicom mkinitrd mktemp modutils mount mt-st ncurses net-tools newt nscd openldap openssh openssh-server openssl pam passwd patch pcre perl perl-Filter popt portmap ppp procmail procps psmisc pspell pyOpenSSL python python-optik pyxf86config raidtools rdist readline redhat-config-mouse redhat-menus redhat-release rhnlib rhpl rmt rootfiles rpm rpm-python rp-pppoe sed sendmail setserial setup shadow-utils slang sudo sysklogd syslinux SysVinit tar tcpdump termcap traceroute tzdata up2date usbutils usermode utempter util-linux vim-minimal wget which wireless-tools words wvdial XFree86-libs XFree86-libs-data XFree86-Mesa-libGL xinetd yp-tools zlib Both FC2 and RHEL3 appear to have some "missing" files that are listed in the comps.xml file but don't exist on the disks. The installer doesn't complain but my buildIso script needs to know about them to know when to stop looking for RPMs. It looks for these in the files "missing.Fedora" and "missing.RedHat." The missing.Fedora file contains: efibootmgr elilo losetup openCryptoki ppc64-utils prctl run s390utils yaboot The missing.RedHat file contains: acpid efibootmgr elilo iprutils iscsi lrzsz openCryptoki ppc64-utils prctl reiserfs-utils s390utils statserial yaboot Finally, there may be some RPMs you want added in or left out depending on which target you've selected. These are in extra.Fedora and extra.RedHat. The extra.Fedora file contains: -at checkpolicy policy-sources The at rpm was not installing properly under FC2t3 and the -at leaves it out. This may be fixed under FC2 -- I haven't had time to check yet. The checkpolicy and policy-sources files are only of interest if you are using selinux. The extra.RedHat file contains: bridge-utils brltty I don't know that I really need either of these, but they are installed in a minimal install and they don't seem to be picked up implicitly like those listed in implicit.RedHat. So for the moment I'm including them explicitly. Before showing the buildIso script itself, I will also include an example ks.cfg file that seems to be working under both FC2 and RHEL3 and should work with this script. I've left off the %post commands and hashed out the rootpw. What's left of the ks.cfg file contains: install cdrom lang en_US.UTF-8 langsupport --default en_US.UTF-8 en_US.UTF-8 keyboard us mouse generic skipx rootpw --iscrypted ########################## firewall --disabled #selinux --disabled authconfig --enableshadow --enablemd5 timezone America/New_York bootloader --location=mbr --append hda=ide-scsi clearpart --all --initlabel part / --fstype ext3 --size 2048 part /sandbox --fstype ext3 --size 1 --grow part swap --size 1024 reboot %packages @ Core @ Dialup Networking Support @ Base # GENERIC ADDITIONS m4 libsafe tripwire # NEEDED FOR NTP libcap ntp tcl expect amhsfilter %post The buildIso script looks first for custom rpms in the CUSTOM_RPMS directory (default ../RPMs), then for replacement rpms in the PACKAGES directory (default ../Packages), and then for standard rpms on the install CDs. It lays out the ISO file directory structure under ROOTS (default ../Roots) is ${ROOTS}/IsoRoot. The script contains a lot of commented mutterings about where things resided under various RH versions. There are many apparent redundancies and out of desperation I tended to replace them all where possible. Much of this could/should be cleaned up -- but it works. The buildIso script contains: #! /bin/sh -- # # Interesting files and where they (should?) reside: # boot.iso: # images/boot.iso # (in 7.1 this was images/boot.img) # initrd.img: (first two are md5 identical in FC2t2) # isolinux/initrd.img # images/boot.iso[/isolinux/initrd.img] # images/pxeboot/initrd.img # (in 7.1 this was images/boot.img[initrd.img]) # isolinux.cfg: (identical) # isolinux/isolinux.cfg # images/boot.iso[isolinux/isolinux.cfg] # (in 7.1 this was images/boot.img[/syslinux.cfg] # ks.cfg: # /ks.cfg # isolinux/ks.cfg # isolinux/initrd.img[(gzipped)/isolinux/ks.cfg] # isolinux/initrd.img[(gzipped)/ks.cfg] # images/pxeboot/initrd.img[(gzipped)/isolinux/ks.cfg] # images/pxeboot/initrd.img[(gzipped)/ks.cfg] # (in 7.1 this was images/boot.img[(gzipped)/ks.cfg] # case `uname --kernel-release` in 2.4*) DEFAULT_TARGET=RedHat ;; 2.6*) DEFAULT_TARGET=Fedora ;; *) echo "Unrecognized kernel release `uname --kernel-release`" exit 1 ;; esac TARGET=${TARGET:-$DEFAULT_TARGET} ROOTS=${ROOTS:-`(cd ../Roots ; pwd)`} PACKAGES=${PACKAGES:-`(cd ../Packages ; pwd)`} CUSTOM_RPMS=${CUSTOM_RPMS:-`(cd ../RPMs ; pwd)`} ISO_LABEL=PinnacleCSIBastionInstall ISO_ROOT=${ROOTS}/IsoRoot ISO_NAME=${1:-BastionInstall.iso} RPMLIST_NAME=/tmp/rpmlist TMPLIST_NAME=/tmp/tmplist RPM_PATH=${TARGET}/RPMS COMPS_NAME=comps.xml COMPS_PATH=${TARGET}/base/${COMPS_NAME} HDLIST_NAME=hdlist HDLIST_PATH=${TARGET}/base/${HDLIST_NAME} # N.B. - the IsoRoot ks.cfg has extra rpm names not in the local ks.cfg KICKSTART_NAME=ks.cfg KICKSTART_PATH=${ISO_ROOT}/${KICKSTART_NAME} BOOTCAT_NAME=boot.cat BOOTCAT_PATH=isolinux/${BOOTCAT_NAME} CD_ROOT=/mnt/cdrom BOOTIMG_NAME=boot.iso BOOTIMG_PATH=images/${BOOTIMG_NAME} BOOTIMG_MOUNT=/mnt/bootimg BOOTIMG_ROOT=${ROOTS}/BootImage CONFIG_NAME=isolinux.cfg CONFIG_PATH=isolinux/${CONFIG_NAME} INITRD_NAME=initrd.img INITRD_PATH=isolinux/${INITRD_NAME} INITRD_MOUNT=/mnt/initrd Cleanup() { for FS_ROOT in ${ISO_ROOT} ${BOOTIMG_ROOT} do if [ -e ${FS_ROOT} ] then rm -rf ${FS_ROOT} fi mkdir ${FS_ROOT} done } ReplicateNonRpms() { if [ -e ${CD_ROOT} ] then sudo umount ${CD_ROOT} 2>/dev/null else sudo mkdir ${CD_ROOT} fi eject echo -n "Please insert ${TARGET} CD 1 and press ENTER: " read line sudo mount ${CD_ROOT} ( cd ${CD_ROOT} ; find . -print | grep -v RPMS | cpio -pdmvu ${ISO_ROOT} ) sudo umount ${CD_ROOT} eject chmod 644 ${ISO_ROOT}/${HDLIST_PATH} } UnpackBootIso() { if [ -e ${BOOTIMG_MOUNT} ] then sudo umount ${BOOTIMG_MOUNT} 2>/dev/null else sudo mkdir ${BOOTIMG_MOUNT} fi sudo mount -o loop -t iso9660 ${ISO_ROOT}/${BOOTIMG_PATH} ${BOOTIMG_MOUNT} mkdir ${BOOTIMG_ROOT} ( cd ${BOOTIMG_MOUNT} ; find . -print | cpio -pdmvu ${BOOTIMG_ROOT} ) sudo umount ${BOOTIMG_MOUNT} } RepackBootIso() { chmod 644 ${ISO_ROOT}/${BOOTIMG_PATH} sudo mkisofs -o ${ISO_ROOT}/${BOOTIMG_PATH} -V "${ISO_LABEL}" -b isolinux/isolinux.bin -c isolinux/boot.cat -no-emul-boot -boot-load-size 4 -boot-info-table -R -J -V -T ${BOOTIMG_ROOT} } # initrd.img: (first two are md5 identical in FC2t2) # isolinux/initrd.img # images/boot.iso[/isolinux/initrd.img] # images/pxeboot/initrd.img UnpackInitRd() { if [ -e ${INITRD_MOUNT} ] then sudo umount ${INITRD_MOUNT} 2>/dev/null else sudo mkdir ${INITRD_MOUNT} fi zcat ${ISO_ROOT}/${INITRD_PATH} >/tmp/${INITRD_NAME} sudo mount -o loop /tmp/${INITRD_NAME} ${INITRD_MOUNT} } RepackInitRd() { sudo umount ${INITRD_MOUNT} rm -f /tmp/${INITRD_NAME}.gz 2>/dev/null gzip /tmp/${INITRD_NAME} sudo cp /tmp/${INITRD_NAME}.gz ${ISO_ROOT}/${INITRD_PATH} sudo cp /tmp/${INITRD_NAME}.gz ${BOOTIMG_ROOT}/${INITRD_PATH} sudo cp /tmp/${INITRD_NAME}.gz ${ISO_ROOT}/images/pxeboot/${INITRD_NAME} } # isolinux.cfg: (they are identical) # isolinux/isolinux.cfg # images/boot.iso[isolinux/isolinux.cfg] # # allowcddma sometimes helps with CD problems - hasn't made a difference here # mem=exactmap mem=640k@0m mem=1023M@1M sometimes helps Proliant memory # recognition - hasn't made a difference here # UpdateLinuxConfig() { chmod 644 ${ISO_ROOT}/${CONFIG_PATH} ed - ${ISO_ROOT}/${CONFIG_PATH} << '!' H /default/s/linux/ks/p /append ks/s|ks|ks=cdrom:/ks.cfg|p w q ! chmod 644 ${BOOTIMG_ROOT}/${CONFIG_PATH} cp ${ISO_ROOT}/${CONFIG_PATH} ${BOOTIMG_ROOT}/${CONFIG_PATH} } # ks.cfg: # /ks.cfg # isolinux/ks.cfg # isolinux/initrd.img[(gzipped)/ks.cfg] # images/boot.iso[isolinux/initrd.img[(gzipped)/ks.cfg]] AddKickstartConfig() { cp -f ${KICKSTART_NAME} ${KICKSTART_PATH} ed - ${KICKSTART_PATH} <<! H ?^[@]?r extra.${TARGET} w q ! } AddBootMessage() { cat > ${ISO_ROOT}/BOOTMSG.TXT <<'!' Test boot message ! } RpmsInPackage() { sed -n -e "/<name>${1}<\/name>/,/<\/group>/p" <${ISO_ROOT}/${COMPS_PATH} | grep '<packagereq' \ | sed -e 's/[<][^>]*[>]//g' | sed -e 's/ *//' } DetermineRpmList() { # These RPMS seem to be implied without explicit comps.xml entries cat implicit.${TARGET} > ${RPMLIST_NAME} sed -n -e '/%packages/,/%post/p' <${KICKSTART_PATH} | grep -v '^ *#' | grep -v '^%' | grep -v '^ *$' | while read LINE do case ${LINE} in [@]*) RpmsInPackage "`echo $LINE | sed -e 's/@ *//'`" >>${RPMLIST_NAME} ;; [-]*) ;; *) echo ${LINE} >>${RPMLIST_NAME} ;; esac done sort -u -o ${RPMLIST_NAME} ${RPMLIST_NAME} >${TMPLIST_NAME} while read PACKAGE do if ! grep -q '^ *'"${PACKAGE}"' *$' missing.${TARGET} then echo ${PACKAGE} >> ${TMPLIST_NAME} fi done < ${RPMLIST_NAME} mv ${TMPLIST_NAME} ${RPMLIST_NAME} } CopyRPMsFromDirectory() { DIRECTORY=${1:?"usage: $0 <directory>"} >${TMPLIST_NAME} while read PACKAGE do FILES=`ls ${DIRECTORY}/${PACKAGE}-*.rpm 2>/dev/null | grep ${PACKAGE}-[a-zA-Z0-9._]*-[a-zA-Z0-9._]*.rpm` if [ -n "${FILES}" ] then for FILE in ${FILES} do echo ${FILE} cp ${FILE} ${ISO_ROOT}/${RPM_PATH} done else echo ${PACKAGE} >> ${TMPLIST_NAME} fi done <${RPMLIST_NAME} mv ${TMPLIST_NAME} ${RPMLIST_NAME} } CopyRPMs() { if [ -e ${ISO_ROOT}/${RPM_PATH} ] then rm -rf ${ISO_ROOT}/${RPM_PATH} fi mkdir ${ISO_ROOT}/${RPM_PATH} CopyRPMsFromDirectory ${CUSTOM_RPMS} CopyRPMsFromDirectory ${PACKAGES} REMAINING_RPMS=`cat ${RPMLIST_NAME} | wc -l` DISK=1 while [ ${REMAINING_RPMS} -gt 0 ] do echo "${REMAINING_RPMS} RPMs remaining." eject echo -n "Please insert ${TARGET} Disk ${DISK} and press ENTER: " read line sudo mount ${CD_ROOT} CopyRPMsFromDirectory ${CD_ROOT}/${TARGET}/RPMS sudo umount ${CD_ROOT} eject REMAINING_RPMS=`cat ${RPMLIST_NAME} | wc -l` DISK=`expr ${DISK} + 1` done } MakeIsoFile() { ( cd ${ROOTS} ; find src -print | cpio -pdmvu ${ISO_ROOT} ) if [ "$TARGET" = RedHat ] then # RHEL3 genhdlist doesn't have --productpath /usr/lib/anaconda-runtime/genhdlist --withnumbers ${ISO_ROOT} PYTHONPATH=/usr/lib/anaconda /usr/lib/anaconda-runtime/pkgorder ${ISO_ROOT}/ '' rhe3qu2 >/tmp/pkgorder.txt /usr/lib/anaconda-runtime/genhdlist --withnumbers --fileorder /tmp/pkgorder.txt ${ISO_ROOT} else /usr/lib/anaconda-runtime/genhdlist --productpath ${TARGET} ${ISO_ROOT} fi sudo mkisofs -o ${ISO_NAME} -V "${ISO_LABEL}" -b isolinux/isolinux.bin -c isolinux/boot.cat -no-emul-boot -boot-info-table -J -r -nobak -T ${ISO_ROOT} } Cleanup ReplicateNonRpms UnpackBootIso #UnpackInitRd UpdateLinuxConfig AddKickstartConfig #AddBootMessage #RepackInitRd RepackBootIso DetermineRpmList CopyRPMs MakeIsoFile
