Filesize too big for ISO9660

[markb]

I'm using Remastersys 2.0.18-1 on Ubuntu 10.10. I only have one HDD. I don't have any mounted drives or partitions except the one my system is installed on. I have placed all my large files in /root/excluded and I have excluded /excluded in the config. I can add up the remaining file sizes of usr, var, etc etc. and they total just under 3.5GB.

Every time I run Remastersys in dist mode or back up mode I get the same result: Filesize too big for ISO9660.

I've read the forums and can't find any other solution. What can be causing this?

[fragadelic]

Can you post the remastersys.log here?

Hopefully I'll be able to tell from there.

[markb]

Thanks, here it is....


Cannot stat exclude dir/file /excluded because No such file or directory, ignoringSource directory entry proc already used! - trying proc_1
Source directory entry media already used! - trying media_1
Source directory entry mnt already used! - trying mnt_1
Source directory entry sys already used! - trying sys_1
Source directory entry dev already used! - trying dev_1
Source directory entry etc already used! - trying etc_1
Source directory entry var already used! - trying var_1
Source directory entry tmp already used! - trying tmp_1
------------------------------------------------------
Mount information
/dev/mapper/Server-root on / type ext4 (rw,errors=remount-ro,user_xattr,commit=0)
proc on /proc type proc (rw,noexec,nosuid,nodev)
none on /sys type sysfs (rw,noexec,nosuid,nodev)
fusectl on /sys/fs/fuse/connections type fusectl (rw)
none on /sys/kernel/debug type debugfs (rw)
none on /sys/kernel/security type securityfs (rw)
none on /dev type devtmpfs (rw,mode=0755)
none on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=0620)
none on /dev/shm type tmpfs (rw,nosuid,nodev)
none on /var/run type tmpfs (rw,nosuid,mode=0755)
none on /var/lock type tmpfs (rw,noexec,nosuid,nodev)
/dev/sda1 on /boot type ext2 (rw)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
nfsd on /proc/fs/nfsd type nfsd (rw)
------------------------------------------------------
Casper Script info
total 144
-rwxr-xr-x 1 root root  297 2011-01-20 14:30 01integrity_check
-rwxr-xr-x 1 root root  383 2011-01-20 14:30 05mountpoints
-rwxr-xr-x 1 root root  571 2011-01-20 14:30 07remove_oem_config
-rw-r--r-- 1 root root 3375 2011-01-20 14:30 10adduser
-rwxr-xr-x 1 root root  400 2011-01-20 14:30 12fstab
-rwxr-xr-x 1 root root  830 2011-01-20 14:30 13swap
-rwxr-xr-x 1 root root 1431 2011-01-20 14:30 14locales
-rw-r--r-- 1 root root 1751 2011-01-20 14:30 15autologin
-rwxr-xr-x 1 root root  577 2011-01-20 14:30 18hostname
-rwxr-xr-x 1 root root 7529 2011-01-20 14:30 19keyboard
-rwxr-xr-x 1 root root  546 2011-01-20 14:30 20xconfig
-rwxr-xr-x 1 root root  531 2011-01-20 14:30 22gnome_panel_data
-rwxr-xr-x 1 root root  904 2011-01-20 14:30 22screensaver
-rwxr-xr-x 1 root root  577 2011-01-20 14:30 22serialtty
-rwxr-xr-x 1 root root  410 2011-01-20 14:30 22sslcert
-rwxr-xr-x 1 root root  380 2011-01-20 14:30 23etc_modules
-rwxr-xr-x 1 root root 3006 2011-01-20 14:30 23networking
-rwxr-xr-x 1 root root 1979 2011-01-20 14:30 24preseed
-rwxr-xr-x 1 root root 1996 2011-01-20 14:30 25configure_init
-rwxr-xr-x 1 root root 9144 2011-01-20 14:30 30accessibility
-rwxr-xr-x 1 root root  759 2011-01-20 14:30 31disable_update_notifier
-rwxr-xr-x 1 root root  817 2011-01-20 14:30 32disable_hibernation
-rwxr-xr-x 1 root root  369 2011-01-20 14:30 33enable_apport_crashes
-rwxr-xr-x 1 root root  892 2011-01-20 14:30 34disable_kde_services
-rwxr-xr-x 1 root root  562 2011-01-20 14:30 35fix_language_selector
-rwxr-xr-x 1 root root  407 2011-01-20 14:30 36disable_trackerd
-rwxr-xr-x 1 root root  908 2011-01-20 14:30 40install_driver_updates
-rwxr-xr-x 1 root root  432 2011-01-20 14:30 41apt_cdrom
-rwxr-xr-x 1 root root  847 2011-01-20 14:32 43disable_updateinitramfs
-rwxr-xr-x 1 root root 1261 2011-01-20 14:30 44pk_allow_ubuntu
-rwxr-xr-x 1 root root  325 2011-01-20 14:30 45disable_guest_account
-rwxr-xr-x 1 root root 1191 2011-01-20 14:30 47une_ubiquity
-rwxr-xr-x 1 root root  214 2011-01-20 14:30 48kubuntu_disable_restart_notifications
------------------------------------------------------
/etc/remastersys.conf info
#Remastersys Global Configuration File


# This is the temporary working directory and won't be included on the cd/dvd
WORKDIR="/home/remastersys"


# Here you can add any other files or directories to be excluded from the live filesystem
# Separate each entry with a space
EXCLUDES="/excluded"


# Here you can change the livecd/dvd username
LIVEUSER="custom"


# Here you can change the name of the livecd/dvd label
LIVECDLABEL="Custom Live CD"


# Here you can change the name of the ISO file that is created
CUSTOMISO="custom.iso"


# Here you can change the url for the usb-creator info
LIVECDURL="http://www.geekconnection.org/remastersys"

------------------------------------------------------
/etc/casper.conf info
# This file should go in /etc/casper.conf
# Supported variables are:
# USERNAME, USERFULLNAME, HOST, BUILD_SYSTEM
 
export USERNAME="mark"
export USERFULLNAME="Live session user"
export HOST="mark"
export BUILD_SYSTEM="Ubuntu"
------------------------------------------------------
/etc/passwd info
root:x:0:0:root:/root:/bin/bash
daemon:x:1:1:daemon:/usr/sbin:/bin/sh
bin:x:2:2:bin:/bin:/bin/sh
sys:x:3:3:sys:/dev:/bin/sh
sync:x:4:65534:sync:/bin:/bin/sync
games:x:5:60:games:/usr/games:/bin/sh
man:x:6:12:man:/var/cache/man:/bin/sh
lp:x:7:7:lp:/var/spool/lpd:/bin/sh
mail:x:8:8:mail:/var/mail:/bin/sh
news:x:9:9:news:/var/spool/news:/bin/sh
uucp:x:10:10:uucp:/var/spool/uucp:/bin/sh
proxy:x:13:13:proxy:/bin:/bin/sh
www-data:x:33:33:www-data:/var/www:/bin/sh
backup:x:34:34:backup:/var/backups:/bin/sh
list:x:38:38:Mailing List Manager:/var/list:/bin/sh
irc:x:39:39:ircd:/var/run/ircd:/bin/sh
gnats:x:41:41:Gnats Bug-Reporting System (admin):/var/lib/gnats:/bin/sh
nobody:x:65534:65534:nobody:/nonexistent:/bin/sh
libuuid:x:100:101::/var/lib/libuuid:/bin/sh
syslog:x:101:103::/home/syslog:/bin/false
mysql:x:102:105:MySQL Server,,,:/var/lib/mysql:/bin/false
sshd:x:103:65534::/var/run/sshd:/usr/sbin/nologin
mark:x:1000:1000:Mark ,,,:/home/mark:/bin/bash
messagebus:x:105:115::/var/run/dbus:/bin/false
avahi-autoipd:x:106:116:Avahi autoip daemon,,,:/var/lib/avahi-autoipd:/bin/false
avahi:x:107:117:Avahi mDNS daemon,,,:/var/run/avahi-daemon:/bin/false
couchdb:x:108:118:CouchDB Administrator,,,:/var/lib/couchdb:/bin/bash
usbmux:x:110:46:usbmux daemon,,,:/home/usbmux:/bin/false
haldaemon:x:111:119:Hardware abstraction layer,,,:/var/run/hald:/bin/false
kernoops:x:112:65534:Kernel Oops Tracking Daemon,,,:/:/bin/false
pulse:x:113:120:PulseAudio daemon,,,:/var/run/pulse:/bin/false
rtkit:x:114:122:RealtimeKit,,,:/proc:/bin/false
saned:x:115:123::/home/saned:/bin/false
hplip:x:116:7:HPLIP system user,,,:/var/run/hplip:/bin/false
gdm:x:117:124:Gnome Display Manager:/var/lib/gdm:/bin/false
squeezeboxserver:x:118:65534:SqueezeBox,,,:/usr/share/squeezeboxserver:/bin/false
statd:x:119:65534::/var/lib/nfs:/bin/false
postfix:x:120:126::/var/spool/postfix:/bin/false
ntp:x:121:128::/home/ntp:/bin/false
ivman:x:123:46::/var/run/ivman:/bin/false
halevt:x:122:46::/var/lib/halevt:/bin/false
------------------------------------------------------
/etc/group info
root:x:0:
daemon:x:1:
bin:x:2:
sys:x:3:
adm:x:4:mark
tty:x:5:
disk:x:6:
lp:x:7:
mail:x:8:
news:x:9:
uucp:x:10:
man:x:12:
proxy:x:13:
kmem:x:15:
dialout:x:20:mark
fax:x:21:
voice:x:22:
cdrom:x:24:mark
floppy:x:25:
tape:x:26:
sudo:x:27:
audio:x:29:pulse
dip:x:30:
www-data:x:33:
backup:x:34:
operator:x:37:
list:x:38:
irc:x:39:
src:x:40:
gnats:x:41:
shadow:x:42:
utmp:x:43:
video:x:44:
sasl:x:45:
plugdev:x:46:mark
staff:x:50:
games:x:60:
users:x:100:
nogroup:x:65534:
libuuid:x:101:
crontab:x:102:
syslog:x:103:
fuse:x:104:
mysql:x:105:
mlocate:x:106:
ssh:x:107:
sambashare:x:108:mark
ssl-cert:x:109:
winbindd_priv:x:110:
netdev:x:111:
mark:x:1000:
lpadmin:x:113:mark
admin:x:114:mark
messagebus:x:115:
avahi-autoipd:x:116:
avahi:x:117:
couchdb:x:118:
haldaemon:x:119:
pulse:x:120:
pulse-access:x:121:
rtkit:x:122:
saned:x:123:
gdm:x:124:
nopasswdlogin:x:125:
postfix:x:126:
postdrop:x:127:
ntp:x:128:
utempter:x:129:
------------------------------------------------------
Command-line options = backup
------------------------------------------------------
 The compressed filesystem is larger than the iso9660 specification allows for a single file. You must try to reduce the amount of data you are backing up and try again.

[lkjoel]

Try excluding /var/log*

[fragadelic]

/var/log/* is already excluded and empty files are placed there.

mark -
Open a Terminal Window and past the following:
unsquashfs -lls /home/remastersys/remastersys/ISOTMP/casper/filesystem.squashfs > squashoutput.txt
email me the squashoutput.txt file please

[markb]

Got the following message in terminal:

Can't find a SQUASHFS superblock on /home/remastersys/remastersys/ISOTMP/casper/filesystem.squashfs

[fragadelic]

What about:

find /home/remastersys/remastersys/ISOTMP

[markb]

/home/remastersys/remastersys/ISOTMP
/home/remastersys/remastersys/ISOTMP/.disk
/home/remastersys/remastersys/ISOTMP/isolinux
/home/remastersys/remastersys/ISOTMP/isolinux/memtest
/home/remastersys/remastersys/ISOTMP/isolinux/isolinux.bin
/home/remastersys/remastersys/ISOTMP/isolinux/isolinux.cfg
/home/remastersys/remastersys/ISOTMP/isolinux/splash.png
/home/remastersys/remastersys/ISOTMP/isolinux/vesamenu.c32
/home/remastersys/remastersys/ISOTMP/README.diskdefines
/home/remastersys/remastersys/ISOTMP/preseed
/home/remastersys/remastersys/ISOTMP/preseed/custom.seed
/home/remastersys/remastersys/ISOTMP/casper
/home/remastersys/remastersys/ISOTMP/casper/vmlinuz
/home/remastersys/remastersys/ISOTMP/casper/filesystem.manifest
/home/remastersys/remastersys/ISOTMP/casper/filesystem.manifest-desktop
/home/remastersys/remastersys/ISOTMP/casper/filesystem.squashfs
/home/remastersys/remastersys/ISOTMP/casper/README.diskdefines
/home/remastersys/remastersys/ISOTMP/casper/initrd.gz

I looked for filestystem.squashfs in /home/remastersys/remastersys/ISOTMP/casper and found it is there, but it has an 'X' in the top right corner.

[fragadelic]

The X means it was built by "root" user so you can't delete it as your normal user.

How big is the file?

I'm still kind of concerned that the check for the files failed on the file.  It almost sounds like you have some sort of compatibility issue between the kernel and squashfs-tools.  If you have added any ppa's or other repositories, please post their apt lines here.  There have been times in the past where someone adds packages to their ppa or repository that conflicts with the live packages.

[markb]

filesystem.squashfs is 13.2GB

Kernel is 2.6.35-30-server

Added repositories are:
http://packages.medibuntu.org/maverick free non-free
http://www.geekconnection.org/remastersys/repository karmic/
http://ppa.launchpad.net/stebbins/handbrake-releases/ubuntu maverick
http://ppa.launchpad.net/stedy6/stedy-minidlna/ubuntu maverick

Could dropbox cause an issue?

[fragadelic]

I think you have 2 issues:

1 - take the leading / from the excluded folder in the config file
2 - the server kernel may not support squashfs

Try fixing the excluded folder leading slash and try again.  If it still doesn't work, you will need to use one of the desktop kernels.

[markb]

Thanks, I'll try this and let you know the outcome

[markb]

I think you have 2 issues:

1 - take the leading / from the excluded folder in the config file
2 - the server kernel may not support squashfs

Try fixing the excluded folder leading slash and try again.  If it still doesn't work, you will need to use one of the desktop kernels.

I removed the leading slash from the excluded folder config but still get the same result. Filesize too big...

I checked the changelog for kernel 2.6.35.30-server and it says squashfs was added to fs-core-modules so does this mean the kernel does support squashfs?

If not, is it straightforward to swop a kernel or does it mean reinstall?

[fragadelic]

Do you have any virtual machines?

[markb]

No

[markb]

No VM's. I checked the kernel documentation and squashfs is supported. Will I have to reinstall ubuntu with a desktop kernel for remastersys to work?   

[fragadelic]

I think your issue is this being mounted:

rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)

Not sure why I didn't catch it before but you will need to unmount this prior to remastering.

[markb]

Thanks, I'll try it. I have no idea what it is or why it's mounting but will give it a go.

[fragadelic]

Its part of nfs that is used to provide network shares with nfs.

[markb]

Thanks, will be it be sufficient to do a sudo service nfs-kernel-server stop, and then run remastersys?

[fragadelic]

Not sure.  Check with the "mount" command in a terminal window after you do that and if it is still mounted you will need to unmount it manually.

[markb]

I think I've unmounted the NFS share. I've been using 3.0.0 today and reach the point where Remastersys creates md5sum.txt for the livecd/dvd and then I get the message that the ISO is in home/remastersys but there is no ISO file there. I checked home/remastersys/remastersys and found ISOTMP - size 123GB and dummysys which is 399.4MB.

Maybe the problem is still being caused by the NFS share? If it is, I'll just have to uninstall NFS completely as I can't find any other way.

[fragadelic]

Check to see with the mount command again.

There is something that is getting included there that shouldn't.

[markb]

I just cannot unmount this rpc_pipefs. Google is full of people that have asked the same questions but answers are thin and incomprehensible to anyone who doesn't already know the answer. I'm banging my head against the wall with this.

[fragadelic]

Try this and then check with mount again.

sudo umount /var/lib/nfs/rpc_pipefs

If it is unmounted, go ahead and try to remaster again.

[markb]

Try this and then check with mount again.

sudo umount /var/lib/nfs/rpc_pipefs

If it is unmounted, go ahead and try to remaster again.

This is the command I've been using but I get the message "device is busy (In some cases useful info about processes that use the device is found by lsof(8) or fuser(1))".

So I tried sudo lsof /var/lib/nfs/rpc_pipefs and it returned this, which doesn't help me.
COMMAND = rpc.idmap
PID = 3272
USER = root
FD = 9
TYPE = DIR
DEVICE = 0,19
SIZE = 0
NODE = 103

I also tried sudo fuser -km /var/lib/nfs/rpc_pipefs and it returned 1143. Then I ran the umount command again and got the same message: "device is busy etc..")

This thing doesn't want to unmount...

[markb]

Have now unmounted /var/lib/nfs/rpc_pipefs by taking a couple of mount points out of /etc/exports. When I do a umount command, it tells me it's not mounted 

I'm ran a DIST with this in the excluded section of the config:

home/mark/Videos home/mark/Music home/mark/xyz.......then I tried
home/mark/Videos /home/mark/Music /home/mark/xyz......then I tried
/home/mark/Videos /home/mark/Music /home/mark xyz........

Same outcome every time. No ISO file and a ISOTMP file thats 123GB.

[fragadelic]

Do this and either attach the file if it isn't too big or email it to me.

unsquashfs -lls /home/remastersys/remastersys/ISOTMP/casper/filesystem.squashfs | grep -v " inodes " | \
grep -v "unsquashfs:" | awk '{print $3}' | grep -v "," > markbsize.txt

Send me the markbsize.txt so I can see what is taking up so much room.

[markb]

Just sent by email

[fragadelic]

Can you send me this one as well.

unsquashfs -lls /home/remastersys/remastersys/ISOTMP/casper/filesystem.squashfs > markbdetail.txt