PDA

View Full Version : [ubuntu] Can't download files larger than 2GB from ubuntu server



milindras
May 7th, 2009, 01:11 PM
Hi,
We have a Ubuntu web server & Im trying to download bigger than 2 GB files & its not allowing. Less than 2GB any file I can be download or wget successfully.
Can any one tell me where to check for this problem?
Thanks
Milindra

BslBryan
May 7th, 2009, 01:21 PM
Hello, milindras. :-)

Well, a FAT32 partition cannot handle a file larger than 2GB, so if you're downloading on a FAT partition, try downloading on ext3 instead.

That being said, if it's not FAT32, it is quite possible that perhaps you have your FTP server set to cut off at 2GB? You might check it's config file.

If that's still not the problem, just try to use this:

curl http://whatever.example.ie.iso -C - -o whatever.iso

I hope I've been of some help. :-)

Good luck, and best to you.

colau
May 7th, 2009, 01:27 PM
Hello, milindras. :-)

Well, a FAT32 partition cannot handle a file larger than 2GB, so if you're downloading on a FAT partition, try downloading on ext3 instead.

That being said, if it's not FAT32, it is quite possible that perhaps you have your FTP server set to cut off at 2GB? You might check it's config file.

If that's still not the problem, just try to use this:

curl http://whatever.example.ie.iso -C - -o whatever.iso

I hope I've been of some help. :-)

Good luck, and best to you.
Thanks.
Got another option "curl".

milindras
May 7th, 2009, 01:28 PM
Hello, milindras. :-)

Well, a FAT32 partition cannot handle a file larger than 2GB, so if you're downloading on a FAT partition, try downloading on ext3 instead.

That being said, if it's not FAT32, it is quite possible that perhaps you have your FTP server set to cut off at 2GB? You might check it's config file.

If that's still not the problem, just try to use this:

curl http://whatever.example.ie.iso -C - -o whatever.iso

I hope I've been of some help. :-)

Good luck, and best to you.
Hi,
Appreciate for promt reply.
Could you tell me how to check my file system? Whether Fat32 or ?

And also what doest meant by
curl http://whatever.example.ie.iso -C - -o whatever.iso

Thanks
Milindra

3rdalbum
May 7th, 2009, 01:37 PM
Fat32 can handle files up to 4GB, not 2GB.

I'm thinking that Ext2 has a filesize limit of 2GB?

Curl is a program for downloading; it's an alternative to "wget". You've just been given a command to use with Curl; the URL given (http://whatever.example.ie.iso) is the URL of the file that you want to download, and the "whatever.iso" is the filename that you want the file to have when it hits your hard disk.

colau
May 7th, 2009, 01:39 PM
Fat32 can handle files up to 4GB, not 2GB.

I'm thinking that Ext2 has a filesize limit of 2GB?

Curl is a program for downloading; it's an alternative to "wget". You've just been given a command to use with Curl; the URL given (http://whatever.example.ie.iso) is the URL of the file that you want to download, and the "whatever.iso" is the filename that you want the file to have when it hits your hard disk.
Does curl have resume support?

gamblor01
May 7th, 2009, 01:44 PM
Could you tell me how to check my file system? Whether Fat32 or ?

You can use the following command to list all of the partitions and their corresponding formats:



sudo fdisk -l


If this is a Linux machine I seriously doubt the drive is formatted FAT32. Most likely it's ext3 (the ID column with be "83" and the System column will say "Linux").

What is the error message you are getting when wget fails?

milindras
May 7th, 2009, 01:45 PM
Fat32 can handle files up to 4GB, not 2GB.

I'm thinking that Ext2 has a filesize limit of 2GB?

Curl is a program for downloading; it's an alternative to "wget". You've just been given a command to use with Curl; the URL given (http://whatever.example.ie.iso) is the URL of the file that you want to download, and the "whatever.iso" is the filename that you want the file to have when it hits your hard disk.
Thanks.
Im using a download manager to download files to a XP machine. So the curl command cannot use isnt it?

milindras
May 7th, 2009, 01:47 PM
You can use the following command to list all of the partitions and their corresponding formats:



sudo fdisk -l


If this is a Linux machine I seriously doubt the drive is formatted FAT32. Most likely it's ext3 (the ID column with be "83" and the System column will say "Linux").

What is the error message you are getting when wget fails?
Disk /dev/sda: 158.9 GB, 158999773184 bytes
255 heads, 63 sectors/track, 19330 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 1 262 2104514+ 82 Linux swap / Solaris
/dev/sda2 * 263 19330 153163710 83 Linux

that is the out put of that. Can you tell me how to identify the file type?

Thanks

milindras
May 7th, 2009, 01:48 PM
Disk /dev/sda: 158.9 GB, 158999773184 bytes
255 heads, 63 sectors/track, 19330 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 1 262 2104514+ 82 Linux swap / Solaris
/dev/sda2 * 263 19330 153163710 83 Linux

that is the out put of that. Can you tell me how to identify the file type?

Thanks
Ah Its looks like FAT32

gamblor01
May 7th, 2009, 03:37 PM
No this system is clearly using ext3 (the ID is 83 and System is Linux) and not FAT32 according to the fdisk output.

I am a little confused however. First you say that are using Ubuntu, then you say you are using a download manager on Windows XP, and then you post the output of disk from a Linux machine.

So which is it? Are you trying to download the file on a system running Ubuntu or Windows XP?

milindras
May 7th, 2009, 03:43 PM
No this system is clearly using ext3 (the ID is 83 and System is Linux) and not FAT32 according to the fdisk output.

I am a little confused however. First you say that are using Ubuntu, then you say you are using a download manager on Windows XP, and then you post the output of disk from a Linux machine.

So which is it? Are you trying to download the file on a system running Ubuntu or Windows XP?
Oh, Sorry If I confused you. Its like this.

We have a Linux web server (Ubuntu) which Im taking some weekly backups.
Im using a download manager on a Xp machine to downloads those backed up files from the ubuntu server to Xp machine.
I can download any files less than 2GB from my server to my XP machine. But not anything larger than 2 GB.

Thanks

cholericfun
May 7th, 2009, 03:47 PM
so check you XP if its FAT32, (and you'll never be able to make files larger than 2GB - never heard of the 4GB another poster mentioned earlyer)
i think you can see that in the defragger

also you might want to check if all works fine for files >2GB on an NTFS / ext3 machine. just case theres something else going on as well

Slim Odds
May 7th, 2009, 03:56 PM
so check you XP if its FAT32, (and you'll never be able to make files larger than 2GB - never heard of the 4GB another poster mentioned earlyer)


File size limits are:
FAT32 -- 4GB
FAT16 -- 2GB

http://en.wikipedia.org/wiki/Comparison_of_file_systems#Limits

Also, for one of the previous posters, ext2 is 16GB (or more depending on block size).

cholericfun
May 7th, 2009, 03:58 PM
File size limits are:
FAT32 -- 4GB
FAT16 -- 2GB


ah cool, was never aware of that

milindras
May 27th, 2009, 10:39 AM
so check you XP if its FAT32, (and you'll never be able to make files larger than 2GB - never heard of the 4GB another poster mentioned earlyer)
i think you can see that in the defragger

also you might want to check if all works fine for files >2GB on an NTFS / ext3 machine. just case theres something else going on as well

I think there is something else.
Does apache, FTP server etc .. can put restrictions on the download limits?
For ftp server im using vsftpd, and I checked the vsftpd.conf file for any limitation, but couldnt find any thing.

thanks