Page 1 of 2 12 LastLast
Results 1 to 10 of 11

Thread: splitting a 123GB picture file into smaller files

  1. #1
    Join Date
    May 2018
    Location
    Canada
    Beans
    93
    Distro
    Ubuntu Development Release

    splitting a 123GB picture file into smaller files

    Hello, I know there's a method called split and many more than can do this kind of things but they seem to all split it in text lines or in bye sizes. SO basically I have a 123GB file size that I need to upload to the Microsoft OneDrive and since the file is so big the uploading just freezes and crashes every single time so basically I want to divide that file in like around 10-15 GB files. But I don't know what the command is to split that file because all the pictures and videos have different sizes so I do not know if the pictures would be cut off or something like that. This might sound stupid but the file is so big that a lot of computers seem to have trouble copying it so I do not have a back-up hence why I don't want to risk anything.

  2. #2
    Join Date
    May 2005
    Location
    US
    Beans
    Hidden!
    Distro
    Ubuntu

    Re: splitting a 123GB picture file into smaller files

    Microsoft says you can't direct upload large files, but you can add the files to the OneDrive desktop app:
    https://support.office.com/en-us/art...d-59d3e802247e

    I'm sure they don't have a native Linux OneDrive app, but maybe have a look here for a workaround?
    https://medium.com/@glmdev/onedrive-...u-2bcbf6777ee4

  3. #3
    Join Date
    Oct 2005
    Location
    Lab, Slovakia
    Beans
    10,502

    Re: splitting a 123GB picture file into smaller files

    You can use split, tar, 7zip, dd...

    I probably don't need to tell you to read the man pages...

  4. #4
    Join Date
    May 2018
    Location
    Canada
    Beans
    93
    Distro
    Ubuntu Development Release

    Re: splitting a 123GB picture file into smaller files

    yes I know I can use split but what is it the correct method?

  5. #5
    Join Date
    Nov 2007
    Location
    London, England
    Beans
    7,366
    Distro
    Xubuntu 20.04 Focal Fossa

    Re: splitting a 123GB picture file into smaller files

    Try:
    Code:
    split -b 15G -d bigpig.jpg bigpic

  6. #6
    Join Date
    May 2018
    Location
    Canada
    Beans
    93
    Distro
    Ubuntu Development Release

    Re: splitting a 123GB picture file into smaller files

    um that doesnt work because I have over 24000 pictures and videos together... So I can't select one

  7. #7
    Join Date
    Nov 2007
    Location
    London, England
    Beans
    7,366
    Distro
    Xubuntu 20.04 Focal Fossa

    Re: splitting a 123GB picture file into smaller files

    You have 24000 pictures all over a hundred GB? It'll take a while, but you can script it.
    Code:
    find -name '*jpg' -exec split -b 15G -d '{}' '{}' \;

  8. #8
    Join Date
    May 2018
    Location
    Canada
    Beans
    93
    Distro
    Ubuntu Development Release

    Re: splitting a 123GB picture file into smaller files

    No, I have a file like a folder that had around 24000 pictures and videos and in total it adds up to 123 GB. I want the folder to be separated in equal amounts of pictures... So like one folder full of 24000 pics totalling 123GB of pictures I want that transformed to 7-8 folders each with around 10-15 GB of pictures

  9. #9
    Join Date
    Oct 2005
    Location
    Queensland, Australia
    Beans
    Hidden!
    Distro
    Ubuntu Development Release

    Re: splitting a 123GB picture file into smaller files

    What is "a file like a folder"?
    How did you create "a file like a folder"?

  10. #10
    Join Date
    Aug 2011
    Location
    51.8° N 5.8° E
    Beans
    6,125
    Distro
    Xubuntu

    Re: splitting a 123GB picture file into smaller files

    Sounds like some archive format. I think the way to go is to unpack the archive, then create new archives, each containing 10-15 GB of data. As image and video files cannot be compressed by the archive format (because they are already compressed to the max using lossy techniques; the lossless compression of archive formats can't beat that), you just have to collect 10-15GB of image/video files, then pack them into an archive. It should be doable to write a script for that.

Page 1 of 2 12 LastLast

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •