Results 1 to 2 of 2

Thread: Clustering two ubuntu servers

  1. #1
    Join Date
    Sep 2019
    Beans
    1

    Unhappy Clustering two ubuntu servers

    Hi,

    I have very CPU intensive tasks that take forever and I would like to spread the tasks among several machines. I read about Beowulf, but it seems there is little activity or new posts for "Ubuntu Beowulf". Is there some Ubuntu package to offload some of CPU intensive tasks to another server? Most of the tasks are executed from shell, so for now I am torturing rsh, but there must be better ways to do it.

    Does anyone know of an easy to install package that would allow me to offload some of shell executed commands to another Ubuntu server?

    Thank you!

  2. #2
    Join Date
    Mar 2010
    Location
    Squidbilly-Land
    Beans
    Hidden!
    Distro
    Ubuntu Mate 16.04 Xenial Xerus

    Re: Clustering two ubuntu servers

    Don't use rsh. Use ssh.

    There's a number of packages that can help with batch processing. batch, at, xargs, taskspooler, gnu-parallel.
    https://www.gnu.org/software/parallel/
    https://www.gnu.org/software/paralle...ernatives.html
    A quick google search found at least 50 different possible options.
    I use xargs with find. Also use taskspooler about 50x a day. Sometimes inotify is really all I need.

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •