Page 1 of 2 12 LastLast
Results 1 to 10 of 11

Thread: Shell Access for a Research Project

  1. #1
    Join Date
    Jan 2007
    Beans
    207
    Distro
    Ubuntu Development Release

    Shell Access for a Research Project

    Does anyone know of a service that provides shell access that I can use to analyse data for a scientific research project? I'll need to install one Perl module and one C library (the module is a wrapper for the library). One Python script is also included.

    I would take the traditional route and perform the task through a university/research institution, but I'm not affiliated with anyone, so I'm a bit stuck. Unfortunately I can't leave my computer on for the duration of the task either.

    If anyone knows of a way to facilitate this, I am happy to give you credit. The estimated time to process the data is a couple of days, but it could take closer to a week.

    If you need specific information, please PM me and I'll be happy to explain more. Of course, all the code I will run is open source so that you can see what's going on. Thank you for your time!
    Last edited by ShareBuntu; July 24th, 2012 at 01:13 PM. Reason: Fixed a typo.
    Think.

  2. #2
    Join Date
    Aug 2005
    Beans
    6,028

  3. #3
    Join Date
    Jan 2007
    Beans
    207
    Distro
    Ubuntu Development Release

    Re: Shell Access for a Research Project

    These are great, thank you. I'll start making my way through them. The only thing I'm worried about is whether shell accounts like these will allow me to run CPU intensive processes for a few days.
    Think.

  4. #4
    Join Date
    Aug 2005
    Beans
    6,028

    Re: Shell Access for a Research Project

    Quote Originally Posted by ShareBuntu View Post
    These are great, thank you. I'll start making my way through them. The only thing I'm worried about is whether shell accounts like these will allow me to run CPU intensive processes for a few days.
    Just look at my post again as I've edited it with more links. try the IBM one, those guys have lots of horsepower.

    EDIT: Which country are you in? Maybe we can get you access to a linux cluster.
    Last edited by mips; July 24th, 2012 at 02:05 PM.

  5. #5
    Join Date
    Jan 2010
    Location
    Kolkata India
    Beans
    Hidden!
    Distro
    Ubuntu

    Re: Shell Access for a Research Project

    I used to have an shell account at IBM's Z series mainframes running RHEL .
    The Service provides with access to a Linux on System z environment for the purpose of providing the Open Source community with a platform to develop, port and/or test drive your products or applications on this platform.
    “Progress is made by lazy men looking for easier ways to do things”
    — Robert A. Heinlein

  6. #6
    Join Date
    Jan 2010
    Location
    Kolkata India
    Beans
    Hidden!
    Distro
    Ubuntu

  7. #7
    Join Date
    Mar 2007
    Location
    Portsmouth, UK
    Beans
    Hidden!
    Distro
    Ubuntu 11.10 Oneiric Ocelot

    Re: Shell Access for a Research Project

    Quote Originally Posted by ShareBuntu View Post
    If anyone knows of a way to facilitate this, I am happy to give you credit. The estimated time to process the data is a couple of days, but it could take closer to a week.
    A week with what sort of processing power, and would remote access be an absolute requirement?

  8. #8
    Join Date
    Jan 2007
    Beans
    207
    Distro
    Ubuntu Development Release

    Re: Shell Access for a Research Project

    I've tested the processing scripts on a few data files and judged the time required to complete the task by that. The data files do vary though, from around 200b to 1mb in size. I have around 6.5 million comparisons to do and on both my core2 and i7 it completes around 300-400 comparisons in 20-30 seconds. So it's definitely a few days of processing.

    The program to run is a Python script that calls a Perl wrapper for a suffix tree written in C (there is no Python wrapper for it). It's a bit ad hoc, but it gets the job done, and I don't think doing the whole thing from Perl will improve the speed much, since the Python part only takes a split second.

    Remote access isn't an absolute requirement, as I can provide instructions on the libraries required and the instructions to run the script. I'm in Australia, so I don't know if that helps getting access to a Linux cluster somewhere?
    Think.

  9. #9
    Join Date
    Jan 2010
    Location
    Kolkata India
    Beans
    Hidden!
    Distro
    Ubuntu

    Re: Shell Access for a Research Project

    Quote Originally Posted by ShareBuntu View Post
    I've tested the processing scripts on a few data files and judged the time required to complete the task by that. The data files do vary though, from around 200b to 1mb in size. I have around 6.5 million comparisons to do and on both my core2 and i7 it completes around 300-400 comparisons in 20-30 seconds. So it's definitely a few days of processing.

    The program to run is a Python script that calls a Perl wrapper for a suffix tree written in C (there is no Python wrapper for it). It's a bit ad hoc, but it gets the job done, and I don't think doing the whole thing from Perl will improve the speed much, since the Python part only takes a split second.

    Remote access isn't an absolute requirement, as I can provide instructions on the libraries required and the instructions to run the script. I'm in Australia, so I don't know if that helps getting access to a Linux cluster somewhere?
    You can run your script on a remote server with screen or nohup ,

    Code:
    man screen
    That way you dont need to be physically man the terminal .You can just log out from the remote server and the process will be running on background till it finishes .
    Last edited by codemaniac; July 24th, 2012 at 03:52 PM.
    “Progress is made by lazy men looking for easier ways to do things”
    — Robert A. Heinlein

  10. #10
    Join Date
    Mar 2007
    Location
    Portsmouth, UK
    Beans
    Hidden!
    Distro
    Ubuntu 11.10 Oneiric Ocelot

    Re: Shell Access for a Research Project

    I have a quad 2800 (is the exec multicore-capable?) that I can make available, but there's no remote access, and it would obviously take longer than a few days.

    The offer is there in the very unlikely event that you can't find something more suitable.

Page 1 of 2 12 LastLast

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •