Re: Good tutorial on setting up a grid/cluster using fedora

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 02/04/14 03:58 PM, Bill Oliver wrote:
On Wed, 2 Apr 2014, Digimer wrote:

On 02/04/14 03:46 PM, Bill Oliver wrote:
 On Wed, 2 Apr 2014, Digimer wrote:

> >  Ya, just a little TMI.
> >  I think you will need something fairly custom HPC setup... You will
>  need to find a way to break your work up into pieces and send them
out
>  the the various nodes, then collect the returned results and piece
>  them back together (and handle timeouts of jobs not returned by a
>  given node and re-issue to another node).
> >  There are some projects out there that might work as a
foundation, but
>  it's slipping outside my expertise (I'm an HA admin). I would suggest
>  stopping by freenode.net's #hpc channel and seeing what they might be
>  able to recommend.
> >
 I've run a small render farm back when I did forensic animations -- but
 you don't have to have the computers connected for a render farm.  But
 yeah, if I have 100 images and want to do ffts on all of them, I can
run
 scripts on five machines that do 20 each.  I'd like to see if a "real"
 cluster would improve stuff.  In addition, some of the software I've
 used supports real parallelism.


 billo

How do you define "real cluster"?


Something that I can take *one* program compiled for parallelization
that will distribute the processing among machines, as compared to
running multiple invocations of a program on different machine, each
chewing on a different dataset.

For instance, a render farm where I run 15 instances of Maya or Blender
on 15 machines, each rendering a different set of frames to be later
combined for an animation isn't a "real cluster" to me.  Running one
instance of Maya or Blender to use the memory and processing of all 15
machines would be a "real cluster" for me -- assuming a parallel version
of Maya or Blender that could do that, of course.

billo

I think OpenMosix tried to do this but went defunct quite some time ago. LinuxMPI seems to have taken over the source code, but I am not sure it does what you want.

In short, I don't know if there is anything that can sum the computational power of multiple systems and transparently make it look like a single super fast machine.

--
Digimer
Papers and Projects: https://alteeve.ca/w/
What if the cure for cancer is trapped in the mind of a person without access to education?
--
users mailing list
users@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe or change subscription options:
https://admin.fedoraproject.org/mailman/listinfo/users
Fedora Code of Conduct: http://fedoraproject.org/code-of-conduct
Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines
Have a question? Ask away: http://ask.fedoraproject.org




[Index of Archives]     [Older Fedora Users]     [Fedora Announce]     [Fedora Package Announce]     [EPEL Announce]     [EPEL Devel]     [Fedora Magazine]     [Fedora Summer Coding]     [Fedora Laptop]     [Fedora Cloud]     [Fedora Advisory Board]     [Fedora Education]     [Fedora Security]     [Fedora Scitech]     [Fedora Robotics]     [Fedora Infrastructure]     [Fedora Websites]     [Anaconda Devel]     [Fedora Devel Java]     [Fedora Desktop]     [Fedora Fonts]     [Fedora Marketing]     [Fedora Management Tools]     [Fedora Mentors]     [Fedora Package Review]     [Fedora R Devel]     [Fedora PHP Devel]     [Kickstart]     [Fedora Music]     [Fedora Packaging]     [Fedora SELinux]     [Fedora Legal]     [Fedora Kernel]     [Fedora OCaml]     [Coolkey]     [Virtualization Tools]     [ET Management Tools]     [Yum Users]     [Yosemite News]     [Gnome Users]     [KDE Users]     [Fedora Art]     [Fedora Docs]     [Fedora Sparc]     [Libvirt Users]     [Fedora ARM]

  Powered by Linux