Re: Interactive task scheduling (system) ? How do I run a list of tasks consecutively on a server ?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On 21Jan2022 10:39, linux guy <linuxguy123@xxxxxxxxx> wrote:
>I'm using a server to run a bunch of simulations.  By bunch I mean
>hundreds.  Each simulation takes from 10 minutes to 10 hours to run.  All
>of the simulations are run from the command line.  Every day I generate
>more simulation cases.
>
>I'm looking for a method/system/app that I can give a list of tasks that
>will run them on the server, automatically, one after another.

If you can define a task in a single line of text you could run 
something like this on the server:

    tail -f task_list.txt | while read -r spec; do run the task from $spec; done

Put that in a tmux or screen session.

Task submission is then just appending a spec to the text file:

    echo "specification here" >> task_list.txt

Dumb as rocks, but effective. I've run simple workers like this.

Probably "run the task from $spec" should invoke a shell script to run 
exactly one task collecting the output, logging the times etc.

Cheers,
Cameron Simpson <cs@xxxxxxxxxx>
_______________________________________________
users mailing list -- users@xxxxxxxxxxxxxxxxxxxxxxx
To unsubscribe send an email to users-leave@xxxxxxxxxxxxxxxxxxxxxxx
Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: https://lists.fedoraproject.org/archives/list/users@xxxxxxxxxxxxxxxxxxxxxxx
Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure



[Index of Archives]     [Older Fedora Users]     [Fedora Announce]     [Fedora Package Announce]     [EPEL Announce]     [EPEL Devel]     [Fedora Magazine]     [Fedora Summer Coding]     [Fedora Laptop]     [Fedora Cloud]     [Fedora Advisory Board]     [Fedora Education]     [Fedora Security]     [Fedora Scitech]     [Fedora Robotics]     [Fedora Infrastructure]     [Fedora Websites]     [Anaconda Devel]     [Fedora Devel Java]     [Fedora Desktop]     [Fedora Fonts]     [Fedora Marketing]     [Fedora Management Tools]     [Fedora Mentors]     [Fedora Package Review]     [Fedora R Devel]     [Fedora PHP Devel]     [Kickstart]     [Fedora Music]     [Fedora Packaging]     [Fedora SELinux]     [Fedora Legal]     [Fedora Kernel]     [Fedora OCaml]     [Coolkey]     [Virtualization Tools]     [ET Management Tools]     [Yum Users]     [Yosemite News]     [Gnome Users]     [KDE Users]     [Fedora Art]     [Fedora Docs]     [Fedora Sparc]     [Libvirt Users]     [Fedora ARM]

  Powered by Linux