how to tell when jobs are finished
Many of your questions may have already been answered in earlier discussions or in the FAQ. The search results page will indicate current discussions as well as past list serves, articles, and papers.
Pedro Díaz Jiménez pdiaz88 at terra.esSat Aug 4 16:21:52 PDT 2001
- Previous message: how to tell when jobs are finished
- Next message: starting jobs via bproc
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On Saturday 04 August 2001 20:44, Ron Chen wrote:
> Why don't you try to catch the SIGCHLD?
nicer
>
> When child exits, the parent receives SIGCHLD:
and when the child is stopped. I don't know if that could be an issue here
>
> #include <signal.h>
> #include <sys/types.h>
> #include <sys/wait.h>
>
> int sh(int i) /* signal handler */
> {
> int status;
> pid_t pid;
>
> printf("Hello\t");
> pid = wait(&status);
> printf("pid = %d status = %d\n", pid, (status>>8));
> }
>
>
> main()
> {
> int i;
>
> signal(SIGCHLD, sh); /* install handler */
>
> for (i=0;i<3;i++)
> if (fork()==0)
> { sleep(i);
> exit(i);
> }
>
> for (i=0; i<10;i++) /* parent work on other stuff */
> sleep(10);
> }
>
> The parent (main function) may not call sleep(10), I
> used it as a hack. For you, you should call select to
> listen to the new execution request from the cluster
> master (like qmaster in SGE).
>
> The program will print out the pid and exit status:
> Hello pid = 19443 status = 0
> Hello pid = 19444 status = 1
> Hello pid = 19445 status = 2
>
>
> Just wanted to point out one thing here:
> We are working on the process level. We need more work
> to trace the process tree to make sure that we can get
> the information about the job (which consists of 1
> more more processes). Currently, if the child forks
> another child, we won't be able to know.
>
> -Ron
>
> --- Nicholas Henke <henken at seas.upenn.edu> wrote:
> > Thanks guys for the input--
> > I think the signal handler with a polling mechanism
> > should work
> > very nice.
> >
> > Nic
> >
> > > Hi,
> > >
> > > I agree with Sean about the use of waitpid().
> >
> > About the daemon, well, I think
> >
> > > is not necesary. If I not misunderstood you, what
> >
> > you want to do is execute
> >
> > > a certain number of programs and know when anyone
> >
> > of those programs exited.
> >
> > > Here is my proposal, in the form of a
> >
> > pseudo-shell
> >
> > > 1.read somehow the list of programs to execute
> > > 2. For each program to run, create a child using
> >
> > fork() (the master
> >
> > > creates all the childs)
> > > 3. (optional) you may want to redirect each child
> >
> > output to some file
> >
> > > 4. get from the childs its pid via some IPC
> >
> > mechanism (a pipe will do) and
> >
> > > store the in an array or something (i would use a
> >
> > linked list, or a
> >
> > > search-tree table if you will have lots of pids)
> > > 5. Finally, each child calls exec*() and replaces
> >
> > its memory image with the
> >
> > > program desired - that is - executes the program
> > > 6. Now, you have to know when each of the programs
> >
> > you executed has exited.
> >
> > > For simplicity, lets assume you whant to printf
> >
> > something like "Hey!, PID
> >
> > > XXXX finished!". You can do this in two forms (to
> >
> > mi knowledge):
> > > a) loop until all the programs have exited. You
> >
> > can use waitpid with WNOHANG
> >
> > > to poll each pid. Advantage: Simple.
> >
> > Disadvantage: You can't do other
> >
> > > productive things while waiting
> > > b) Set a signal handler to the alarm signal, and
> >
> > test say each second for
> >
> > > completion of one of the pids in your list. If
> >
> > completion, print message and
> >
> > > remove that pid from the list. Disable signal
> >
> > callback when list is empty,
> >
> > > and re-enable when list has at leat one element.
> >
> > Advantages: You can do other
> >
> > > productive things, like launching more processes.
> >
> > Disadvantages: A little
> >
> > > more complicated. If you use this option, see
> >
> > sigaction(2) and signal(2)
> >
> >
> >
> > _______________________________________________
> > Beowulf mailing list, Beowulf at beowulf.org
> > To change your subscription (digest mode or
> > unsubscribe) visit
>
> http://www.beowulf.org/mailman/listinfo/beowulf
>
>
> __________________________________________________
> Do You Yahoo!?
> Make international calls for as low as $.04/minute with Yahoo! Messenger
> http://phonecard.yahoo.com/
- --
__________________________________________________
/ \
| Pedro Diaz Jimenez |
| |
| pdiaz88 at terra.es pdiaz at acm.asoc.fi.upm.es |
| |
| |
| http://planetcluster.org |
| Clustering & H.P.C. news and documentation |
| |
| There are no stupid questions, but there're a |
| lot of inquisitive idiots |
| Anonymous |
| |
| "I find your lack of faith disturbing." |
| Darth Vader, Star Wars Episode IV |
\__________________________________________________/
- -----BEGIN PGP PUBLIC KEY BLOCK-----
Version: GnuPG v1.0.4 (GNU/Linux)
Comment: For info see http://www.gnupg.org
mQGiBDqcGZsRBADFIahNPLk8suMlS39m8RqatLgX4dO7PU2F5p1oVvkyB7PaLQCv
FREWwfrjGpxAjRnxyZ4TdaFi1oCP495t5R2CdjPZu0EfjsEqosdLXkjDsKl2n4Wo
Afb6BaHMJS5PADEI0QfpZOkB8OruAZja/oGmn5rThyjgCxWHUuK1ArmeGwCg7+9a
owg9wP1RohePHJSDB9d2HYMD/i7z1X4ev+K90LumgJwSWlScJ7MEip5rw4wqGOkK
lF/C2nTYsoX5CVEn/pu7hROL/BWIYtBgkNDaEjsVsyb+4KjQXcZUW5l3ADipWYx2
r9s4sFfeZ9nfhDcG0aNYRcCNkYSZ/WxUkXS8UjVEAEhkFu1BA+6UZmeq3pKtJZTR
+HqKA/9zRmgTon36zt2qe9eiR6DyY0EpGEI0iY+KYX6GC/wxizeHBw0FW1eOEoxF
GjtxdBv/U9vi7Vgav6aY+pr4la5q6jVabe03Y8yGDFeL8jM+lqww1rzpABiGrF+W
qge65zCUjL3jJE5+5yi+KcRyllb1OA7uXQTtsRw+TGq9Dvaaz7QwUGVkcm8gRGlh
eiBKaW1lbmV6IChCLk8uRi5ILikgPHBkaWF6ODhAdGVycmEuZXM+iFYEExECABYF
AjqcGZsECwoEAwMVAwIDFgIBAheAAAoJEJ7ud33hGMZRj20An2Ce4S/vBTuZDxnL
WFBrJRnc3UdaAKDnIPNRbz7r4dh9AuBcpbCE1pQ/SLkBDQQ6nBmqEAQAr7O07Dws
5zAbQvm1hwGthXKCHtIIuWCPdX/XkNG6ZxV/cXgs4LI4oAg3GhttD2JIEk2SoVXE
FOf/wIddIDz70/9mIZavMvpR31LxBFSJk0Up3caOvThM90wMttRi7tg7cf04rrMM
Phy8T5bOIW/q5SMwZffbJXD7bA0/jDLdQ6MAAwYD/1emSwNTzOOmMCZadoEBpKIE
HA35P2/m/SsCI+pQ/OKXKPvvrQKTQqRCcDa5aq31oSiT9M5WQ96BlIGKHRPWGpvm
0822V7M9RF2mYZPIfgKfTSvZpYHzjz+RM7PvBBiBc9l95vy70Sh7SywIF86H80Ag
D0dUIDtGlrSANhXjx4EJiEYEGBECAAYFAjqcGaoACgkQnu53feEYxlHdVACgjVhU
Y8CKf6MYZgQOR9eIDNvTX0AAn3dwbW1HLxEF5OQKJIsngl0BUlYK
=d4S3
- -----END PGP PUBLIC KEY BLOCK-----
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.4 (GNU/Linux)
Comment: For info see http://www.gnupg.org
iD8DBQE7bIOWnu53feEYxlERAifYAJ9so6xJC1TzQRGUJwhucNYsciBhSwCcD53m
g8koEeBw2tvjPKvr4B9ytMU=
=WEcF
-----END PGP SIGNATURE-----
- Previous message: how to tell when jobs are finished
- Next message: starting jobs via bproc
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
More information about the Beowulf mailing list