Aaron Griffith
24d8dc4b99
dispatcher status callback
...
Right now it's called every 100 work items. This number is completely
arbitrary and should probably be tuned.
2011-12-26 10:36:52 -05:00
Aaron Griffith
740f5ee628
dispatcher.finish_jobs() has been removed
...
the other dispatcher functions can provide the same functionality, so
removing finish_jobs() only makes the dispatcher interface slimmer.
2011-12-26 10:05:57 -05:00
Aaron Griffith
e8683fd0bc
saner timeout handling on MultiprocessingDispatcher
...
_handle_messages() now *doesn't* block if it's being called simply to
see what jobs are done, but still blocks and times out when it's
*waiting* on jobs to be done.
2011-12-21 06:32:55 -05:00
Aaron Griffith
2863876589
moved in signals from the gist
...
gist: https://gist.github.com/1479733
tracker: #564
2011-12-21 06:10:34 -05:00
Aaron Griffith
2717485031
dispatcher class now supports work-item dependencies
...
Thanks to ion in #overviewer for a particularly slick way to implement
this without using too much memory.
tracker: Issue #564
2011-12-21 04:43:17 -05:00
Aaron Griffith
77ae3e2cb6
some minor changes to allow multinode (!!!) dispatching
...
tracker: #564
2011-12-20 06:38:37 -05:00
Aaron Griffith
192591c2b0
comments and docstrings for the multiprocessing dispatcher
2011-12-20 05:39:41 -05:00
Aaron Griffith
8db7d37164
dispatcher docstrings and first multiprocessing dispatcher
...
tracker: Issue #564
2011-12-20 01:36:34 -05:00
Aaron Griffith
0029753c36
first version of single-process dispatcher
...
tracker: Issue #564
2011-12-19 23:20:59 -05:00
