Andrew Chin
2621997ecc
Made multiprocessing work on windows \o/
2012-02-18 01:19:45 -05:00
Andrew Brown
9319fee138
added processes option to command line and config file
...
Also the config file parser now just looks for all Settings objects in
settingsDefinitions.py, not the items in __all__
2012-02-08 21:05:02 -05:00
Aaron Griffith
1baf506a59
renders now work with the multiprocessing dispatcher
2012-01-06 21:56:26 -05:00
Aaron Griffith
24d8dc4b99
dispatcher status callback
...
Right now it's called every 100 work items. This number is completely
arbitrary and should probably be tuned.
2011-12-26 10:36:52 -05:00
Aaron Griffith
740f5ee628
dispatcher.finish_jobs() has been removed
...
the other dispatcher functions can provide the same functionality, so
removing finish_jobs() only makes the dispatcher interface slimmer.
2011-12-26 10:05:57 -05:00
Aaron Griffith
e8683fd0bc
saner timeout handling on MultiprocessingDispatcher
...
_handle_messages() now *doesn't* block if it's being called simply to
see what jobs are done, but still blocks and times out when it's
*waiting* on jobs to be done.
2011-12-21 06:32:55 -05:00
Aaron Griffith
2863876589
moved in signals from the gist
...
gist: https://gist.github.com/1479733
tracker: #564
2011-12-21 06:10:34 -05:00
Aaron Griffith
2717485031
dispatcher class now supports work-item dependencies
...
Thanks to ion in #overviewer for a particularly slick way to implement
this without using too much memory.
tracker: Issue #564
2011-12-21 04:43:17 -05:00
Aaron Griffith
77ae3e2cb6
some minor changes to allow multinode (!!!) dispatching
...
tracker: #564
2011-12-20 06:38:37 -05:00
Aaron Griffith
192591c2b0
comments and docstrings for the multiprocessing dispatcher
2011-12-20 05:39:41 -05:00
Aaron Griffith
8db7d37164
dispatcher docstrings and first multiprocessing dispatcher
...
tracker: Issue #564
2011-12-20 01:36:34 -05:00
Aaron Griffith
0029753c36
first version of single-process dispatcher
...
tracker: Issue #564
2011-12-19 23:20:59 -05:00
