Welcome, guest | Sign In | My Account | Store | Cart

Notice! PyPM is being replaced with the ActiveState Platform, which enhances PyPM’s build and deploy capabilities. Create your free Platform account to download ActivePython or customize Python with the packages you require and get automatic updates.

Download
ActivePython
INSTALL>
pypm install jug

How to install Jug

  1. Download and install ActivePython
  2. Open Command Prompt
  3. Type pypm install jug
 Python 2.7Python 3.2Python 3.3
Windows (32-bit)
0.9
0.9.6Never BuiltWhy not?
0.9 Available View build log
0.8.1 Available View build log
0.8 Available View build log
0.8-b0 Available View build log
0.7.4 Available View build log
0.7.3 Available View build log
0.7.2 Available View build log
0.7.1 Failed View build log
0.7 Failed View build log
0.6.99 Available View build log
0.6.9 Available View build log
0.6.2 Available View build log
0.6 Available View build log
Windows (64-bit)
0.9
0.9.6Never BuiltWhy not?
0.9 Available View build log
0.8.1 Available View build log
0.8 Available View build log
0.8-b0 Available View build log
0.7.4 Available View build log
0.7.3 Available View build log
0.7.2 Available View build log
0.7.1 Failed View build log
0.7 Failed View build log
0.6.99 Available View build log
0.6.9 Available View build log
0.6.2 Available View build log
0.6 Available View build log
Mac OS X (10.5+)
0.9
0.9.6Never BuiltWhy not?
0.9 Available View build log
0.8.1 Available View build log
0.8 Available View build log
0.8-b0 Available View build log
0.7.4 Available View build log
0.7.3 Available View build log
0.7.2 Available View build log
0.7.1 Failed View build log
0.7 Failed View build log
0.6.99 Available View build log
0.6.9 Available View build log
0.6.2 Available View build log
0.6 Available View build log
Linux (32-bit)
0.9.2
0.9.6Never BuiltWhy not?
0.9.2 Available View build log
0.9.1 Available View build log
0.9 Available View build log
0.8.1 Available View build log
0.8 Available View build log
0.8-b0 Available View build log
0.7.4 Available View build log
0.7.3 Available View build log
0.7.2 Available View build log
0.7.1 Failed View build log
0.7 Failed View build log
0.6.99 Available View build log
0.6.9 Available View build log
0.6.2 Available View build log
0.6 Available View build log
Linux (64-bit)
0.9.6 Available View build log
0.9.2 Available View build log
0.9.1 Available View build log
0.9 Available View build log
0.8.1 Available View build log
0.8 Available View build log
0.8-b0 Available View build log
0.7.4 Available View build log
0.7.3 Available View build log
0.7.2 Available View build log
0.7.1 Failed View build log
0.7 Failed View build log
0.6.99 Available View build log
0.6.9 Available View build log
0.6.2 Available View build log
0.6 Available View build log
 
License
MIT
Dependencies
Lastest release
version 0.9.6 on Jan 9th, 2014

Jug allows you to write code that is broken up into tasks and run different tasks on different processors.

It uses the filesystem to communicate between processes and works correctly over NFS, so you can coordinate processes on different machines.

Jug is a pure Python implementation and should work on any platform.

Python 2.6/2.7 and Python 3.3 are supported.

Website: http://luispedro.org/software/jug

Documentation: https://jug.readthedocs.org/

Video: On vimeo or showmedo

Mailing List: http://groups.google.com/group/jug-users

Short Example

Here is a one minute example. Save the following to a file called primes.py:

from jug import TaskGenerator
from time import sleep

@TaskGenerator
def is_prime(n):
    sleep(1.)
    for j in xrange(2,n-1):
        if (n % j) == 0:
            return False
    return True

primes100 = map(is_prime, xrange(2,101))

Of course, this is only for didactical purposes, normally you would use a better method. Similarly, the sleep function is so that it does not run too fast.

Now type jug status primes.py to get:

Task name                  Waiting       Ready    Finished     Running
----------------------------------------------------------------------
primes.is_prime                  0          99           0           0
......................................................................
Total:                           0          99           0           0

This tells you that you have 99 tasks called primes.is_prime ready to run. So run jug execute primes.py &. You can even run multiple instances in the background (if you have multiple cores, for example). After starting 4 instances and waiting a few seconds, you can check the status again (with jug status primes.py):

Task name                  Waiting       Ready    Finished     Running
----------------------------------------------------------------------
primes.is_prime                  0          63          32           4
......................................................................
Total:                           0          63          32           4

Now you have 32 tasks finished, 4 running, and 63 still ready. Eventually, they will all finish and you can inspect the results with jug shell primes.py. This will give you an ipython shell. The primes100 variable is available, but it is an ugly list of jug.Task objects. To get the actual value, you call the value function:

In [1]: primes100 = value(primes100)

In [2]: primes100[:10]
Out[2]: [True, True, False, True, False, True, False, False, False, True]
Travis Build Status
https://travis-ci.org/luispedro/jug.png

What's New

version 0.9.6 (Tue Aug 6 2013) - Faster decoding - Add jug-execute script - Add describe() function - Add write_task_out() function

version 0.9.5 (May 27 2013)

  • Added debug mode
  • Even better map.reduce.map using blocked access
  • Python 3 support
  • Documentation improvements

version 0.9.4 (Apr 15 2013)

  • Add CustomHash wrapper to set __jug_hash__
  • Print traceback on import error
  • Exit when no progress is made even with barrier
  • Use Tasklets for better jug.mapreduce.map
  • Use Ipython debugger if available (patch by Alex Ford)
  • Faster --aggressive-unload
  • Add currymap() function

version 0.9.3 (Dec 2 2012)

  • Fix parsing of ports on redis URL (patch by Alcides Viamontes)
  • Make hashing robust to different orders when using randomized hashing (patch by Alcides Viamontes)
  • Allow regex in invalidate command (patch by Alcides Viamontes)
  • Add --cache --clear suboption to status
  • Allow builtin functions for tasks
  • Fix status --cache`` (a general bug which seems to be triggered mainly by bvalue() usage).
  • Fix CompoundTask (broken by earlier __jug_hash__ hook introduction)
  • Make Tasklets more flexible by allowing slicing with Tasks (previously, slicing with tasks was not allowed)

version 0.9.2 (Nov 4 2012):

  • More flexible mapreduce()/map() functions
  • Make TaskGenerator pickle()able and hash()able
  • Add invalidate() method to Task
  • Add --keep-going option to execute
  • Better help messsage

version 0.9.1 (Jun 11 2012):

  • Add --locks-only option to cleanup subcommand
  • Make cache file (for status subcommand) configurable
  • Add webstatus subcommand
  • Add bvalue() function
  • Fix bug in shell subcommand (value was not in global namespace)
  • Improve identity()
  • Fix bug in using Tasklets and --aggressive-unload
  • Fix bug with Tasklets and sleep-until/check

version 0.9:

  • In the presence of a barrier(), rerun the jugfile. This makes barrier much easier to use.
  • Add set_jugdir to public API
  • Added CompoundTaskGenerator
  • Support subclassing of Task
  • Avoid creating directories in file backend unless it is necessary
  • Add jug.mapreduce.reduce (which mimicks the builtin reduce)

For older version see ChangeLog file.

Roadmap

Version 1.0

Version 1.0 is just around the corner. After 0.8 is done, there really are not that many features left. More flexible configuration, a bit more caching, and we are done.

After version 1.0

I want to start adding bells&whistles through extensions. Things like timing, more active monitoring, &c.

Subscribe to package updates

Last updated Jan 9th, 2014

Download Stats

Last month:2

What does the lock icon mean?

Builds marked with a lock icon are only available via PyPM to users with a current ActivePython Business Edition subscription.

Need custom builds or support?

ActivePython Enterprise Edition guarantees priority access to technical support, indemnification, expert consulting and quality-assured language builds.

Plan on re-distributing ActivePython?

Get re-distribution rights and eliminate legal risks with ActivePython OEM Edition.