Top-rated recipes tagged "queue"

Threaded communication with subprocess (Python)

2013-03-13T06:06:16-07:00

Python recipe 578488 by Jan Müller (async, ipc, messaging, multithreading, pipe, queue, subprocess). Revision 3.

This recipe shows how to domesticate another executable as a service in a subprocess.

Simple lock-queue via Memcached (Python)

2008-11-19T01:32:07-08:00

Python recipe 576567 by Tal Einat (concurrency, contextmanager, lock, locking, memcache, memcached, queue).

A simple lock-queue (FIFO) context manager implemented with Memcached.

In essence this is a normal lock, where the requests to acquire the lock are granted in the order in which they were originally made. Note that requests to acquire the lock are always blocking.

Interruptible Queue (Python)

2008-12-04T23:27:13-08:00

Python recipe 576461 by Carl Banks (queue). Revision 3.

A Queue that allows the producer thread to raise an exception in the consumer threads, or vice versa.

Priority Queue (with deletion) (Python)

2013-12-08T21:12:55-08:00

Python recipe 578780 by elazar (artificial_intelligence, heap, heapq, priority_queue, queue). Revision 5.

Based on the interface defined in aima-python http://aima-python.googlecode.com/svn/trunk/utils.py

Yields better performance.

Queue for managing multiple SIGALRM alarms concurrently (Python)

2012-12-06T18:58:11-08:00

Python recipe 577600 by Glenn Eychaner (alarm, queue, signal). Revision 3.

In asynchronous code, signal.alarm() is extremely useful for setting and handling timeouts and other timed and periodic tasks. It has a major limitation, however, that only one alarm function and alarm time can be set at a time; setting a new alarm disables the previous alarm. This package uses a heapq to maintain a queue of alarm events, allowing multiple alarm functions and alarm times to be set concurrently.

Find the oldest (or yougest) of a list of files (Python)

2009-06-10T16:08:13-07:00

Python recipe 576804 by Micah Elliott (age, files, find, queue).

Sometimes you need to perform an operation on the oldest of a set of files. Using get_oldest_file you could implement an age-based priority queue that processes files from oldest to newest. The list of files you pass in may be from a glob of a single directory or some more elaborate search routine.

Queue with tagged items (Python)

2009-01-28T07:23:40-08:00

Python recipe 576632 by Jirka Vejrazka (consumer, producer, queue, tag). Revision 2.

I needed multiple consumers to retrieve data from a queue fed by one producer. Could not find a good working code for that, so I implemented my own queue. Docstring should describe how this works.

Two notes: 1) my code uses multiprocessing code, but in this module, the Lock and Condition could be easily replaced with the same objects from the threading module 2) the attached test uses syntax for "nose" testing package, I did not convert it to doctest or UnitTest.