Popular Python recipes tagged "meta:requires=threading"

Tail multiple pidgin IRC logfiles (Python)

2015-06-06T12:13:00-07:00

Python recipe 579066 by Anton Vredegoor (colorize, irc, iterators, logfiles, merging, nonblocking, pidgin, tail, threads). Revision 2.

Tail multiple pidgin IRC logfiles.

Pidgin should be connected to IRC with the channels one wants to tail joined, and it should save logs as text.

The script needs two arguments:

the directory containing the directories with channel logs

a list of channel names, quoted and separated by spaces

Example command:

python pidgin-irctail.py -d ~/.purple/logs/irc/YOUR_IRC_HANDLE@irc.freenode.net -c "#chan1 #chan2 #chan3"

Some text elements are higlighted, and channel names are inserted into the log lines after the time info.

If more than one channel is entered, the output of the logs is merged.

Analog Clock (Python)

2014-05-14T20:53:39-07:00

Python recipe 578875 by Paulo Cavalcanti (clock). Revision 3.

A python-tkinter analog clock

Py2.6+ and Py3.0+ backport of Python 3.3's LRU Cache (Python)

2013-03-06T05:38:15-08:00

Python recipe 578078 by Raymond Hettinger (cache, lru). Revision 6.

Full-featured O(1) LRU cache backported from Python3.3. The full Py3.3 API is supported (thread safety, maxsize, keyword args, type checking, __wrapped__, and cache_info). Includes Py3.3 optimizations for better memory utilization, fewer dependencies, and fewer dict lookups.

Pyqt / Pyside: thread-safe callbacks + main loop integration (Python)

2013-10-12T08:43:09-07:00

Python recipe 578634 by Justin Israel (events, pyqt, pyside, python, thread). Revision 4.

A mechanism for communication from any thread to the main thread.

It uses the same custom Event, but adds a classmethod convenience for taking a callback and params, wrapping it into an event and posting it to the receiver. Also adds in support for weak method references to the callback, in case the source object gets deleted before its callback is actually called.

Merges forks of both: http://code.activestate.com/recipes/81253/#c5 http://code.activestate.com/recipes/578299-pyqt-pyside-thread-safe-global-queue-main-loop-int/

Python 3 Token Bucket (Rate Limit) (Python)

2013-09-16T23:41:46-07:00

Python recipe 578659 by Esteban Castro Borsani (bucket, limit, rate, ratelimit, token, tokenbucket).

A thread safe implementation.

Primitive Peer to Peer Chat (Python)

2013-07-07T02:09:57-07:00

Python recipe 578591 by teddy_k (chat, peer, select, socket, threading).

This took me longer than it should have. I am putting it here in the hopes that this post will spare others from having to Google things for extended periods of time.

In short, you either listen for a connection (Chat_Server), or connect to a remote IP address (Chat_Client). From there, you can send text strings back and forth.

This is a bit rough-hewn, obviously; I apologize in advance.

Generator with lookahead (Python)

2013-09-24T10:44:56-07:00

Python recipe 578671 by Rutger Saalmink (background, generator, generators, lookahead, performance, python).

Python generators are a great way of reducing memory usage due to the lazy (on demand) generation of values. However, when the process-time of generating such a value is relatively high, we can improve performance even more by obtaining the next n values of the generator in a separate thread in the background. Hence, the BackgroundGenerator.

Threaded communication with subprocess (Python)

2013-03-13T06:06:16-07:00

Python recipe 578488 by Jan Müller (async, ipc, messaging, multithreading, pipe, queue, subprocess). Revision 3.

This recipe shows how to domesticate another executable as a service in a subprocess.

download the Activestate cook book recipe (Python)

2013-01-29T16:24:22-08:00

Python recipe 578439 by lwz7512 .

Small effort to store the python recipes to our local

similar effort by other people: 543267-i-will-download-all-of-the-recipes-from-the-python 535162-i-download-all-the-python-cookbook-recipes

Simple python thread manager (Python)

2012-12-17T16:19:12-08:00

Python recipe 578385 by Tom Wissing (manager, python, threading, threads).

A simple python static class handling basic threading. Designed for "worker" threads that loop forever over a function and the like.

Python: A event/signal dispatcher (Python)

2013-07-29T05:34:24-07:00

Python recipe 578307 by Esteban Castro Borsani (dispatcher, events, oop, python, signals).

This is a thread-safe dispatcher.

Simple python thread manager (Python)

2012-11-17T23:18:17-08:00

Python recipe 578331 by Tino Deak (manager, python, threading, threads).

A simple python static class handling basic threading. Designed for "worker" threads that loop forever over a function and the like.

DoubleDict (Python)

2012-07-24T21:24:14-07:00

Python recipe 578224 by Stephen Chappell (class, dictionary).

After seeing requests for being able to access keys in a dictionary by value, the following recipe was born. It creates the DoubleDict class and allows just that. To ensure that only one key is returned when accessing it by value, values must be unique just as keys are unique, and this rule is automatically enforced. Most dictionary methods are supported, and many more are added to allow working with the dictionary from the view of the values instead of the keys. Several optional metaclasses are also provided to enable optional features in the DoubleDict class such as data consistency checks and atomic method execution.

Distributed lock manager for Python (Python)

2012-07-04T21:03:32-07:00

Python recipe 578194 by pavel (distributed, lock, locking, locks, manager, socket, thread, threading, wsgi). Revision 2.

Distributed lock manager provides mutex(es) over network. It is used to synchronize processes running on different machines, e.g. WSGI processes in case of web applications. Lock object is compatible with threading.Lock and can be used as a context manager ("with statement"). It can be easily modified to use UNIX sockets instead of TCP/IP. Communication protocol is text based.

First start server process:

$ chmod +x dlm.py
$ ./dlm.py

Usage:

from dlm import LockClient

client = LockClient('localhost', 27272, 'client_name')

lock = client.mkLock('lock_name')

lock.acquire()
# critical section here...
lock.release()

# using context manager
with lock:
    # critical section here...

download the Activestate cook book recipe (Python)

2012-07-04T12:14:22-07:00

Python recipe 578193 by Sudeep AM . Revision 2.

Small effort to store the python recipes to our local

similar effort by other people: 543267-i-will-download-all-of-the-recipes-from-the-python 535162-i-download-all-the-python-cookbook-recipes

Reader-Writer lock with priority for writers (Python)

2011-09-28T21:45:04-07:00

Python recipe 577803 by Mateusz Kobos (locking, threads). Revision 2.

The following class implements a reader-writer lock to use in the second readers-writers problem with python threads. In this problem, many readers can simultaneously access a share, and a writer has an exclusive access to this share. Additionally, the following constraints should be met: 1) no reader should be kept waiting if the share is currently opened for reading unless a writer is also waiting for the share, 2) no writer should be kept waiting for the share longer than absolutely necessary.

Observer pattern implemented with Descriptor class (Python)

2012-02-14T23:43:53-08:00

Python recipe 578038 by Rodney Drenth (descriptor, observer, publish, reactive, subscribe).

The observer pattern is implemented using an observable descriptor. One creates instances of observable in a class, which allows observers to subscribe to changes in the observable. Assigning a value to the observable causes the suscribers to be notified. An observable can subscribe to another observable, in which case changes to the second propagate to subscribers of the first. The subscribe method returns a Subscription object. When this object is deleted or becomes unreferenced, the subscription is cancelled.

This version compatible with Python 3.0 Example uses unittest to help in understanding the functionality.

Caching decorator with timeout, selective invalidation (Python)

2005-11-05T05:47:03-08:00

Python recipe 442513 by Greg Steffensen (algorithms). Revision 5.

A caching decorator that garbage collects in a separate thread (for performance), allows each cached function to (optionally) set a custom maximum age for entries, and allows individual cache entries to be selectively invalidated.

Run async code inline, nonblocking (Python)

2011-11-23T10:13:31-08:00

Python recipe 577959 by PRITAM K (asynchronous, closure, decorator, generator, threads).

A decorator, that makes it easy to switch between the mainthread and background threads.

actorish decorator for making async code look more like sync one and a less blocking (Python)

2011-10-30T19:59:44-07:00

Python recipe 577931 by Przemyslaw Podczasi (actor, threading).

I like how gevent is making async code to look like sync but non blocking without all the ugly callbacks. I tried doing that with threads and object proxy (I found great one at: http://pypi.python.org/pypi/ProxyTypes written by Phillip J. Eby, and this is where the actual magic happens).

For every function that is decorated it returns a proxy and the io call (or anything else) won't block until the value is actually needed. (should be some pools and args pickling there, to make it more like message passing but I didn't want to fuzzy the example) To use it as actor model, I guess it would require to queue requests to decorated object's methods and create a single thread to process them an in LazyProxy callback set q.get() instead of t.join()