Popular recipes tagged "meta:loc=101"

Unix tee-like functionality via a Python class (Python)

2017-03-31T14:30:30-07:00

Python recipe 580767 by Vasudev Ram (cli, command, commandline, linux, python, tee, unix, utilities, windows).

The Unix tee commmand, when used in a command pipeline, allows you to capture the output of the preceding command to a file or files, while still sending it on to standard output (stdout) for further processing via other commands in a pipeline, or to print it, etc.

This recipe shows how to implement simple tee-like functionality via a Python class. I do not aim to exactly replicate the functionality of the Unix tee, only something similar.

More details and sample output here:

https://jugad2.blogspot.in/2017/03/a-python-class-like-unix-tee-command.html

Image Resizer (Python)

2016-05-22T16:45:52-07:00

Python recipe 580663 by FB36 (image, images, utilities, utility). Revision 2.

Image resizer/converter command-line utility.

Loading c extensions from a repository build area (Python)

2015-10-12T09:38:49-07:00

Python recipe 579109 by Robin Becker .

I test reportlab with multiple pythons. Rather than having to install into different virtualenvs I prefer to build my C-extensions in the repository using pythonxx setup.py build_ext and place the repository source folder onto the python path (using eg a link). However, this means I must load the extensions from somewhere other than their natural place. The BuiltExtensionFinder can be used for this.

Reading XML into dict-like object (Python)

2013-03-14T18:50:07-07:00

Python recipe 578492 by Lucas Oliveira (attributes, dict, xml). Revision 4.

Load XML, tree or root
Make its children available through __getitem__
Make its attributes available through __getattr__
If child is requested, return an instance created with child as new root
Make its text accessible through __getattr__, using attribute "text"

Ali (Java)

2013-02-17T12:54:44-08:00

Java recipe 578461 by Alireza Hosseini .

{{{ http://code.activestate.com/recipes/578439/ (r1)

Just a try using the thread modules.

import urllib as ul import bs4 as bs import urlparse as up import re as re import os.path as op import Queue as que import time import threading

pat = re.compile('.[\d]{4,7}.')

count=0

class dldfile(threading.Thread): def __init__(self,qu1): threading.Thread.__init__(self) self.qu1=qu1 self.ad='download/1/'

def run(self):
    try:
        url,filename=self.qu1.get()
        url =url+self.ad             #comment this line in case need to download whole web page instead of recipe ONLY...
        ul.urlretrieve(url,filename)
        global count
    except:
        print " RE-TRYING ",
        count= count - 1
        self.qu1.put((url,filename))
        self.run()
    finally:
        count= count +1
        print str(count)+"("+str( threading.activeCount())  +")",filename
        self.qu1.task_done()

class dload(threading.Thread ): def __init__(self,qu,url = "http://code.activestate.com/recipes/langs/python/?page=" ): threading.Thread.__init__(self) self.url= url self.q =que.Queue() self.qu=qu

def run(self):
    ind=self.qu.get()
    url=self.url+str(ind)
    soup =bs.BeautifulSoup(''.join( ul.urlopen(url).readlines() ))
    bu = up.urlsplit(self.url)
    print 'started with the ' ,str(url).split('/')[-1],
    for i in  soup.find_all(attrs = { "class" : "recipe-title"}):
        sp = up.urlsplit(i.a.get('href'))
        path = sp.path
        print path
        if re.search(pat, path):
            path = bu.scheme+'://'+bu.netloc+path
            filename = str(path).split('/')[-2]
            filename = op.join(op.abspath(op.curdir),filename+'.py') # recipe will be stored in given location

filename = op.join(op.abspath(op.curdir),filename+'.html')

uncomment the above line if downloading the web page for teh recipe

            print path
            self.q.put((path,filename))
    self.fetch_data()
    time.sleep(1)
    self.qu.task_done()
    self.q.join()
    print 'done with the ' ,str(url).split('/')[-1],

def fetch_data(self):
    Que1 = que.Queue()
    minitask =10
    while not self.q.empty():
        for i in range(minitask):
            x = dldfile(Que1)
            x.setDaemon(True)
            x.start()
        for j in range(minitask):
            Que1.put(self.q.get())
        Que1.join()
        del x

if __name__ =='__main__': task=5 Que = que.Queue() for k in range(1,190,task): # no. of pages included under the python tag. 188 is current count and 3700+ python recipes print "\n PAGE # : {0} \t \nDeploying Fresh threads\n".format(k) for i in range(task): t = dload(Que) t.start() for j in range(task): Que.put(k+j) Que.join() Que.queue.clear() del t print "DONE\n" time.sleep(2) del Que print "Our buisness finished"

end of http://code.activestate.com/recipes/578439/ }}}

Pipeline made of coroutines (Python)

2012-09-14T09:53:58-07:00

Python recipe 578265 by Chaobin Tang (唐超斌) (coroutine, pipelining, python). Revision 2.

A pipeline made of several coroutines that can be turned off gracefully.

How to debug (deadlocked) multi threaded programs (Python)

2010-07-26T15:39:15-07:00

Python recipe 577334 by Laszlo Nagy (dead, debug, lock, stack, thread, trace).

Simple module that allows you to explore deadlocks in multi threaded programs.

Queue for managing multiple SIGALRM alarms concurrently (Python)

2012-12-06T18:58:11-08:00

Python recipe 577600 by Glenn Eychaner (alarm, queue, signal). Revision 3.

In asynchronous code, signal.alarm() is extremely useful for setting and handling timeouts and other timed and periodic tasks. It has a major limitation, however, that only one alarm function and alarm time can be set at a time; setting a new alarm disables the previous alarm. This package uses a heapq to maintain a queue of alarm events, allowing multiple alarm functions and alarm times to be set concurrently.

Simple local cache and cache decorator (Python)

2010-12-08T09:06:34-08:00

Python recipe 577492 by Andrey Nikishaev (cache, decorator, memoization, python).

Simple local cache. It saves local data in singleton dictionary with convenient interface

Examples of use:

# Initialize
SimpleCache({'data':{'example':'example data'}})
# Getting instance
c = SimpleCache.getInstance()

c.set('re.reg_exp_compiled',re.compile(r'\W*'))
reg_exp = c.get('re.reg_exp_compiled',default=re.compile(r'\W*'))

# --------------------------------------------------------------

c = SimpleCache.getInstance()
reg_exp = c.getset('re.reg_exp_compiled',re.compile(r'\W*'))

# --------------------------------------------------------------    

@scache
def func1():
    return 'OK'

Type-Checking Function Overloading Decorator (Python)

2010-04-11T11:16:48-07:00

Python recipe 577065 by Ryan Lie (checkng, decorator, function, overloading, python, type). Revision 2.

The recipe presents a function overloading decorator in python that do type check. The type signature is marked with the @takes and @returns decorator, which causes the function to raise an InputParameterError exception if called with inappropriate arguments. The @overloaded function searches for the first overloads that doesn't raise TypeError or InputParameterError when called. Alternative overloads are added to the overloads list by using the @func.overload_with decorator. The order of function definition determines which function gets tried first and once it founds a compatible function, it skips the rest of the overloads list.

bier-soup.py, a small example of BeautifulSoup (Python)

2009-07-24T05:59:43-07:00

Python recipe 576841 by denis (beautifulsoup, bier). Revision 3.

bier-soup.py reads html tables like those in http://www.bier1.de and writes plain text files, as a small example of BeautifulSoup

Polynomial explorer (Python)

2008-09-11T07:21:11-07:00

Python recipe 576501 by Kaushik Ghose (interactive_graphs, matplotlib). Revision 2.

Polynomial explorer. You tell this module what order of polynomial you want and it will set up a figure with a graph of that polynomial plotted with x = -1 to +1. It will set up a second figure with a set of coefficient axes. You can click on the coeffiecient axes to set the coefficents. The graph will then update to reflect the values of the new coefficients.

This code illustrates the use of mouse interaction using matplotlib

Transactional Set Updates (Python)

2007-04-28T03:12:59-07:00

Python recipe 511496 by Raymond Hettinger (algorithms). Revision 2.

Tracks the additions and deletions to a set during update operations. Useful for large sets with few modifications.

A basic time profiler (Python)

2006-08-03T20:39:37-07:00

Python recipe 496938 by Anand (shortcuts).

This recipe provides a very simple time profiling module which helps you to measure actual execution time for blocks of Python code without peppering your code with many time.time() statements.

IPv6 Multicast (Python)

2005-10-28T11:43:52-07:00

Python recipe 442490 by Shane Holloway (network).

IPv6 can be tricky in many ways, and multicast makes it even more fun. This recipe is intended to give you a working implementation to start from.

Dupinator -- detect and delete duplicate files (Python)

2005-01-09T12:31:21-08:00

Python recipe 362459 by Bill Bumgarner (files).

Point this script at a folder or several folders and it will find and delete all duplicate files within the folders, leaving behind the first file found of any set of duplicates. It is designed to handle hundreds of thousands of files of any size at a time and to do so quickly. It was written to eliminate duplicates across several photo libraries that had been shared between users. As the script was a one-off to solve a very particular problem, there are no options nor is it refactoring into any kind of modules or reusable functions.

Decimal & Hex conversion routines (Tcl)

2005-06-03T11:28:27-07:00

Tcl recipe 415982 by Chris Cornish .

Here are a suite of hexadecimal to/from decimal conversion routines. These have been used in an application, so there should not be any errors, I trust.

Implementing "Future"s with decorators (Python)

2004-12-30T05:26:18-08:00

Python recipe 355651 by Justin Shaw (algorithms). Revision 5.

How to kick off a slow process without waiting around for the result. The process is run in the background until the value is actually needed at which time it blocks until the value is ready.

Some python style switches (Python)

2004-05-11T21:38:56-07:00

Python recipe 269708 by Runsun Pan (shortcuts). Revision 6.

Python style switches. Showing several ways of making a 'switch' in python.

xmlgettext.py (Python)

2003-07-28T12:29:21-07:00

Python recipe 212728 by Fritz Cizmarov (xml).

extract the texts from an XML-file and write it into an *.pot