Popular recipes tagged "url"

Python Short URL Generator (Python)

2014-11-09T11:19:07-08:00

Python recipe 578961 by Des Wagner (deterministic, generator, short, tiny, unique, url).

Python implementation for generating Tiny URL- and bit.ly-like URLs.

Python script to find linux distros details from distrowatch (Python)

2015-07-29T18:24:23-07:00

Python recipe 579038 by Emil george james (beautifulsoup, internet, module, python, url, web).

this script is a simlpe python script to find linux distros details from distrowatch using beautifulsoup,urllib2 modules.The script finds distros distribution details from distrowatch.com when the distribution name is called as argument.

Python Short URL Generator (Python)

2011-09-19T14:06:36-07:00

Python recipe 576918 by Michael Fogleman (deterministic, generator, short, tiny, unique, url). Revision 3.

Python implementation for generating Tiny URL- and bit.ly-like URLs.

slugify: make a string usable in a URL or filename (JavaScript)

2011-07-12T17:46:49-07:00

JavaScript recipe 577787 by Trent Mick (filename, nodejs, slug, slugify, url). Revision 2.

"Slugify" a string so it has only alphanumeric and hyphen characters. Useful for URLs and filenames. This is a JavaScript (node.js too) version of Recipe 577257.

Note: It is missing the guarantee that only ascii characters are passed through. I don't know an NFKD equivalent in JavaScript-land.

Perl URL encode and decode (Perl)

2010-11-02T17:52:46-07:00

Perl recipe 577450 by Trent Mick (decode, encode, url).

URL encode and decode functions for Perl.

Random URL (Python)

2010-09-12T22:23:09-07:00

Python recipe 577389 by FB36 (html, http, url, urllib2, web).

Finds and displays a random webpage from the Internet. (Warning: It may take a while!)

Website Text Search (Python)

2010-09-11T17:32:01-07:00

Python recipe 577388 by FB36 (html, http, url, urllib2, web). Revision 2.

Searches a website recursively for the given text string and prints all URLs containing it.

Image Downloader (Python)

2014-02-24T03:49:51-08:00

Python recipe 577385 by FB36 (html, http, url, urllib2, web). Revision 4.

Finds and downloads all images from any given URL.

Important note:

If your download location path has spaces then put quotes around it!

Website Mapper (Python)

2010-09-23T01:23:04-07:00

Python recipe 577392 by FB36 (html, http, url, web). Revision 3.

Prints the tree graph of the given URL.

slugify: make a string usable in a URL or filename (Python)

2010-06-07T04:11:55-07:00

Python recipe 577257 by Trent Mick (ascii, django, filename, slug, slugify, url). Revision 2.

"Slugify" a string so it is ascii, has only alphanumeric and hyphen characters. Useful for URLs and filenames. This is heavily based on the slugify in Django.

Note: presumes that you've import red higher up in your module.

Object id mask, against data spiders (Python)

2010-08-16T07:18:43-07:00

Python recipe 577359 by Chaobin Tang (唐超斌) (encryption, url). Revision 4.

A funny, simple, and efficient encrypt for an object ID. Always used against an unsolicited automated spider that scrawls your site to collect data.

ur1.ca command-line client (Python)

2011-03-23T05:27:27-07:00

Python recipe 577236 by Cong (scraping, shortening, url, web). Revision 2.

(ur1.ca)[http://ur1.ca/] is the URL shortening services provided by status.net. This script makes it possible to access the service from the command line. This is done by scraping the returned page and look for the shortened URL.

Random URL (JavaScript)

2010-03-25T16:07:54-07:00

JavaScript recipe 577143 by FB36 (random, url).

Save this code as randomURL.html. Everytime you open the file w/ a browser it will try to visit a random Internet page. Unfortunately most random trials does not take you a browser renderable webpage. I am open to ideas on how to make certain it finds a good webpage everytime.

Method-based URL dispatcher for the Tornado web server (Python)

2009-11-20T11:51:47-08:00

Python recipe 576958 by Dan McDougall (dispatcher, shortcuts, subclass, tornado, url, web). Revision 5.

The MethodDispatcher is a subclass of tornado.web.RequestHandler that will use the methods contained in subclasses of MethodDispatcher to handle requests. In other words, instead of having to make a new RequestHandler class for every URL in your application you can subclass MethodDispatcher and use the methods contained therein as your URLs.

The MethodDispatcher also adds the convenience of automatically passing arguments to your class methods. So there is no need to use Tornado's get_argument() method.

Example

To demonstrate the advantages of using MethodDispatcher I'll present a standard Tornado app with multiple URLs and re-write it using MethodDispatcher...

The standard Tornado way

class Foo(tornado.web.RequestHandler):
    def get(self):
        self.write('foo')

class Bar(tornado.web.RequestHandler):
    def get(self):
        self.write('bar')

class SimonSays(tornado.web.RequestHandler):
    def get(self):
        say = self.get_argument("say")
        self.write('Simon says, %s' % `say`)

application = tornado.web.Application([
    (r"/foo", Foo),
    (r"/bar", Bar),
    (r"/simonsays", SimonSays),
])

The MethodDispatcher way

class FooBar(MethodDispatcher):
    def foo(self):
        self.write("foo")

    def bar(self):
        self.write("bar")

    def simonsays(self, say):
        self.write("Simon Says, %s" % `say`)

application = tornado.web.Application([
    (r"/.*", FooBar)
])

Notes

As you can see from the above example, using the MethodDispatcher can significantly reduce the complexity of Tornado applications. Here's some other things to keep in mind when using the MethodDispatcher:

MethodDispatcher will ignore any methods that begin with an underscore (_). This prevents builtins and private methods from being exposed to the web.
The '/' path is special: It always maps to self.index().
MethodDispatcher does not require that your methods distinquish between GET and POST requests. Whether a GET or POST is performed the matching method will be called with any passed arguments or POSTed data. Because of the way this works you should not use get() and post() in your MethodDispatcher subclasses unless you want to override this functionality.
When an argument is passed with a single value (/simonsays?say=hello) the value passed to the argument will be de-listed. In other words, it will be passed to your method like so: {'say': 'hello'}. This overrides the default Tornado behavior which would return the value as a list: {'say': ['hello']}. If more than one value is passed MethodDispatcher will use the default behavior.

download a URL with a console progress meter (Python)

2008-10-08T05:05:12-07:00

Python recipe 576530 by Trent Mick (commandline, download, url).

A little script/function to download a given URL with a console progress meter. Usage:

python geturl.py http://example.com/downloads/bigfile.zip

(This is from an old post to python-list.)

Creating beautiful urls from user generated text (Python)

2008-09-21T07:22:06-07:00

Python recipe 576511 by Mark Zitnik (beautiful, url, web). Revision 3.

Most of the web sites that work with user generated content use the text that was entered by the user as the url for this specific item and usually the user enter charates like ' '(space) '&', '.' and some other char that you want to remove or convert to _ , _and_ , _dot_. So i have wrote a dynamic code that you can setup what chars you what to change.