Latest recipes tagged "http"

De-chunk and decompress HTTP body (Python)

2015-06-30T03:31:31-07:00

Python recipe 579075 by Vovan (chunked, content, dechunking, decompression, encoding, http, preprocess, transfer). Revision 2.

Example read_body_stream() usage:

with open(http_file_path, 'rb') as fh:
    print(b''.join(httputil.read_body_stream(
        fh, chunked=True, compression=httputil.GZIP))

Encode multipart form data for uploading files via POST (Python)

2013-09-22T21:27:24-07:00

Python recipe 578668 by Ben Hoyt (form, http, multipart, upload).

This function lets you encode form fields and files in multipart/form-data format for uploading files via HTTP POST.

Easy way to use Graph Facebook API without ad-hoc libraries (Ruby)

2012-11-20T14:14:27-08:00

Ruby recipe 578343 by Filippo Squillace (api, facebook, http, ruby).

I was painfully lokking for a simple function that allow easily make GET or POST requests in Ruby without using complex libraries such as Koala for accessing to the Facebook Graph. At the end I gave up and did it by myself, so the function fb_api, based on net/http, is able to make GET or POST requests (depending if the request is for retrieving information of the graph or is for changing the graph such as post feed etc.). It returns a dict from a JSON data structure.

This might be useful for your facebook app ;)

Basic interface to Apache Solr (Python)

2011-10-17T12:46:55-07:00

Python recipe 577909 by Graham Poulter (http, solr).

A basic model class representing Apache Solr. Abstracts the select, delete, update, and commit operations.

Select operation returns Python object parsed from a JSON-formatted response.

Securely processing Twilio requests from Tornado (Python)

2011-10-05T15:29:44-07:00

Python recipe 577893 by Jesse Davis (authentication, http, https, nginx, telephony, tornado, twilio).

Twilio is a telephony service that POSTs to a callback URL on your server and asks you what to do when it receives phone calls or SMSes to the numbers you rent from Twilio. But securing your communications with Twilio can be complex if you're using Tornado behind Nginx. This shows you how to protect your Twilio callback URL with HTTP Authentication, request-signing, and (optionally) SSL.

I'm using HTTP Authentication code from Kevin Kelley, and I wrote the rest myself.

Transparent HTTP Tunnel for Python sockets (to be used by ftplib ) (Python)

2011-11-07T10:25:56-08:00

Python recipe 577643 by Raphaël Jolivet (ftp, ftplib, http, over, proxy, python, socket, socks). Revision 4.

This script allows how to transparently install a HTTP proxy (proxy HTTP 1.1, using CONNECT command) on all outgoing sockets.

I did that to bring TCP over HTTP to FTPlib, transparently. It should enable HTTP tunneling for all methods / modules that use the low-level socket API.

Website Mapper (Python)

2010-09-23T01:23:04-07:00

Python recipe 577392 by FB36 (html, http, url, web). Revision 3.

Prints the tree graph of the given URL.

Random URL (Python)

2010-09-12T22:23:09-07:00

Python recipe 577389 by FB36 (html, http, url, urllib2, web).

Finds and displays a random webpage from the Internet. (Warning: It may take a while!)

Website Text Search (Python)

2010-09-11T17:32:01-07:00

Python recipe 577388 by FB36 (html, http, url, urllib2, web). Revision 2.

Searches a website recursively for the given text string and prints all URLs containing it.

Image Downloader (Python)

2014-02-24T03:49:51-08:00

Python recipe 577385 by FB36 (html, http, url, urllib2, web). Revision 4.

Finds and downloads all images from any given URL.

Important note:

If your download location path has spaces then put quotes around it!

Routines for programmatically authenticating with the Google Accounts system at Google App-Engine. (Python)

2010-05-20T20:39:50-07:00

Python recipe 577217 by Berend (auth, authentication, gae, google, http, sessions). Revision 2.

This takes two calls, one to the ClientLogin service of Google Accounts, and then a second to the login frontend of App Engine.

User credentials are provided to the first, which responds with a token. Passing that token to the _ah/login GAE endpoint then gives the cookie that can be used to make further authenticated requests.

Parse HTTP date-time string (Python)

2010-01-20T13:47:50-08:00

Python recipe 577015 by Sridhar Ratnakumar (datetime, http, parsing).

This recipe will help you parse datetime strings returned by HTTP servers following the RFC 2616 standard (which supports three datetime formats). Credit for this recipe goes to ΤΖΩΤΖΙΟΥ.

Serve static web content from within a gzipped tarball to save space using CherryPy (Python)

2009-03-31T18:24:06-07:00

Python recipe 576706 by Dan McDougall (cherrypy, compression, embedded, gzip, html, http, network, routes, web, web_server).

This code lets you store all of your static website content inside a gzipped tarball while transparently serving it to HTTP clients on-demand. Perfect for embedded systems where space is limited.

Python HTTP Pipelining (Python)

2009-02-27T16:21:23-08:00

Python recipe 576673 by Markus J (http, pipelining). Revision 5.

Gets several pages in parallel, without threads. It exploits HTTP pipelining by resetting the state of HTTPConnection to trick it into sending the next request ahead of time.

More information about HTTP pipelining can be found on Wikipedia: http://en.wikipedia.org/wiki/HTTP_pipelining

Very Simple HTTP Web Server (Python)

2010-05-12T11:20:07-07:00

Python recipe 576541 by TheMachineCharmer (http, server, web, web_server). Revision 2.

This is very very simple HTTP web server.

Python HTTP POST binary file upload with pycurl (Python)

2008-08-14T04:47:36-07:00

Python recipe 576422 by Robert Lujo (django, http, post, upload).

There is a way to upload file with standard python libraries (urllib, httplib, ...) as explained at http://code.activestate.com/recipes/146306/. But that didn't worked for me for binary data. I didn't liked/tried solution explained at http://fabien.seisen.org/python/urllib2_multipart.html, so I tried with pycurl (http://pycurl.sourceforge.net/ wrapper for http://curl.haxx.se/libcurl/) because it is std. lib for php, and uploading the file is very simple (just add @<path-to-file> to post variable value). It was a little hard to find proper way because there is no such example or documentation. But I found it, and it is so simple ;)

I supply django test application which receives file that is uploaded.