Validate data easily with JSON Schema (Python)

2015-12-06T21:23:48-08:00

Python recipe 579135 by Vasudev Ram (data, json, jsonschema, python, python2).

This recipe shows how to use the jsonschema Python library, which implements the JSON Schema specification, to easily validate your Python data. It sends good output to stdout and bad output to stderr, for demo purposes.

jsonschema Python library: https://pypi.python.org/pypi/jsonschema

JSON Schema: http://json-schema.org/

Populate SQL tables from CSV data files (Python)

2011-02-02T21:21:49-08:00

Python recipe 577559 by James Mills (conversion, csv, data, python, sql).

Just a quick recipe I developed a few years ago that I thought might be useful to others. Basically it takes as input a data file with comma separated values (CSV) and translates this into a series of SQL "INSERT" statements allowing you to then feed this into MySQL, SQLite, or any other database.

Example Usage:

$ cat cars.csv Year,Make,Model,Length 1997,Ford,E350,2.34 2000,Mercury,Cougar,2.38

$ sqlite3 cars.db "CREATE TABLE cars (Year, Make, Model, Length)"

$ ./csv2sql.py cars.csv | sqlite3 cars.db

$ sqlite3 cars.db "SELECT * FROM cars" 1997|Ford|E350|2.34 2000|Mercury|Cougar|2.38

Enjoy! Feedback welcome!

cheers James Mills / prologic

2-3 Tree (Python)

2011-10-08T21:46:03-07:00

Python recipe 577898 by Boris (2_3tree, algorithms, data, python, structure, tree).

My implementation of 2-3 Trees on python

Read CSV with D and write it to PDF with Python (Python)

2016-10-26T17:49:00-07:00

Python recipe 580710 by Vasudev Ram (conversion, csv, data, files, formats, pdf, pdf_generation, xtopdf).

This recipe shows how to read data from a CSV file with a D program and write that data to a PDF file with a Python program - all in a single command-line invocation (after writing the individual programs, of course).

It requires the xtopdf toolkit, which you can get from:

https://bitbucket.org/vasudevram/xtopdf

Instructions for installing xtopdf:

http://jugad2.blogspot.in/2012/07/guide-to-installing-and-using-xtopdf.html

xtopdf in turn requires the open source version of the ReportLab toolkit, which you can get from:

http://www.reportlab.com/ftp (http://www.reportlab.com/ftp/reportlab-1.21.1.tar.gz)

It also requires the DMD compiler to compile the D program - this was the version used:

DMD32 D Compiler v2.071.2

Use PrettyTable and xtopdf to create PDF tables with borders, alignment and padding (Python)

2015-01-24T21:21:27-08:00

Python recipe 579012 by Vasudev Ram (data, pdf, prettytable, string, tabular, xtopdf).

This recipe shows how to create tabular data in PDF format, supporting neat borders, and alignment and padding of columns, using the Python libraries called PrettyTable and xtopdf.

Filtering CSV data by fields (cut for csv) (Python)

2011-02-02T21:39:45-08:00

Python recipe 577560 by James Mills (csv, cut, data, filter, python).

Ever wanted to take a CSV file as input, cut it up and only extract the fields that you want ?

Here's how!

$ cat cars.csv Year,Make,Model,Length 1997,Ford,E350,2.34 2000,Mercury,Cougar,2.38

$ csvcut.py -f 0 -f -1 - < cars.csv Year,Length 1997,2.34 2000,2.38

--JamesMills (prologic)

Finding the sizes of various Python data types (Python)

2016-04-28T18:28:59-07:00

Python recipe 580655 by Vasudev Ram (data, datastructures, memory, python, python2, system, type).

This recipe shows how to find the sizes of various common data types in Python, both built-in and user-defined. It uses the sys.getsizeof() function and also discusses a few other points of interest.

Creating fake data using numpy (Python)

2009-08-07T09:22:34-07:00

Python recipe 576870 by tat.wright (data, fake, gaussian, graph, histogram, normal, sample_data).

Create a deliberately bad normal distribution for sample data - varying the badness, mean, standard deviation and range of results shown.

[xtopdf] Publish Delimiter-Separated Values (DSV data) to PDF (Python)

2016-12-17T19:08:33-08:00

Python recipe 580736 by Vasudev Ram (commandline, csv, data, files, formats, pdf, pdf_generation, python, tsv, utilities, xtopdf).

This recipe shows how to publish delimiter-separated values (a commonly used tabular data format) to PDF, using the xtopdf toolkit for PDF creation. It lets the user specify the delimiter via one of two command-line options - an ASCII code or an ASCII character. As Unix filters tend to do, it can operate either on standard input or on input filenames given as command-line arguments. In the case of multiple inputs via files, each input goes to a separate PDF output file.

Process Delimiter-Separated Values data with Python (Python)

2016-11-24T23:57:35-08:00

Python recipe 580722 by Vasudev Ram (command, commandline, data, dsv, file, python, utilities, utility).

This recipe shows how to read and process delimiter-separated values (DSV) data with a Python command-line program. It provides two ways of specifying the delimiter character, by an ASCII character or an ASCII code, which makes it more flexible than allowing only a character. It allows the DSV data to be specified as one or more filenames on the command line, or given via the standard input of the program.

data_dump.py, like the Unix od (octal dump) command (Python)

2015-11-01T12:43:38-08:00

Python recipe 579120 by Vasudev Ram (data, dump, hexadecimal, linux, octal, od, representation, unix, utility, windows).

This recipe implements a simple data dump tool, roughly like the od command of Unix, which stands for octal dump (though od can also dump data in hex and other formats). This tool dumps data in character and hex formats, in this version. This is data_dump.py version 1.

Retrieving the median of a set in constant time (Python)

2011-04-19T15:00:57-07:00

Python recipe 577661 by jimmy2times (data, heap, median, python, retrieving, structure). Revision 2.

Provides a data structure for a queue of integers whose get() method returns the median element. The interface is similar to the standard Queue module, with an added method top() to retrieve the median without removing it.

Data (A Class For Arbitrary Data) (Python)

2015-08-03T15:22:40-07:00

Python recipe 579092 by Alfe (class, data, lightweight).

A class which is designed to be easy to use when one needs a piece of data with a minimum of source required.

Usage:

shop = Data(owner="Homer", address="down the street", ice=Data(flavor="vanilla", amount=3))
print shop
Data:
  owner = 'Homer'
  ice = Data:
          amount = 3
          flavor = 'vanilla'
  address = 'down the street'

Kids Level Analogue Data Logger, (Transient Recorder), Program. (Python)

2011-07-31T16:14:48-07:00

Python recipe 577796 by Barry Walker (amiga, analogue, anim, apple, arduino, data, demo, display, e_uae, linux, logger, macbook_pro, program, windows, winuae). Revision 2.

This code is kids level Analogue Data-Logger(/Transient-Recorder), using the Arduino series of dev' boards.

It is no where near completion and is a second feeder/feeler upload only.

It is designed to work from Classic Text Mode Python from Versions 1.4.0 to 2.7.2 on a Classic AMIGA, WinUAE, Linux and Windows, (32 bit), to Vista. Not tested on Python for Windows 7, (32 bit), nor Mac OSX flavours as I don't have these OSes.

Linux versions run from a default root terminal for the time being.

The Arduino dev' board IS catered for in the code for the above platforms just thoroughly read the code for more information. It defaults to a DEMO mode so you can see it working...

The test code for the Arduino Diecimila Dev Board is here:-

http://code.activestate.com/recipes/577625-arduino-diecimila-board-access-inside-winuae-demo/

Enjoy finding simple solutions to often very difficult problems... ;o)

Bazza, G0LCU...

RFC 822-style parser (Python)

2010-01-09T22:46:42-08:00

Python recipe 576996 by Karl Dickman (data, formats). Revision 7.

In The Art of Unix Programming, Eric S. Raymond describes a data file metaformat based on RFC 822. [http://www.faqs.org/docs/artu/ch05s02.html#id2902039] This is a simple parser for that format.

Extract data from feedjit (Python)

2011-05-03T19:50:27-07:00

Python recipe 577683 by jrovegno (data, feedjit). Revision 2.

Script to extract data from my live traffic feed from feedjit

Representing a set in a compact way (Python)

2011-04-24T10:55:45-07:00

Python recipe 577660 by jimmy2times (compact, compressed, data, python, set, structure). Revision 5.

Implements a data structure for sets of natural numbers, represented by a single integer. The interface is similar to the built-in structure 'set'.

Most viewed recipes tagged "data"