Popular recipes tagged "regex" but not "python"

Recursive find replace in files using regex (Python)

2016-04-28T13:24:15-07:00

Python recipe 580653 by ccpizza (files, regex, replace, search). Revision 5.

Recursively find and replace text in files under a specific folder with preview of changed data in dry-run mode

Example Usage

See what is going to change (dry run):

find_replace.py --dir project/myfolder --search-regex "\d{4}-\d{2}-\d{2}" --replace-regex "2012-12-12" --dryrun

Do actual replacement:

find_replace.py --dir project/myfolder --search-regex "\d{4}-\d{2}-\d{2}" --replace-regex "2012-12-12"

Do actual replacement and create backup files:

find_replace.py --dir project/myfolder --search-regex "\d{4}-\d{2}-\d{2}" --replace-regex "2012-12-12" --create-backup

Same action as previous command with short-hand syntax:

find_replace.py -d project/myfolder -s "\d{4}-\d{2}-\d{2}" -r "2012-12-12" -b

Output of find_replace.py -h:

DESCRIPTION:
    Find and replace recursively from the given folder using regular expressions

optional arguments:
  -h, --help            show this help message and exit
  --dir DIR, -d DIR     folder to search in; by default current folder
  --search-regex SEARCH_REGEX, -s SEARCH_REGEX
                        search regex
  --replace-regex REPLACE_REGEX, -r REPLACE_REGEX
                        replacement regex
  --glob GLOB, -g GLOB  glob pattern, i.e. *.html
  --dryrun, -dr         don't replace anything just show what is going to be
                        done
  --create-backup, -b   Create backup files

USAGE:
   find_replace.py -d [my_folder] -s <search_regex> -r <replace_regex> -g [glob_pattern]

Recapitalize word in the beginning of every sentence (Python)

2014-01-05T14:11:00-08:00

Python recipe 578796 by sky kok (regex). Revision 2.

Recapitalizes text, placing caps after end-of-sentence punctuation. Turning "hello world. how are you?" to "Hello world. How are you?"

Elementary regex without third party libraries (C++)

2013-07-13T12:58:14-07:00

C++ recipe 578602 by greg zakharov (regex, wininet).

This is a dirty trick how to access primitive regular expression on Windows.

slurp.py (Regex based simple parsing engine) (Python)

2013-05-26T18:00:58-07:00

Python recipe 578532 by Mike 'Fuzzy' Partin (parser, regex, text_processing).

A parsing engine that allows you to define sets of patterns and callbacks, and process any I/O object in Pyton that has a readline() method.

Cheap-date trick; a different way to parse (Python)

2012-03-06T14:08:10-08:00

Python recipe 578064 by Scott S-Allen (cheap, date, format, grep, parse, regex, sharp).

... a light meal with a heavy dose of "tutorial mash" on the side.

In the constructive spirit of "more ways to solve a problem"; this is a portion of my lateral, occasionally oblique, solutions. Nothing new in le régime de grande, but hopefully the conceptual essence will amuse.

Initially started as a response to recipe 577135 which parses incremental date fragments and preserves micro-seconds where available. That script does more work than this, for sure, but requires special flow-control and iterates a potentially incumbering shopping list (multi-dimensional with some detail).

So here's a different box for others to play with. Upside-down in a sense, it doesn't hunt for anything but a numerical "pulse"; sequences of digits punctuated by other 'stuff' we don't much care about.

Missing a lot of things, intentionally, this snippet provides several examples demoin' flexibility. Easy to button-up, redecorate and extend later for show, till then the delightful commentary makes it hard enough to see bones already -- all six lines or so!

Note: The core script is repeated for illustrative purposes. The first is step-by-step, the second is lean and condensed for utilitarian purposes. It is the second, shorter, version that I yanked from a file and gussied up.

lreplace() and rreplace(): Replace the beginning and ends of a strings (Python)

2010-06-04T02:18:48-07:00

Python recipe 577252 by Dan McDougall (regex, replace, string).

Python newbies will often make the following mistake (I certainly have =):

>>> test = """this is a test:
... tis the season for mistakes."""
>>> for line in test.split('\n'):
...     print line.lstrip('this')
... 
 is a test
 the season for mistakes.

The mistake is assuming that lstrip() (or rstrip()) strips a string (whole) when it actually strips all of the provided characters in the given string. Python actually comes with no function to strip a string from the left-hand or right-hand side of a string so I wrote this (very simple) recipe to solve that problem. Here's the usage:

>>> test = """this is a test:
... tis the season for mistakes."""
>>> for line in test.split('\n'):
...     print lreplace('this', '', line)
... 
 is a test
tis the season for mistakes.

I really wish Python had these functions built into the string object. I think it would be a useful addition to the standard library. It would also be nicer to type this:

line.lreplace('this', '')

Instead of this:

lreplace('this','',line)

Python Easily Packetize / Slice / Chunk Text (Python)

2011-09-30T05:34:57-07:00

Python recipe 577885 by __nero (chunk, packetize, regex, split, udp).

I needed to chunk up some text to send over UDP and didn't want to have messy for loops with an if condition for size and then the little bit left over. All that struck me as very messy. I then thought of the re module and came up with a very simple solution to chunk up data.

url_spider (Python)

2011-03-14T09:08:28-07:00

Python recipe 577608 by amir naghavi (database, regex, web). Revision 3.

a simple url spider that goes through web pages and collects urls.

tryout regex (Python)

2010-12-17T17:28:26-08:00

Python recipe 577503 by Lost Protocol (regex). Revision 2.

Teaches you regex in python by trying it out.

>>> only one command called compile allows you to compile a certain string
>>> any other input is treated as pattern to match

hexadecimal CSS colors, convert the six-digit to the three-digit notation (Bash)

2010-10-02T14:07:23-07:00

Bash recipe 577416 by Romain Dartigues (color, css, regex, rgb, sed, shortening).

Want to replace all six-digit RGB notation (#rrggbb) to the short (three-digit #rgb) form? Or the opposite?

Clean a .py file full of constant chr(x) calls (Python)

2010-04-02T08:20:50-07:00

Python recipe 577175 by Marcelo Fernández (chr, cleaner, cleaning, regex).

This script identifies every chr(xx) call in a script (being xx an integer) and replaces it with a constant byte string. For example: print chr(13) + chr(255) in the input .py file gets translated into '\n' + '\xff' on the output .py file, not breaking the input program, and maybe speeding it a little.

Python code minifier (Python)

2014-05-25T16:23:55-07:00

Python recipe 576704 by Dan McDougall (bz2, bzip2, comments, compression, docstring, embedded, gzip, minify, pack, regex, zlib). Revision 16.

Update 05/25/2014: Pyminifier 2.0 has been released and now lives on Github: https://github.com/liftoff/pyminifier (docs are here: http://liftoff.github.io/pyminifier/). The code below is very out-of-date but will be left alone for historical purposes.

Python Minifier: Reduces the size of Python code for use on embedded platforms. Performs the following:

Removes docstrings.
Removes comments.
Removes blank lines.
Minimizes code indentation.
Joins multiline pairs of parentheses, braces, and brackets (and removes extraneous whitespace within).
Preserves shebangs and encoding info (e.g. "# -- coding: utf-8 --")
NEW: Optionally, produces a bzip2 or gzip-compressed self-extracting python script containing the minified source for ultimate minification.

Update 09/23/2010: Version 1.4.1: Fixed an indentation bug when operators such as @ and open parens started a line.

Update 09/18/2010: Version 1.4:

Added some command line options to save the result to an output file.
Added the ability to save the result as a bzip2 or gzip-compressed self-extracting python script (which is kinda neat--try it!).
Updated some of the docstrings to provide more examples of what each function does.

Update 06/02/2010: Version 1.3: Rewrote several functions to use Python's built-in tokenizer module (which I just discovered despite being in Python since version 2.2). This negated the requirement for pyparsing and improved performance by an order of magnitude. It also fixed some pretty serious bugs with dedent() and reduce_operators().

PLEASE POST A COMMENT IF YOU ENCOUNTER A BUG!

Automagically dispatch commands using regex token classes (Python)

2009-09-28T03:46:29-07:00

Python recipe 576914 by Mick Krippendorf (command_dispatch_pattern, re, regex). Revision 2.

The (?P<...>...) notation in Python's regular expressions can be viewed as a classification of matched tokens. The names of these classes can be used to dispatch tokens to appropriate handlers:

Dict-like string formatting from an object by named atttributes (Python)

2009-08-17T12:59:16-07:00

Python recipe 576883 by Jacob Oscarson (regex, text).

Formats a string using the same notation as a dict-expansion, but using an object as the source for the expansion instead. Attributes from the object are used as source to the expansions.

extract table into 2-vector from html page (Python)

2008-09-03T22:22:42-07:00

Python recipe 576485 by devdoer (html, parse, regex).

extract table into 2-vector from html page

transform a text to another by regex (Python)

2008-09-02T20:30:53-07:00

Python recipe 576481 by devdoer (parse, regex).

transform a text to another by regex