A quick script that lets you download all of your tweets and write them to a text file.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 | #!/usr/bin/python
import time
from urllib2 import urlopen
from BeautifulSoup import BeautifulSoup
# Replace USERNAME with your twitter username
url = u'http://twitter.com/USERNAME?page=%s'
tweets_file = open('tweets', 'w')
for x in range(10*10000):
f = urlopen(url % x)
soup = BeautifulSoup(f.read())
f.close()
tweets = soup.findAll('span', {'class': 'entry-content'})
if len(tweets) == 0:
break
[tweets_file.write(x.renderContents() + '\n') for x in tweets]
# being nice to twitter's servers
time.sleep(5)
tweets_file.close()
|
Loops through all of your public timeline pages, grabs the individual tweets, and throws them into a text file.
Cool! I'm gonna keep that in my library for when I just have BSD or a console-only system. This is great.
ImportError: No module named BeautifulSoup
I've never worked with BeautifulSoup before. I googled their site and downloaded the zip they have, but I don't know what I should be doing with it to be able to make this work.
Alex: You should be able to install it with easy_install or pip. BeautifulSoup is in the cheese shop.
Alex, you can also install it using PyPM that comes with ActivePython.
Hi guys I am new to python. How can I use this code to extract tweets. I copied the codes in python but recieved no result even no error message.
Hello! I dont understand limit to for "(10*10000)", you can explain me? Thanks!