Tweep is an advanced Twitter scraping tool written in python that allows for scraping Tweets and pictures from Twitter profiles **without** using Twitter's API.
Tweep is an advanced Twitter scraping tool written in python that allows for scraping Tweets from Twitter profiles **without** using Twitter's API.
## Benefits
Some of the benefits of using Tweep vs Twitter API:
...
...
@@ -11,15 +11,13 @@ Some of the benefits of using Tweep vs Twitter API:
- Can fetch __all__ Tweets (Twitter API limits to last 3200 Tweets)
## Requirements
- BeautifulSoup4 `pip install beautifulsoup4`
- Image `pip install image`
- Requests `pip install requests`
`pip3 install -r requirements.txt`
## Usage
-`-u` The user's Tweets you want to scrape.
-`-s` Search for Tweets containing this word or phrase.
-`--year` Filter tweets before the specified year.
-`--pics` Download all the pictures from Tweets.
-`-o` Save output to a file.
-`--year` Filter Tweets before the specified year.
-`--fruit` Display Tweets with "low-hanging-fruit".
-`--tweets` Display Tweets only.
-`--verified` Display Tweets only from verified users (Use with `-s`).
...
...
@@ -39,9 +37,24 @@ A few simple examples to help you understand the basics:
-`python tweep.py -u username -s pineapple` - Scrape all Tweets from the *user*'s timeline containing _pineapple_.
-`python tweep.py -s pineapple` - Collect every Tweet containing *pineapple* from everyone's Tweets.
-`python tweep.py -u username --year 2014` - Collect Tweets that were tweeted **before** 2014.
-`python tweep.py -u username --pics` - Download all pictures from *user*'s timeline.
-`python tweep.py -u username -o file.txt` - Scrape Tweets and save to file.txt.
-`python tweep.py -u username --fruit` - Show Tweets with low-hanging fruit.
-`python tweep.py -s "Donald Trump" --verified --users` - List verified users that Tweet about Donald Trump.
## Example String
`881653591265746945 2017-07-02 23:19:31 UTC <dqt> i need to drink more water`
`955511208597184512 2018-01-22 18:43:19 GMT <now> pineapples are the best fruit`
## Screenshot
<imgsrc="https://i.imgur.com/RKdBrHr.png"/>
## Changelog
### 1/21/18
- Added:
-`Python3` update and rewriten using asyncio. Fetching Tweets should be a lot more faster naturally.
-`Output` can be saved.
-`Replies` are now visible in the scrapes.
- Removed:
-`Pics` feature, I'll re-add this on a later date.
## Contact
Shout me out on Twitter: [@now](https://twitter.com/now)