A few simple examples to help you understand the basics:
A few simple examples to help you understand the basics:
-`python3 Twint.py -u username` - Scrape all the Tweets from *user*'s timeline.
-`python3 Twint.py -u username` - Scrape all the Tweets from *user*'s timeline.
...
@@ -53,12 +53,10 @@ A few simple examples to help you understand the basics:
...
@@ -53,12 +53,10 @@ A few simple examples to help you understand the basics:
More detail about the commands and options are located in the [wiki](https://github.com/twintproject/twint/wiki/Commands)
More detail about the commands and options are located in the [wiki](https://github.com/twintproject/twint/wiki/Commands)
## Using Twint as a Module (Recommended)
## Module Example
To install Twint as module run `pip3 install --upgrade -e git+https://github.com/twintproject/twint.git@origin/master#egg=twint`
Twint can now be used as a module and supports custom formatting. **More details are located in the [wiki](https://github.com/twintproject/twint/wiki/Module)**
Twint can now be used as a module and supports custom formatting. **More details are located in the [wiki](https://github.com/twintproject/twint/wiki/Module)**
`955511208597184512 2018-01-22 18:43:19 GMT <now> pineapples are the best fruit`
`955511208597184512 2018-01-22 18:43:19 GMT <now> pineapples are the best fruit`
## Storing Options
## Storing Options
- Write to file.
- Write to file
- CSV
- CSV
- JSON
- JSON
- SQLite
- SQLite
- Mysql (DB collation utf8mb4)
- Elasticsearch
- Elasticsearch
### Elasticsearch Setup
## Elasticsearch Setup
Details on setting up Elasticsearch with Twint is located in the [wiki](https://github.com/twintproject/twint/wiki/Elasticsearch).
Details on setting up Elasticsearch with Twint is located in the [wiki](https://github.com/twintproject/twint/wiki/Elasticsearch).
### Graph Visualization
## Graph Visualization


[Graph](https://github.com/twintproject/twint/tree/master/graph) details are also located in the [wiki](https://github.com/twintproject/twint/wiki/Graph).
[Graph](https://github.com/twintproject/twint/tree/master/graph) details are also located in the [wiki](https://github.com/twintproject/twint/wiki/Graph).
...
@@ -99,6 +97,49 @@ We are developing a Twint Desktop App.
...
@@ -99,6 +97,49 @@ We are developing a Twint Desktop App.
> While scraping tweets and saving them to a database, I want also save users infos
> While scraping tweets and saving them to a database, I want also save users infos
Pass `--user-info` to CLI, or specify `c.User_info = True` if you are using Twint as module.
Pass `--user-info` to CLI, or specify `c.User_info = True` if you are using Twint as module.
> I tried scraping tweets from a user, I know
## More Examples
#### Followers/Following
> To get only follower usernames/following usernames
If you have any questions, want to join in on discussions, or need extra help, you are welcome to join our OSINT focused [Slack server](https://join.slack.com/t/os-int/shared_invite/enQtNDI1MDA2OTg4MDg0LWUxYWNmMjI2MGFlMTZjZjhmOWY1ZTVhNmFiMDU2NzY1MzhiMDI2ZTZmYmEwY2MxY2YzMGFkZTY2MTcxZWI2ODM).
If you have any questions, want to join in on discussions, or need extra help, you are welcome to join our OSINT focused [Slack server](https://join.slack.com/t/os-int/shared_invite/enQtNDI1MDA2OTg4MDg0LWUxYWNmMjI2MGFlMTZjZjhmOWY1ZTVhNmFiMDU2NzY1MzhiMDI2ZTZmYmEwY2MxY2YzMGFkZTY2MTcxZWI2ODM).