- 25 Oct, 2018 2 commits
-
-
Francesco Poldi authored
* Update index-tweets.json * Update index-user.json * Update get.py * Update output.py * Update run.py * Update tweet.py * Update user.py * Update db.py * Update elasticsearch.py * Update _count variable * Update elasticsearch.py * Set to update (#246) * Added option for custom type * Create automate.py * Finished dataframes storing option (#224) * Update (#174) * add function to clean accumulated pandas storage data * Fixed typo, dataname, removed attributes * Added config options and config var * Added autoclean Works for search now * Added Elasticsearch count options * Added silent output and objects for users and followers * Update * Clean following/followers attr * Final construct of object * Redesign * Little fix * Debug * Debug * Globals * Removed debug * Globals pt 2 * Mix * Added _old_obj to store previous scrape * Prefix * Pre fix pt 2 * commented * Fix for object follow * Update * Update * Completed follow_object * Pandas object for followers and following * Finished pandas object for followers and following * Added docstrings in Twint.py * Added lowercase #170 * Finished lower case Close #170 * Fix defaults * Added some edits In `panda.py` changing the structure of the dataframe for users that one is following/followed, in `config.py` added autoupdate so that one does not have to call `storage.panda.get()` at every run, in `output.py` edited follow_object, in `run.py` added autoupdate function for panda, in`tweet.py` just some docstrings * Update for panda and objects * Finished storing data into dataframes #173 Now followers, following, tweets, and user details are saved in dataframes * Added proxy support (#225) * Added proxy #139 * Added new requirement, fixed proxy, added proxy config * Changed index names, removed duplicate arg * Updated default CLI args * Added visualizations and dashboard * Typo fix * Added loggin options, fixes retweets * Update README.md Added examples and how-to * Updated index and fixes * Update * Update dashboards * Update * Update index-tweets, fixed visualizations and new dashboard * Update doc * Fixed errors with user_full * Fixed quite hidden issue * Added print error * Added other print error * Update * #173 * Fix non-latin chars #229 * Added auto-index-creation Making Elasticsearch setup easier * Revert "Set to update (#246)" (#247) This reverts commit 69cbcf58f5cd36a84003c792315e9455bed55a2b. * Update output.py * Update output.py * Elasticsearch update * Added user_info option * Removed ES count * Get userinfo of username passed
-
Maxim Gubin authored
* New twitter scheme * Fix minor mistake * Fix location issue
-
- 23 Oct, 2018 1 commit
-
-
Maxim Gubin authored
* Fix Tor proxy not being able to connect * Fix request calls * Fix proxy args
-
- 22 Oct, 2018 3 commits
-
-
Francesco Poldi authored
This reverts commit 4c27b2b82cb84e7b8d5fac206b0b8502a5faba4e.
-
Francesco Poldi authored
-
Francesco Poldi authored
-
- 08 Oct, 2018 1 commit
-
-
andytnt authored
* Update index-tweets.json * Update index-user.json * Update get.py * Update output.py * Update run.py * Update tweet.py * Update user.py * Update db.py * Update elasticsearch.py * Update _count variable
-
- 07 Oct, 2018 1 commit
-
-
Francesco Poldi authored
Making Elasticsearch setup easier
-
- 01 Oct, 2018 2 commits
-
-
Francesco Poldi authored
* Added option for custom type * Create automate.py * Finished dataframes storing option (#224) * Update (#174) * add function to clean accumulated pandas storage data * Fixed typo, dataname, removed attributes * Added config options and config var * Added autoclean Works for search now * Added Elasticsearch count options * Added silent output and objects for users and followers * Update * Clean following/followers attr * Final construct of object * Redesign * Little fix * Debug * Debug * Globals * Removed debug * Globals pt 2 * Mix * Added _old_obj to store previous scrape * Prefix * Pre fix pt 2 * commented * Fix for object follow * Update * Update * Completed follow_object * Pandas object for followers and following * Finished pandas object for followers and following * Added docstrings in Twint.py * Added lowercase #170 * Finished lower case Close #170 * Fix defaults * Added some edits In `panda.py` changing the structure of the dataframe for users that one is following/followed, in `config.py` added autoupdate so that one does not have to call `storage.panda.get()` at every run, in `output.py` edited follow_object, in `run.py` added autoupdate function for panda, in`tweet.py` just some docstrings * Update for panda and objects * Finished storing data into dataframes #173 Now followers, following, tweets, and user details are saved in dataframes * Added proxy support (#225) * Added proxy #139 * Added new requirement, fixed proxy, added proxy config * Changed index names, removed duplicate arg * Updated default CLI args * Added visualizations and dashboard * Typo fix * Added loggin options, fixes retweets * Update README.md Added examples and how-to * Updated index and fixes * Update * Update dashboards * Update * Update index-tweets, fixed visualizations and new dashboard * Update doc * Fixed errors with user_full * Fixed quite hidden issue * Added print error * Added other print error * Update * #173 * Fix non-latin chars #229
-
Francesco Poldi authored
-
- 30 Sep, 2018 1 commit
-
-
Francesco Poldi authored
-
- 29 Sep, 2018 5 commits
-
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
- 27 Sep, 2018 9 commits
-
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
Added examples and how-to
-
Francesco Poldi authored
-
- 24 Sep, 2018 6 commits
-
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
* Added proxy #139
-
- 23 Sep, 2018 1 commit
-
-
Francesco Poldi authored
* Update (#174) * add function to clean accumulated pandas storage data * Fixed typo, dataname, removed attributes * Added config options and config var * Added autoclean Works for search now * Added Elasticsearch count options * Added silent output and objects for users and followers * Update * Clean following/followers attr * Final construct of object * Redesign * Little fix * Debug * Debug * Globals * Removed debug * Globals pt 2 * Mix * Added _old_obj to store previous scrape * Prefix * Pre fix pt 2 * commented * Fix for object follow * Update * Update * Completed follow_object * Pandas object for followers and following * Finished pandas object for followers and following * Added docstrings in Twint.py * Added lowercase #170 * Finished lower case Close #170 * Fix defaults * Added some edits In `panda.py` changing the structure of the dataframe for users that one is following/followed, in `config.py` added autoupdate so that one does not have to call `storage.panda.get()` at every run, in `output.py` edited follow_object, in `run.py` added autoupdate function for panda, in`tweet.py` just some docstrings * Update for panda and objects * Finished storing data into dataframes #173 Now followers, following, tweets, and user details are saved in dataframes
-
- 21 Sep, 2018 1 commit
-
-
Jake Creps authored
-
- 15 Sep, 2018 1 commit
-
-
Francesco Poldi authored
-
- 13 Sep, 2018 1 commit
-
-
flemish4 authored
When media number is over 1000 twitter writes it as 3.2k = 3200 which is now accounted for. 2. When searching for information, protected accounts were never found. This was because the code expected .find to fail when no result when in reality it returns None. Corrected this to check for None and try the other option.
-
- 30 Aug, 2018 3 commits
-
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
- 29 Aug, 2018 1 commit
-
-
Francesco Poldi authored
-
- 02 Aug, 2018 1 commit
-
-
Benjamin Ooghe-Tabanou authored
-