- 26 Oct, 2018 15 commits
-
-
andytnt authored
-
andytnt authored
-
Francesco Poldi authored
-
andytnt authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
andytnt authored
* Fix json * Added new data to meta
-
andytnt authored
-
andytnt authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
Index creation
-
Francesco Poldi authored
-
andytnt authored
-
- 25 Oct, 2018 3 commits
-
-
Maxim Gubin authored
-
Francesco Poldi authored
* Update index-tweets.json * Update index-user.json * Update get.py * Update output.py * Update run.py * Update tweet.py * Update user.py * Update db.py * Update elasticsearch.py * Update _count variable * Update elasticsearch.py * Set to update (#246) * Added option for custom type * Create automate.py * Finished dataframes storing option (#224) * Update (#174) * add function to clean accumulated pandas storage data * Fixed typo, dataname, removed attributes * Added config options and config var * Added autoclean Works for search now * Added Elasticsearch count options * Added silent output and objects for users and followers * Update * Clean following/followers attr * Final construct of object * Redesign * Little fix * Debug * Debug * Globals * Removed debug * Globals pt 2 * Mix * Added _old_obj to store previous scrape * Prefix * Pre fix pt 2 * commented * Fix for object follow * Update * Update * Completed follow_object * Pandas object for followers and following * Finished pandas object for followers and following * Added docstrings in Twint.py * Added lowercase #170 * Finished lower case Close #170 * Fix defaults * Added some edits In `panda.py` changing the structure of the dataframe for users that one is following/followed, in `config.py` added autoupdate so that one does not have to call `storage.panda.get()` at every run, in `output.py` edited follow_object, in `run.py` added autoupdate function for panda, in`tweet.py` just some docstrings * Update for panda and objects * Finished storing data into dataframes #173 Now followers, following, tweets, and user details are saved in dataframes * Added proxy support (#225) * Added proxy #139 * Added new requirement, fixed proxy, added proxy config * Changed index names, removed duplicate arg * Updated default CLI args * Added visualizations and dashboard * Typo fix * Added loggin options, fixes retweets * Update README.md Added examples and how-to * Updated index and fixes * Update * Update dashboards * Update * Update index-tweets, fixed visualizations and new dashboard * Update doc * Fixed errors with user_full * Fixed quite hidden issue * Added print error * Added other print error * Update * #173 * Fix non-latin chars #229 * Added auto-index-creation Making Elasticsearch setup easier * Revert "Set to update (#246)" (#247) This reverts commit 69cbcf58f5cd36a84003c792315e9455bed55a2b. * Update output.py * Update output.py * Elasticsearch update * Added user_info option * Removed ES count * Get userinfo of username passed
-
Maxim Gubin authored
* New twitter scheme * Fix minor mistake * Fix location issue
-
- 23 Oct, 2018 1 commit
-
-
Maxim Gubin authored
* Fix Tor proxy not being able to connect * Fix request calls * Fix proxy args
-
- 22 Oct, 2018 3 commits
-
-
Francesco Poldi authored
This reverts commit 4c27b2b82cb84e7b8d5fac206b0b8502a5faba4e.
-
Francesco Poldi authored
-
Francesco Poldi authored
-
- 08 Oct, 2018 1 commit
-
-
andytnt authored
* Update index-tweets.json * Update index-user.json * Update get.py * Update output.py * Update run.py * Update tweet.py * Update user.py * Update db.py * Update elasticsearch.py * Update _count variable
-
- 07 Oct, 2018 1 commit
-
-
Francesco Poldi authored
Making Elasticsearch setup easier
-
- 01 Oct, 2018 2 commits
-
-
Francesco Poldi authored
* Added option for custom type * Create automate.py * Finished dataframes storing option (#224) * Update (#174) * add function to clean accumulated pandas storage data * Fixed typo, dataname, removed attributes * Added config options and config var * Added autoclean Works for search now * Added Elasticsearch count options * Added silent output and objects for users and followers * Update * Clean following/followers attr * Final construct of object * Redesign * Little fix * Debug * Debug * Globals * Removed debug * Globals pt 2 * Mix * Added _old_obj to store previous scrape * Prefix * Pre fix pt 2 * commented * Fix for object follow * Update * Update * Completed follow_object * Pandas object for followers and following * Finished pandas object for followers and following * Added docstrings in Twint.py * Added lowercase #170 * Finished lower case Close #170 * Fix defaults * Added some edits In `panda.py` changing the structure of the dataframe for users that one is following/followed, in `config.py` added autoupdate so that one does not have to call `storage.panda.get()` at every run, in `output.py` edited follow_object, in `run.py` added autoupdate function for panda, in`tweet.py` just some docstrings * Update for panda and objects * Finished storing data into dataframes #173 Now followers, following, tweets, and user details are saved in dataframes * Added proxy support (#225) * Added proxy #139 * Added new requirement, fixed proxy, added proxy config * Changed index names, removed duplicate arg * Updated default CLI args * Added visualizations and dashboard * Typo fix * Added loggin options, fixes retweets * Update README.md Added examples and how-to * Updated index and fixes * Update * Update dashboards * Update * Update index-tweets, fixed visualizations and new dashboard * Update doc * Fixed errors with user_full * Fixed quite hidden issue * Added print error * Added other print error * Update * #173 * Fix non-latin chars #229
-
Francesco Poldi authored
-
- 30 Sep, 2018 1 commit
-
-
Francesco Poldi authored
-
- 29 Sep, 2018 5 commits
-
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
- 27 Sep, 2018 8 commits
-
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
-
Francesco Poldi authored
Added examples and how-to
-