brian/twitter_scraper
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
54 Commits 1 Branch 0 Tags
8427f6802ec61c85624230fb98f6821a6c36d2c4
Commit Graph
54 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
simplypower-bbj 8427f6802e updated code to use less logins to database 2022-12-18 20:51:29 +01:00
simplypower-bbj c402a1d65a updated code to use less logins to database 2022-12-18 20:51:17 +01:00
simplypower-bbj 67cd2557c3 updated to use env var discord service name 2022-12-18 20:51:00 +01:00
simplypower-bbj 17e463c22f added discord service name 2022-12-18 20:50:30 +01:00
simplypower-bbj db4c31d75e added try except statements and logging 2022-12-18 19:36:46 +01:00
simplypower-bbj be529bf189 fixed bug where database login was abused 2022-12-18 17:56:07 +01:00
simplypower-bbj 7c26d033e7 added script to monitor translation progress 2022-12-18 17:19:06 +01:00
simplypower-bbj 9ad1d7f067 fixed bug 2022-12-18 16:13:31 +01:00
brian 34b3044007 added comment 2022-12-18 15:04:39 +00:00
brian c1aa7d23eb updated code to run on multiple hosts at the same time 2022-12-18 15:03:53 +00:00
brian f6e8ee0c77 updated code to avoid translating already translated content 2022-12-18 14:56:43 +00:00
brian 0c70b39abd added and tested function to spawn process that speed up the translation process 2022-12-18 14:20:15 +00:00
brian 60bf1074a7 added function to insert one translated content 2022-12-18 14:19:52 +00:00
brian bf5f9253da installed packages 2022-12-18 13:37:00 +00:00
brian a23fb3ee23 began testing functions to generate plots 2022-12-18 13:36:50 +00:00
brian 6c312eb3bc added functino to clean translated content 2022-12-18 13:36:23 +00:00
brian 73e3a42f88 added function to translate all content in database 2022-12-18 12:03:29 +00:00
brian 90e5ee5803 added functions to translate content 2022-12-18 12:02:56 +00:00
brian 87224cd5ed ran tests 2022-12-18 12:02:16 +00:00
brian f51f81ba07 added functions to clean content 2022-12-18 12:01:41 +00:00
brian fc04f49a00 added function to insert translated list of content 2022-12-18 12:00:55 +00:00
simplypower-bbj d52a9e3558 installed packages 2022-12-18 11:27:43 +01:00
simplypower-bbj 77b798ffd0 updated package reference 2022-12-18 11:27:29 +01:00
simplypower-bbj a1d3406ce9 added code and ran tests using sntwitter 2022-12-18 11:26:50 +01:00
simplypower-bbj d2b9f08dea ran tests 2022-12-18 11:16:36 +01:00
simplypower-bbj f3700ea501 started testing functions to clean data 2022-12-18 11:12:16 +01:00
simplypower-bbj 51b314c6c5 renamed selenium based scraper files 2022-12-18 11:11:35 +01:00
simplypower-bbj 6bbde24b84 deleted docker related files 2022-12-18 11:10:19 +01:00
simplypower-bbj da253b25a7 updated to run snscraper 2022-12-18 11:09:02 +01:00
simplypower-bbj 31588e49a3 added newest version of googgle_trans_new 2022-12-18 11:08:39 +01:00
simplypower-bbj dbb9702468 added function to get all data 2022-12-18 11:05:16 +01:00
simplypower-bbj 1dd12c894a added functino to get content from database 2022-12-18 11:04:19 +01:00
simplypower-bbj 7f2268605a increased username allowed length 2022-12-17 01:29:18 +01:00
simplypower-bbj 1041828256 updated to use .env file 2022-12-17 01:26:19 +01:00
simplypower-bbj 167426914f updated to run once an hour 2022-12-17 01:25:59 +01:00
simplypower-bbj 3c1437a898 renamed file 2022-12-17 01:16:53 +01:00
simplypower-bbj 80410e2b4e added entrypoint for service 2022-12-17 01:13:18 +01:00
simplypower-bbj 39ce562fe3 fixed bug in try-except statement 2022-12-17 01:12:52 +01:00
simplypower-bbj d602fda7c9 added function to insert lists of data 2022-12-17 01:12:31 +01:00
simplypower-bbj 61c1b04a0d prepared to run as container 2022-12-17 01:02:34 +01:00
simplypower-bbj bc73952e76 moved files to code folder 2022-12-17 01:02:13 +01:00
simplypower-bbj fc5ebd1dde renamed env file 2022-12-17 00:55:59 +01:00
simplypower-bbj 9a07ad1dc7 added logging and discord message interface 2022-12-17 00:53:33 +01:00
simplypower-bbj 7dfea2891c installed packages 2022-12-17 00:53:18 +01:00
simplypower-bbj 33c307da43 added function to insert data 2022-12-17 00:49:27 +01:00
simplypower-bbj cdbcbac49d added database interaction class 2022-12-17 00:47:51 +01:00
simplypower-bbj 7a535b3e94 ran test 2022-12-17 00:47:24 +01:00
simplypower-bbj 7eab2f1ef7 installed packages 2022-12-17 00:47:07 +01:00
simplypower-bbj 439fd3d4e2 updated env file 2022-12-17 00:18:07 +01:00
simplypower-bbj 111e801553 removed ignore for .env-file 2022-12-17 00:17:54 +01:00