[07:30:56] srrodlund: in case you haven’t seen, the tool-zppixbot instance will have maintenance in ~90 mins hopefully lasting ~30 mins [07:42:36] (03PS1) 10RhinosF1: Add sitenotice for maint. [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601179 (https://phabricator.wikimedia.org/T254046) [07:43:42] (03PS2) 10RhinosF1: Add sitenotice for maint. [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601179 (https://phabricator.wikimedia.org/T254046) [07:43:48] (03CR) 10RhinosF1: [V: 03+2 C: 03+2] Add sitenotice for maint. [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601179 (https://phabricator.wikimedia.org/T254046) (owner: 10RhinosF1) [07:44:48] (03PS1) 10RhinosF1: Add sitenotice for maint. [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601180 (https://phabricator.wikimedia.org/T254046) [07:45:26] (03PS2) 10RhinosF1: Add sitenotice for maint. [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601180 (https://phabricator.wikimedia.org/T254046) [07:45:30] (03CR) 10RhinosF1: [V: 03+2 C: 03+2] Add sitenotice for maint. [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601180 (https://phabricator.wikimedia.org/T254046) (owner: 10RhinosF1) [07:55:16] .op [07:55:17] Please wait... [08:53:09] [ANNOUNCEMENT] ZppixBot maintenance will begin in just under 10 mins. You will not be able to use most services during this time. [09:01:45] ^ me [09:21:06] Reception123: we've been in a lot of channels [09:32:04] yup [09:48:59] [02ZppixBot-Source] 07RhinosF1 pushed 033 commits to 03master [+1/-0/±3] 13https://git.io/Jf6hH [09:49:01] [02ZppixBot-Source] 07RhinosF1 0328a4755 - Change pip config [09:49:02] [02ZppixBot-Source] 07RhinosF1 039f72be5 - Update .travis.yml Update travis [09:49:04] [02ZppixBot-Source] 07RhinosF1 03256d5da - Update .travis.yml update travis [09:50:06] [02ZppixBot-Source] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jf6h7 [09:50:07] [02ZppixBot-Source] 07RhinosF1 035c99f77 - Update .travis.yml [09:50:47] [02ZppixBot-Source] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/Jf6hF [09:50:48] [02ZppixBot-Source] 07RhinosF1 0321cee02 - Update requirements.txt [09:52:34] Reception123: we can bring the bot up as soon as travis passes, starting webservice [09:54:37] (03PS1) 10RhinosF1: Revert "Add sitenotice for maint." [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601318 [09:54:48] (03CR) 10RhinosF1: [V: 03+2 C: 03+2] Revert "Add sitenotice for maint." [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601318 (owner: 10RhinosF1) [09:54:54] (03PS1) 10RhinosF1: Revert "Add sitenotice for maint." [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601319 [09:55:00] (03CR) 10RhinosF1: [V: 03+2 C: 03+2] Revert "Add sitenotice for maint." [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601319 (owner: 10RhinosF1) [09:57:28] Reception123: webservice started fine [10:04:45] Reception123: should be a few minutes [10:08:44] Reception123: Service Restored [10:09:47] 10Tool-Zppixbot, 10User-RhinosF1: Clean ZppixBot's filesystem up - https://phabricator.wikimedia.org/T254046 (10RhinosF1) 05Open→03Resolved Complete [10:09:50] .ip 8.8.8.8 [10:09:50] Downloading GeoIP database, please wait... [10:10:47] [IP/Host Lookup] Hostname: dns.google | Location: United States | ISP: AS15169 GOOGLE [10:10:56] .commands [10:10:57] Hang on, I'm creating a list. [10:10:57] I've posted a list of my commands at https://clbin.com/VDeuO - You can see more info about any of these commands by doing .help (e.g. .help time) [10:11:54] ZppixBot: well done! [10:11:57] .ping [10:11:57] Pong! [10:12:30] [ANNOUNCEMENT] The maintenance on ZppixBot is complete. Some commands may be slow on first run. [10:12:48] srrodlund: webservice is online again [10:13:50] 10Tool-Zppixbot, 10User-RhinosF1: Clean ZppixBot's filesystem up - https://phabricator.wikimedia.org/T254046 (10RhinosF1) Sanity checked and everything seems fine, I've reloaded the ip database and ran .commands and .ping to hopefully populate a few caches again. The bot may be slow for first use. [10:14:42] That took 67 mins [10:15:48] .seen Reception123 [10:15:48] RhinosF1: I last saw Reception123 in another channel 2 hours, 17 minutes ago. [10:50:19] back [10:54:38] Reception123: everything works [10:55:26] great! [10:56:00] Reception123: apart from a copy-paste error, everything started fine [11:46:53] .commands [11:46:54] I've posted a list of my commands at https://clbin.com/VDeuO - You can see more info about any of these commands by doing .help (e.g. .help time) [12:01:57] Reception123: there's 420 users not seen since 2019 [12:02:08] hmm [12:13:31] Reception123: I'm going to go through and drop slowly users that are "orphan" or not since in over 18 months [12:13:44] ok, sounds good [12:14:05] Reception123: unfortunately, not automated [12:23:01] Reception123: It's a manual process which is annyoing [12:35:03] https://www.irccloud.com/pastebin/bjgI41Pv/ [12:35:04] [ Snippet | IRCCloud ] - www.irccloud.com [12:35:10] Reception123: 54 orphans [12:56:08] Reception123: all have been dropped [12:56:46] these all haven't been seen in 18 months https://www.irccloud.com/pastebin/VVkSnZWd/ [12:56:46] [ Snippet | IRCCloud ] - www.irccloud.com [13:04:44] 10Tool-Zppixbot: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10RhinosF1) [13:04:55] 10Tool-Zppixbot: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10RhinosF1) p:05Triage→03Medium [13:05:19] Reception123: now just to drop the 417 old accounts [13:05:29] heh [13:07:57] 10Tool-Zppixbot: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10RhinosF1) {P11346} [13:10:17] 10Tool-Zppixbot: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10RhinosF1) there is no "easy" way to do this # Generate the list # Drop the nick_id from nick_values # Drop the nick_id from nicknames # Delete the key from nick_ids [13:15:45] 10Tool-Zppixbot: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10RhinosF1) https://zppixbot.toolforge.org/zppixbot/wiki/index.php?title=Privacy_Policy&diff=38&oldid=5 [13:16:06] Reception123: that will be done tommorow [13:16:15] ok [13:18:20] .c 1142-1086 [13:18:21] RhinosF1: 56 [13:27:40] (03PS1) 10MacFan4000: Restore table headers - accidentally removed in my last commit, also update versions [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601347 [13:30:54] (03PS2) 10MacFan4000: Restore table headers - accidentally removed in my last commit, also update versions [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601347 [13:31:28] (03CR) 10RhinosF1: [V: 03+2 C: 03+2] Restore table headers - accidentally removed in my last commit, also update versions [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601347 (owner: 10MacFan4000) [13:31:54] MacFan4000: doing [13:32:31] (03CR) 10RhinosF1: [V: 03+2 C: 03+2] "deployed" [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601347 (owner: 10MacFan4000) [13:32:55] ty [13:33:31] MacFan4000: ty to you for helping [13:38:06] actually looks like there's more I need to fix [13:40:44] MacFan4000: I'm signing out now fyi until tonight [14:01:16] .whoami [14:01:19] .accesslevel [14:01:19] The access level for Examknow is User. [14:01:31] .accesslevel RhinosF1 [14:01:31] The access level for Examknow is User. [14:03:25] (03PS1) 10MacFan4000: Clean-up docs some more [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601351 [14:10:16] (03PS2) 10MacFan4000: Clean-up docs some more [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601351 [14:13:35] .accesslevel [14:13:35] The access level for MacFan4000 is User. [14:30:11] .accesslevel [14:30:11] The access level for RhinosF1 is Admin. [14:30:16] Examknow: ^ [14:30:47] ah ok [14:30:51] (03CR) 10RhinosF1: [V: 03+1 C: 03+1] Clean-up docs some more [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601351 (owner: 10MacFan4000) [14:31:05] MacFan4000: will do later [14:31:14] k [15:26:14] 10Tool-Zppixbot, 10User-Examknow: Create Chanops Database file - https://phabricator.wikimedia.org/T254166 (10Examknow) [15:26:44] 10Tool-Zppixbot, 10User-Examknow, 10User-RhinosF1: Create Chanops Database file - https://phabricator.wikimedia.org/T254166 (10Examknow) a:03RhinosF1 [16:42:56] 10Tool-Zppixbot, 10User-Examknow, 10User-RhinosF1: Create Chanops Database file - https://phabricator.wikimedia.org/T254166 (10RhinosF1) p:05Triage→03Medium [16:50:44] 10Tool-Zppixbot, 10User-Examknow, 10User-RhinosF1: Create channelmgnt.db and tables - https://phabricator.wikimedia.org/T254166 (10RhinosF1) [16:51:12] 10Tool-Zppixbot, 10User-Examknow, 10User-RhinosF1: Create channelmgnt.db and tables - https://phabricator.wikimedia.org/T254166 (10RhinosF1) [17:38:11] 10Tool-Zppixbot, 10User-Examknow, 10User-RhinosF1: Create channelmgnt.db and tables - https://phabricator.wikimedia.org/T254166 (10RhinosF1) [18:08:55] 10Tool-Zppixbot: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10Examknow) We can make an python script to run the SQL and remove the data from the tables [19:54:39] .joinall [19:54:51] Reception123: you’ll have to restart the bot [19:56:08] Reception123: fixes [21:16:14] 10Tool-Zppixbot, 10User-Examknow, 10User-RhinosF1: Create channelmgnt.db and tables - https://phabricator.wikimedia.org/T254166 (10RhinosF1) 05Open→03Resolved [21:16:16] 10Tool-Zppixbot, 10User-Examknow: Improve ways to change ZppixBot's ChanOps list - https://phabricator.wikimedia.org/T234480 (10RhinosF1) [21:24:57] (03CR) 10RhinosF1: [V: 03+2 C: 03+2] Clean-up docs some more [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601351 (owner: 10MacFan4000) [21:25:04] (03CR) 10RhinosF1: [V: 03+2 C: 03+2] "deploying" [labs/tools/ZppixBot] - 10https://gerrit.wikimedia.org/r/601351 (owner: 10MacFan4000) [21:25:16] MacFan4000: ^ [21:39:27] Texas: hi [21:39:43] Texas: we can chat code in here [21:39:51] k [21:41:21] 10Tool-Zppixbot: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10RhinosF1) In SQL: ` DELETE from nick_values where nick_id is 34; DELETE from nicknames where nick_id is 34; DELETE from nick_ids where nick_id is 34; ` would drop user 34 from everywhere in default.db [21:41:36] Texas: ^ [21:43:15] Texas: https://kite.com/python/docs/sqlalchemy.orm.query.Query.delete might help [21:43:15] [ Kite ] - kite.com [21:43:16] 10Tool-Zppixbot: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10Examknow) >>! In T254154#6183365, @RhinosF1 wrote: > In SQL: > > ` > DELETE from nick_values where nick_id is 34; > DELETE from nicknames where nick_id is 34; > DELETE from nick_ids where nick_id is 34; > ` > >... [21:44:02] 10Tool-Zppixbot, 10User-Examknow: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10Examknow) [21:44:18] 10Tool-Zppixbot, 10User-Examknow: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10RhinosF1) > For a more long-term solution we can make a python script to review the data in the tables to see what needs to be removed. That's 1 select query [21:45:29] 10Tool-Zppixbot, 10User-Examknow: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10Examknow) >>! In T254154#6183372, @RhinosF1 wrote: >> For a more long-term solution we can make a python script to review the data in the tables to see what needs to be removed. > That's 1 selec... [21:45:55] 10Tool-Zppixbot, 10User-Examknow: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10RhinosF1) EXAMPLE: > select nick_id from nick_values where value < 1546300800 and key = "seen_timestamp" for criteria 2 >select nick_id from nick_values where value < "##RhinosF1" and key = "see... [21:46:15] 10Tool-Zppixbot, 10User-Examknow: Establish data retention guidelines - https://phabricator.wikimedia.org/T254154 (10RhinosF1) >>! In T254154#6183376, @Examknow wrote: >>>! In T254154#6183372, @RhinosF1 wrote: >>> For a more long-term solution we can make a python script to review the data in the tables to see... [21:46:50] Texas: a single automated process for criteria 1 could work, for criteria 2 it should be manual [21:47:09] as the bot doesn't record when it was last in a channe; [21:47:18] ah [21:47:35] Texas: criteria 1 is easy [21:47:54] yeah [21:48:12] RhinosF1: I can review this stuff tomorrow. Right now I must go. [21:48:31] ok