Page MenuHomeMiraheze

Goal-2023-Jan-JunGoal
ArchivedPublic

Members

  • This project does not have any members.
  • View All

Watchers

  • This project does not have any watchers.
  • View All

Details

Description

Miraheze's Goals for the first half of 2023 (January 1st ~ June 30th).

Tasks added to this project must be at least one of the following:

a long-term project that can realistically be finished before June 30th,
a development project that will have a positive impact on Miraheze communities,
an objective for Site Reliability Engineers (infrastructure, introducing a new service, major work etc.).
MediaWiki and development tasks can be added freely by anyone assuming someone has in the past hinted at the possibility they would be willing to work on it or have a noticeable impact on communities.

Site Reliability Engineering tasks should only be added by members of the Site Reliability Engineering team as they have full control over their priorities and workflow, not subject to community benefit.

< Goal-2022-Jul-Dec | #goal-2023-jul-dec >

Recent Activity

Feb 14 2024

Reception123 added a comment to T7582: Create automated system for managing SSL requests.

I can now confirm that since notifications are fixed (thanks @Universal_Omega !) RequestSSL is operational.
What remains to be done is to add a check on-wiki for whether CNAME or NS is pointed (@Universal_Omega has an idea for how to do that easily) and then for the puppet API

Feb 14 2024, 07:00 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Feb 10 2024

Reception123 added a comment to T7582: Create automated system for managing SSL requests.

@Reception123 If you want to get RequestSSL working right now, we could look at sending emails the way core does with Special:EmailUser

Feb 10 2024, 15:03 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a comment to T7582: Create automated system for managing SSL requests.

@Reception123 If you want to get RequestSSL working right now, we could look at sending emails the way core does with Special:EmailUser

Feb 10 2024, 11:01 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Jan 21 2024

OrangeStar added a comment to T7582: Create automated system for managing SSL requests.

Regarding step 4:

This is too Miraheze-specific for inclusion in the RequestSSL codebase in my opinion. It is better suited as part of T11710. In the Miraheze-specific setup of this extension, once RequestSSL sends the request to puppet, the server program receiving the request should take care of determining if we should add new DNS zones. So I think steps 4 and 5 should be merged together.

Just to be clear, what you propose is the following? In my example, the domain is pointed via NS.
1: User requests SSL
2: RequestSSL checks (with puppet181's help) whether domain is pointed or not
3: RequestSSL submitted
4: ssl-certificate script once again checks whether domain is pointed and if it's pointed via NS, adds zone to GitHub
5: RequestSSL marked as completed

EDIT: in the fully automated version, steps 2 and 4 would probably be repetitive and would need merging

Jan 21 2024, 18:33 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
Reception123 added a comment to T7582: Create automated system for managing SSL requests.

Regarding step 4:

This is too Miraheze-specific for inclusion in the RequestSSL codebase in my opinion. It is better suited as part of T11710. In the Miraheze-specific setup of this extension, once RequestSSL sends the request to puppet, the server program receiving the request should take care of determining if we should add new DNS zones. So I think steps 4 and 5 should be merged together.

Jan 21 2024, 18:01 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a comment to T7582: Create automated system for managing SSL requests.

Regarding step 4:

Jan 21 2024, 15:45 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
Reception123 added a comment to T7582: Create automated system for managing SSL requests.

I’m not sure that ssl-admins should be decommissioned, as cert removals would still be done manually, and this would allow us to investigate should something go wrong, and also somebody might not want letsencrypt.

Jan 21 2024, 14:46 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
MacFan4000 added a comment to T7582: Create automated system for managing SSL requests.

I’m not sure that ssl-admins should be decommissioned, as cert removals would still be done manually, and this would allow us to investigate should something go wrong, and also somebody might not want letsencrypt.

Jan 21 2024, 14:44 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar moved T7582: Create automated system for managing SSL requests from Backlog to Currently blocked on the RequestSSL board.
Jan 21 2024, 12:11 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a subtask for T7582: Create automated system for managing SSL requests: T11710: Automate certificate generation.
Jan 21 2024, 12:00 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a parent task for T7582: Create automated system for managing SSL requests: T11709: Write mediawiki.org page for RequestSSL.
Jan 21 2024, 11:50 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Jan 19 2024

Reception123 added a project to T7582: Create automated system for managing SSL requests: RequestSSL.
Jan 19 2024, 16:39 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a comment to T7582: Create automated system for managing SSL requests.

@Reception123 I think it's about time we get a RequestSSL project and workboard on Phab. Also, add me as a member of the project if it will not have an open join policy please.

Jan 19 2024, 12:18 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Jan 18 2024

Reception123 added a comment to T7582: Create automated system for managing SSL requests.

Thinking about it, it would still definitely be useful to check whether the domain is pointing before the request is submitting but the python script running on puppet141 would still be needed in the end in order to be able to create the DNS zone for wikis pointing NS. The script already exists but needs some adjustments.

Jan 18 2024, 16:24 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
Reception123 updated the task description for T7582: Create automated system for managing SSL requests.
Jan 18 2024, 16:23 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
Reception123 added a comment to T7582: Create automated system for managing SSL requests.

@OrangeStar Thanks for the ideas. Indeed, it might be better to check whether the domain is pointed via PHP rather than having that in the python script and then having to contact the user afterwards and tell them it isn't. I guess what could be done then if it is not pointed is have an error display that clearly directs users to somewhere where they can get help pointing their domain.

Jan 18 2024, 16:15 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a comment to T7582: Create automated system for managing SSL requests.

Functional but not yet over! Can't do much right now since I'm waiting for T11680 which will introduce some utility functions (To avoid reinventing the wheel) that the server program that automates cert generation would need, but I want to cleanup some of my PRs (the ones yesterday were just to make stuff work), move strings into i18n, change existing i18n strings too, remove some ID leftovers I saw while skimming the code, and automate checking that the domain is pointed correctly at least.

Jan 18 2024, 16:00 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Jan 17 2024

Reception123 added a comment to T7582: Create automated system for managing SSL requests.

Noting that the repo has been transferred to https://github.com/miraheze/requestssl

Jan 17 2024, 20:48 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
Reception123 added a comment to T7582: Create automated system for managing SSL requests.

Thanks to @OrangeStar, RequestSSL is now functional! There's unfortunately one late issue that I thought of that will mean it can still not be made operational. For custom domains it is quite often the case that users don't point their domains properly and need guidance. My understanding is that RequestSSL uses Echo to notify users when there's a comment on their request and if they don't manually enable email notifications they might not get any and would not know that there's been a comment.

Jan 17 2024, 20:42 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a comment to T7582: Create automated system for managing SSL requests.

https://github.com/Reception123/RequestSSL/pull/5

Jan 17 2024, 18:37 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
Reception123 added a comment to T7582: Create automated system for managing SSL requests.
  • Implement logging so that when RemoteWiki is executed with ManageWiki it logs it as if someone had changed managewiki on wiki

Does MediaWiki even have a concept of other wikis existing other than the one currently "running"? We could open the database for the remote wiki and manually write to the logs, but I don't think that's very good.

Assuming you want to log to the remote wiki's managewiki log.

Jan 17 2024, 17:36 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a comment to T7582: Create automated system for managing SSL requests.
  • Implement logging so that when RemoteWiki is executed with ManageWiki it logs it as if someone had changed managewiki on wiki
Jan 17 2024, 17:25 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Jan 16 2024

Reception123 added a comment to T7582: Create automated system for managing SSL requests.
Jan 16 2024, 19:00 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a comment to T7582: Create automated system for managing SSL requests.

https://github.com/Reception123/RequestSSL/pull/4

Jan 16 2024, 18:55 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a comment to T7582: Create automated system for managing SSL requests.

UO for the rescue! I was about to commit a grave sin against best practices.

Jan 16 2024, 17:24 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
Universal_Omega added a comment to T7582: Create automated system for managing SSL requests.
  • Add a method so that $oldstatus and $newstatus is known in order for the updateManageWiki function to be executed only when the status is changed from something else to completed

So, I have an idea for this, but... it involves reading the $wgRequest global. Would this be acceptable? I'll keep searching for better ways to do this anyway.

Jan 16 2024, 17:23 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a comment to T7582: Create automated system for managing SSL requests.
  • Add a method so that $oldstatus and $newstatus is known in order for the updateManageWiki function to be executed only when the status is changed from something else to completed
Jan 16 2024, 17:12 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Jan 14 2024

Reception123 added a comment to T7582: Create automated system for managing SSL requests.

Heads up: some custom domains are pointed using CNAME flattening. So any automation attempts should not only check for CNAME records or whether the authoritative nameservers are pointed to us, but if the A or AAAA returned points to the known IPs of cp* servers.

Jan 14 2024, 17:24 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
OrangeStar added a comment to T7582: Create automated system for managing SSL requests.

Heads up: some custom domains are pointed using CNAME flattening. So any automation attempts should not only check for CNAME records or whether the authoritative nameservers are pointed to us, but if the A or AAAA returned points to the known IPs of cp* servers.

Jan 14 2024, 17:03 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)
Reception123 added a comment to T7582: Create automated system for managing SSL requests.

Timestamps are no longer an issue. For any SRE that is a more competent developer than me (most will be!), the two remaining things for Step 3 are:

Jan 14 2024, 13:21 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Jan 8 2024

Universal_Omega updated the task description for T7582: Create automated system for managing SSL requests.
Jan 8 2024, 23:57 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Jan 4 2024

Reception123 raised the priority of T7582: Create automated system for managing SSL requests from Low to Normal.

Due to the large number of tasks in this area and the particular use that automation can provide, moving this task to normal priority. It'd be nice if at least the remaining fixes for RequestSSL (Step 3) can be completed soon.

Jan 4 2024, 17:52 · RequestSSL, Goal-2023-Jan-Jun, SRE Automation, Goal-2021-Jul-Dec, SSL, MediaWiki (SRE)

Nov 21 2023

MacFan4000 archived Goal-2023-Jan-Jun.
Nov 21 2023, 03:39

Jun 8 2023

MacFan4000 placed T9541: Allow content to be reported from wiki pages up for grabs.
Jun 8 2023, 22:35 · Goal-2023-Jan-Jun, Goal-2022-Jul-Dec, MediaWiki, MediaWiki (SRE), Trust & Safety

May 24 2023

Joritochip placed T8791: Create tags in ManageWiki/WikiDiscover up for grabs.

Unfortunately due to some external circumstances I do not have the time to finish this task at the moment, I will pick it up again when I have time if nobody else claims it in the meantime. The work in progress commits I made are linked in the original post if someone wants to continue working based on what I had done

May 24 2023, 03:02 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice

Apr 18 2023

Paladox closed T9033: Decide whether to switch to opensearch as graylog seems to not be supporting versions passed 7.10 as Resolved.
Apr 18 2023, 20:03 · Goal-2023-Jan-Jun, Infrastructure (SRE)

Apr 1 2023

Joritochip updated the task description for T8791: Create tags in ManageWiki/WikiDiscover.
Apr 1 2023, 01:47 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice

Mar 31 2023

Joritochip moved T8791: Create tags in ManageWiki/WikiDiscover from Radar to In Progress on the Joritochip board.
Mar 31 2023, 06:39 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Joritochip added a project to T8791: Create tags in ManageWiki/WikiDiscover: Joritochip.
Mar 31 2023, 06:39 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice

Mar 29 2023

Joritochip updated the task description for T8791: Create tags in ManageWiki/WikiDiscover.
Mar 29 2023, 23:46 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Reception123 added a comment to T8791: Create tags in ManageWiki/WikiDiscover.

I don't think it's particularly likely for the number of wikis to suddenly grow so in that case the same model could be adopted and we can worry about scalability when we get there.

Mar 29 2023, 20:38 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Joritochip added a comment to T8791: Create tags in ManageWiki/WikiDiscover.

I took a look at how WikiDiscover implements the "number of wikis with setting" magic word, and it actually just fetches every wiki from the DB, parses its settings JSON, and checks if the setting has the desired value... we could take the same approach here instead of a separate table for consistency reasons, although I don't think doing it that way is particularly scalable if there was a significantly larger amount of wikis (since we only have ~6k it's not that big of a performance worry)

Mar 29 2023, 20:29 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Reception123 added a comment to T8791: Create tags in ManageWiki/WikiDiscover.

In that case a separate table should be fine.

Mar 29 2023, 10:20 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Joritochip added a comment to T8791: Create tags in ManageWiki/WikiDiscover.

Since there can only be one category per wiki, the query only needs to look for an exact match. If we were to store tags as strings in JSON format or as comma separated lists, we'd need the query to check for any occurrence of each tag being filtered for every wiki. That kind of query is slow in SQL.

Mar 29 2023, 08:30 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Reception123 added a comment to T8791: Create tags in ManageWiki/WikiDiscover.

How come it would be that different than querying categories with the current system?

Mar 29 2023, 07:54 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Joritochip added a comment to T8791: Create tags in ManageWiki/WikiDiscover.

In order to make querying tags efficient we'll likely need a new table on the mhglobal database cw_wikitags with wiki_dbname and tag_id columns... Although we could store the tags as JSON or CSV in cw_wikis, trying to query that would be slow

Mar 29 2023, 07:16 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Joritochip moved T8791: Create tags in ManageWiki/WikiDiscover from Backlog to Features on the ManageWiki board.
Mar 29 2023, 06:23 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Joritochip moved T8791: Create tags in ManageWiki/WikiDiscover from Backlog to Features on the CreateWiki board.
Mar 29 2023, 06:23 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Joritochip added projects to T8791: Create tags in ManageWiki/WikiDiscover: ManageWiki, CreateWiki.
Mar 29 2023, 06:23 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice
Joritochip updated the task description for T8791: Create tags in ManageWiki/WikiDiscover.
Mar 29 2023, 05:09 · Joritochip, CreateWiki, ManageWiki, Goal-2023-Jan-Jun, WikiDiscover, MediaWiki (SRE), Notice