Report on the Toolhub project for the week ending 2021-09-24.
See the on-wiki progress report [0] for additional details and clickable links.
== TL;DR ==
* Minor code cleanups
* Kubernetes deployment progress
Bryan's goal for the week was to complete the technical tasks of
creating the initial database tables and test the crawler process from
inside the Kubernetes staging cluster. The database tables have been
created and some testing done, but that testing revealed missing
configuration which took the rest of the week to design and implement.
With that configuration now in place, work will continue next week on
setting up LVS, DNS, and Varnish for https://toolhub.wikimedia.org.
Once that is done we will be able to continue testing OAuth
authentication and the crawler. If all goes well we may be ready to
announce Toolhub to the movement in the following week!
Many thanks to Giuseppe Lavagetto, Manuel Aróstegui, and Kunal Mehta
for their help this week in finding and resolving deployment issues.
[0]: https://meta.wikimedia.org/wiki/Toolhub/Progress_reports/2021-09-24
Bryan
--
Bryan Davis Technical Engagement Wikimedia Foundation
Principal Software Engineer Boise, ID USA
[[m:User:BDavis_(WMF)]] irc: bd808
Report on the Toolhub project for the two weeks ending 2021-09-17.
See the on-wiki progress report [0] for additional details and clickable links.
== TL;DR ==
* CC0 selected for content license
* List editing
With the content license selected, the list of critical remaining
tasks before we can do the official launch is fairly short:
* Create initial database tables and seed data
* Create initial Elasticsearch schema and index
* Test crawler process from inside Kubernetes staging cluster to
validate HTTP proxy configuration
Beyond these must do tasks, we would also like to work on end user
documentation for using Toolhub on metawiki and to plan our
announcement strategy for letting the Wikimedia community know about
the project. Bryan expects to work on all of these things in the
coming week with a personal goal of having the technical tasks
completed by the next weekly report.
[0]: https://meta.wikimedia.org/wiki/Toolhub/Progress_reports/2021-09-17
Bryan
--
Bryan Davis Technical Engagement Wikimedia Foundation
Principal Software Engineer Boise, ID USA
[[m:User:BDavis_(WMF)]] irc: bd808
Report on the Toolhub project for the week ending 2021-09-03.
See the on-wiki progress report [0] for additional details and clickable links.
== TL;DR ==
* First deployment into 'staging' cluster
Last week's report gave a punch list of known remaining tasks. After
this week's progress, that list now looks like:
* Select content license and document in Toolhub UI at all data entry locations
* {{Done}} Add support for mcrouter to the Helm chart for Toolhub and
per-deployment configuration via helmfile settings
* {{Done}} Load test API to establish initial container sizing limits
for CPU and RAM
* {{Done}} Add production OAuth secrets to generated configuration
* {{Done}} Deploy into "staging" Kubernetes cluster
* Create initial database tables and seed data
* Create initial Elasticsearch schema and index
* Test crawler process from inside Kubernetes staging cluster to
validate HTTP proxy configuration
There will not be a weekly report published on 2021-09-10. Bryan is
going to be taking the week off to enjoy some late summer/early fall
fun away from his laptop. Expect our next report on 2021-09-17, and
join Bryan in hoping that the update provided then will include either
a soft production launch or a concrete timeline for the official
product launch.
[0]: https://meta.wikimedia.org/wiki/Toolhub/Progress_reports/2021-09-03
Bryan
--
Bryan Davis Technical Engagement Wikimedia Foundation
Principal Software Engineer Boise, ID USA
[[m:User:BDavis_(WMF)]] irc: bd808