Report on activities in the Toolhub project for the week ending 2020-10-30.
See the on-wiki progress report [0] for additional details and clickable links.
== TL;DR ==
* Initial backend API created
* OpenAPI v3 schema being automatically generated for backend API
* OpenAPI schema viewer with "try" functionality added to Vue frontend
* CRUD API for managing toolinfo.json URLs for the crawler created
* Work in progress on frontend for toolinfo.json URL management
Progress, and learning about the new to us tools being used in the
project, continues at a steady pace. As a greenfield project that is
using many components new to the developers and largely new to the
Foundation there has been some "two steps forward, one step back"
activities as making progress on a given milestone uncovers weaknesses
in or omissions of tertiary features. This sort of thing is to be
expected and thus far has not become disruptive to the overall
progress and timeline. We are in the last week of the first month of
the quarter, but due to the number of holiday and vacation breaks in
November and December we are closer to half way through the available
working hours for the quarter. We will continue to evaluate progress
versus the roadmap and try to keep everyone informed of potential
changes in what we believe will be {{done}} by the end of the quarter.
[0]: https://meta.wikimedia.org/wiki/Toolhub/Progress_reports/2020-10-30
Bryan
--
Bryan Davis Technical Engagement Wikimedia Foundation
Principal Software Engineer Boise, ID USA
[[m:User:BDavis_(WMF)]] irc: bd808
Report on activities in the Toolhub project for the week ending 2020-10-23.
See the on-wiki progress report [0] for additional details and clickable links.
== TL;DR ==
* The project's canonical git repo has been moved to wikimedia/toolhub
in Gerrit.
* Jenkins is running tests for the gerrit repo using the PipelineLib
project's in-repo configuration. No images are being published to the
Foundation's Docker repo yet.
* Toolhub now has a Vue.js powered user interface!
* Configuration has been added to the Vue frontend and Django backend
creating a workflow for the OAuth 2.0 authentication process and
informing Vue of the current user's authentication state.
This was a good week for progress on the project. As hoped for last
week, the migration to Gerrit and initial Vue setup have been
completed. Finding a workflow for the OAuth login and communicating
user data to the Vue frontend was a nice bonus completion. Bryan plans
on starting work on the Django backend's API endpoints for adding and
removing toolinfo.json external URLs to configure the crawler in the
coming week. Srishti is planning on UI design for the external URLs
management.
For those of you with access to the Foundation's Slack and/or Matrix
chat systems, there is now a #toolhub-team channel that Bryan and
Srishti will be using to discuss Toolhub dev questions rather than
private messages. Join us if you are interested! (/me apologizes to
the non-Foundation staff who do not currently have access to this
chat.)
[0]: https://meta.wikimedia.org/wiki/Toolhub/Progress_reports/2020-10-23
Bryan
--
Bryan Davis Technical Engagement Wikimedia Foundation
Principal Software Engineer Boise, ID USA
[[m:User:BDavis_(WMF)]] irc: bd808
Report on activities in the Toolhub project for the week ending 2020-10-16.
See the on-wiki progress report [0] for additional details and clickable links.
== TL;DR ==
* T264807: The Django backend now has working integration with
MediaWiki's OAuth 2.0 server for user account creation and
authentication.
* T264813: A .pipeline/config.yaml configuration has been written.
Testing is blocked on moving the git repo from GitHub to Gerrit which
is expected in the coming week.
* Srishti has been reviewing the UI wireframes from 2018 and thinking
about how implementation will happen. She also has made a POC git repo
to show Bryan how to setup the parallel frontend and backend
components.
Bootstrapping work is nearly done with migration to Gerrit and initial
Vue.js setup remaining. We expect to complete these two steps in the
coming week. Bryan will then move on to the initial API bootstrapping
and endpoints for managing toolinfo.json URLs while Srishti starts
designing the basics of the frontend and connecting it to the backend
for authentication.
[0]: https://meta.wikimedia.org/wiki/Toolhub/Progress_reports/2020-10-16
Bryan
--
Bryan Davis Technical Engagement Wikimedia Foundation
Principal Software Engineer Boise, ID USA
[[m:User:BDavis_(WMF)]] irc: bd808
As has become the early tradition here, I would like to welcome
Joaquin Oltra Hernandez, [[User:JHernandez (WMF)]], to the list.
Joaquin is a Developer Advocate at the Foundation and is interested in
following along with our experiment in using this list to keep folks
connected to the Toolhub project work and related discussions. I also
have hopes of getting him involved in the technical community facing
communications that will be needed as we get closer to deploying the
tool. :)
Everyone, please do remember that this list is a part of the Wikimedia
technical spaces and thus covered by the
<https://www.mediawiki.org/wiki/Code_of_Conduct>. The archives of the
list are also publicly available, so keep that in mind as well when
posting here.
Bryan
--
Bryan Davis Technical Engagement Wikimedia Foundation
Principal Software Engineer Boise, ID USA
[[m:User:BDavis_(WMF)]] irc: bd808
Report on activities in the Toolhub project for the week ending 2020-10-09.
See the on-wiki progress report [0] for additional details and clickable links.
Now that we have a place on metawiki for these reports to be written
and archived, I'm going to try making the mailing list post be more of
a TL;DR summary than a comprehensive report. Feedback on that
arbitrary decision is appreciated. If folks would rather have all the
info by email I am happy to accommodate them.
== TL;DR ==
* Goals for the quarter (October-December 2020) have been set and
recorded in Betterworks and Phabricator.
* Research and proof of concept work on Vue.js related front end
concepts has progressed with a result of Vuetify
(<https://vuetifyjs.com/>) being selected as the user interface
library for the project.
* Work has started on OAuth 2.0 integration with MediaWiki including
an upstream patch to make MediaWiki's OAuth 2.0 identity responses
include data that OAuth 1.0a has historically returned.
* The local development environment is converging with the expected
production CI and deployment systems.
[0]: https://meta.wikimedia.org/wiki/Toolhub/Progress_reports/2020-10-09
Bryan
--
Bryan Davis Technical Engagement Wikimedia Foundation
Principal Software Engineer Boise, ID USA
[[m:User:BDavis_(WMF)]] irc: bd808
Report on activities in the Toolhub project for the week ending 2020-10-02.
See the on-wiki progress report [0] for prettier formatting and clickable links.
== Progress reports now published on metawiki ==
The weekly progress reports for Toolhub development from the weeks of
2020-09-18 and 2020-09-25 have been retroactively posted to the new
Toolhub/Progress reports area on metawiki. Going forward these reports
will start on metawiki as pages marked with {{Draft}} and then be
tidied up and summarized to the toolhub-dev mailing list at the end of
the work week.
== Content moderation exploration ==
Where there is free form text content, there will be vandalism. This
is an Internet truism that Wikimedians are well aware of. MediaWiki
includes many components to help support patrolling content
submissions. Toolhub will need systems for this as well, but what
systems? How can we make the process of patrolling Toolhub feel
friendly to folks who are used to doing content patrolling with
MediaWiki?
Bryan, Keegan, Johan, Harej, Xover, and Risker all provided input on
the discussion of needs in T261023. The combined recommendations have
been summarized at Toolhub/Decision record#Content moderation support.
== Draft goals for October-December 2020 ==
Srishti and Bryan have drafted a proposed set of functionality to be
implemented in Q2 of the Foundation's fiscal year 2020/2021
(October-December 2020). This list has been shared with the advisory
council and will likely be finalized as objectives and key results
(OKRs) in the week of October 5th.
Our goal is to implement the features described at
Toolhub/Roadmap#Milestone 2: Initial API and UI; toolinfo crawler
along with supporting features which are needed to build a stable
foundation for the project. This set of features will result in an
application which includes the core features of Hay's Directory and a
platform that can be extended in future iterations to achieve the
"first customer release" functionality of milestones 3, 4, 5, and 6.
== Wrap up ==
The week saw the end of the Foundation's FY20/21 Q1 and the start of
Q2. The key result for Toolhub in the Q1 plan ("Define the technical
plan for Toolhub") ended the quarter with an assessment of 97%
complete. The remaining work in the KR is closing out the "Determine
basic hosting parameters for Toolhub" research task. This task is
currently waiting on feedback from members of the advisory board.
Planning for the next phase of the project (coding!) is well underway.
Official goals are being finalized and should be documented by the
time we send out the progress report for the week ending 2020-10-09.
Bryan is happy in general with the progress that was made in Q1. His
main takeaway for improvement in the future is to try and get issues
needing feedback from other teams and the advisory council surfaced
earlier in the quarter to avoid colliding with the inevitable time
crunch that folks fall under towards the end of the quarter when they
are trying to close out their own goals.
[0]: https://meta.wikimedia.org/wiki/Toolhub/Progress_reports/2020-10-02
Bryan
--
Bryan Davis Technical Engagement Wikimedia Foundation
Principal Software Engineer Boise, ID USA
[[m:User:BDavis_(WMF)]] irc: bd808