Next Thursday we'll be upgrading to OpenStack version 'Queens' starting
at 15:00 UTC.
The upgrade will take a couple of hours. During the upgrade process,
Horizon (and associated OpenStack APIs) will be disabled. There may
also be brief network interruptions during the upgrade.
Toolforge and existing VMs should be largely unaffected if all goes well
-- there may be some service interruption if we encounter networking issues.
- Andrew + the WMCS team
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Hi all,
I’m happy to announce the outcome of an Outreachy internship
<https://phabricator.wikimedia.org/T233707> that I’m finishing up. It is a
new tool and public dataset named Citation Detective which tool developers
and researchers can now use for their projects.
Citation Detective <https://meta.wikimedia.org/wiki/Citation_Detective>
contains sentences that have been identified as needing a citation using a
machine learning-based classifier published earlier last year
<https://arxiv.org/pdf/1902.11116.pdf> by WMF researchers and
collaborators. As part of Outreachy, I developed a tool
<https://github.com/AikoChou/citationdetective> (hosted on Toolforge
<https://tools.wmflabs.org>) to run through Wikipedia and extract
high-scoring sentences along with contextual information.
As an example use case for this data, I also created a proof of concept for
integrating Citation Detective and Citation Hunt
<https://tools.wmflabs.org/citationhunt>. Check out my prototype Citation
Hunt <https://tools.wmflabs.org/aiko-citationhunt>, which uses Citation
Detective to import sentences that would not normally be featured in
Citation Hunt. The repository for that is here
<https://github.com/AikoChou/citationhunt>.
This dataset currently includes sentences from ~120,000 randomly selected
articles from the English Wikipedia. In future work, we hope to expand this
to more language Wikipedia projects and a greater number of articles. It is
also possible to expand the database to contain more fields in a future
version according to feedback from tool developers and researchers. More
use cases for this type of data were identified in a design research project
<https://meta.wikimedia.org/wiki/Research:Identification_of_Unsourced_Statem…>
conducted last year by Jonathan Morgan.
You can find more information in our Wiki Workshop submission
<https://commons.wikimedia.org/wiki/File:Citation_Detective_WikiWorkshop2020…>
and in my blog <https://rollingmist.home.blog/> which documented the whole
journey.
Thank you very much!
Kind regard,
Aiko
On 2020-03-03, Brooke completed the automatic migration phase of the
2020 Kubernetes migration by moving the last workloads from the legacy
Kubernetes cluster to the 2020 Kubernetes cluster [0].
All Toolforge tools using `webservice --backend=kubernetes ...` and/or
manually maintained Kubernetes objects are now running on the 2020
Kubernetes cluster. The Toolforge admin team is in the process of
tearing down the legacy cluster and cleaning up various documentation
and tooling related to it [1].
This project involved a lot of hard work that most of the Toolforge
community did not see. Brooke and Arturo started planning things over
a year ago [2] to ensure that the Toolforge admin team would be able
to complete this migration with a minimum amount of disruption to
tools and their maintainers. Along the journey they researched
Kubernetes best practices and recommendations, read and re-read
numerous tutorial and how-to docs, and designed a completely new
process to automate the deployment of Kubernetes in Toolforge. They
also sought and received help from other Toolforge admins, Wikimedia
Foundation staff, and technical volunteers. This was a truly
collaborative effort.
I am very happy to say that in my opinion we have a well automated and
monitored Kubernetes cluster in Toolforge today. There are many more
features that we will continue to work on as we try to make Kubernetes
use in Toolforge easier for everyone, but we can only do that work
because we now have this solid base to build on. I look forward to
announcements of many more features in the coming months.
Thank you to our alpha and beta testers who found more edge cases and
made good suggestions for simplifying things. Thank you all for your
patience and understanding when things did not go quite as planned
during this process. And finally thank you in advance for the edits
that will be made to help pages on Wikitech and elsewhere as we all
work on bug #1 (improving documentation).
[0]: https://phabricator.wikimedia.org/T246519
[1]: https://phabricator.wikimedia.org/T246689
[2]: https://phabricator.wikimedia.org/T214513
Bryan, on behalf of the Toolforge admin team and the Wikimedia Cloud
Services team
--
Bryan Davis Technical Engagement Wikimedia Foundation
Principal Software Engineer Boise, ID USA
[[m:User:BDavis_(WMF)]] irc: bd808
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Time for another hardware repair task! A lot of these fragile hosts are
slated for replacement within the year but in the next time we need to
nurse them along.
On Friday I'm going to drain cloudvirt1006 for a battery replacement.
Starting around 15:00 UTC the following VMs will be copied to another
host, which means a short period of downtime and a reboot:
phabricator-stage-1001
icinga-dev-01
tool-buster
dwl-test
deployment-echostore01
deployment-sessionstore03
dashiki-02
mwv-builder-03
images
af-nb-fe
traffic-ncredir
deployment-logstash03
media-streaming
bstorm-nfs-test
maps-wma
cvn-app9
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce