Wikitech-l December 2010

wikitech-l@lists.wikimedia.org

95 participants
60 discussions

Re: [Wikitech-l] [Toolserver-l] alternative way to get wikipedia dump while server is down
by Sven Tiffe 04 Dec '10

04 Dec '10

> There is a way to download wikidumps for any project / language, the > data is from early 2009. I will detail the steps as a note for future > reference. > [...] > Next step is either to copy a file using SCP or start your own FTP > server on the EC2 instance and download the files that you need. You > will need to pay a small fee but this is in the range of cents. > > Best, > > Diederik > Thank you for your comprehensive description of accessing the archived data in EC2. Personally, I will consider it to get a dump that way in order to continue working. However, I am curious if there are any news about the regular server. Last update in http://wikitech.wikimedia.org/view/Dataset1 was ten days ago and I wonder how likely it is to fix the server e.g. next week. Is there anybody here on the list who may update the wiki page? Thanks! Sven

2 1

svn access to 1.16wmf4
by Ashar Voultoiz 04 Dec '10

04 Dec '10

Hello, Would it be possible to get commit rights to the 1.16wmf4 ? For now, I would focus on merging revisions for the CodeReview extension, no Core work yet :p cheers, -- Ashar Voultoiz

1 0

Code review comments list
by Roan Kattouw 03 Dec '10

03 Dec '10

Quick note before I go to sleep: with bundled efforts from Casey, Chad, Sam and me, we now have a mailing list that all CodeReview comments are sent to: mediawiki-codereview(a)lists.wikimedia.org [1], requested in bug 22046 [2]. Nice as another stalk list or if you miss knowing what's going on from the old days when commenting on code meant replying to mediawiki-cvs e-mails on wikitech-l. The list is set up so only CodeReview itself can post to it. Replies are set to go to wikitech-l, but of course you should use CR's own commenting mechanism to reply to a comment instead. Just like mediawiki-cvs, this list is not archived. Tim and I are the current list admins. Roan Kattouw (Catrope) [1] https://lists.wikimedia.org/mailman/listinfo/mediawiki-codereview [2] https://bugzilla.wikimedia.org/show_bug.cgi?id=22046

1 0

Donation Interface translation questions
by Niklas Laxström 03 Dec '10

03 Dec '10

There seems to be some unanswered questions regarding translatable messages of donation interface at code review [1]. Could someone look and answer those soon? [1] http://www.mediawiki.org/wiki/Special:Code/MediaWiki/75835 Thanks, -Niklas -- Niklas Laxström

2 1

null revisions
by Dmitriy Sintsov 03 Dec '10

03 Dec '10

Hi! >From looking at DB scheme I cannot find an efficient way of getting the list of null revisions or opposite (no null revisions list). With LIMIT paging (for custom API). When I GROUP then ORDER and LIMIT, it behaves extremly slow. It seems that I should use very inefficient GROUP BY rev_text_id (and also MySQL not offering FIRST / LAST aggregate functions) and also there is no index on rev_text_id by default :-( I wish there was a field like rev_minor_edit but for detection of null revisions, such as these generated by XML import / export. They confuse the logic of my wiki synchronization script. However, even if I were able to persuade to include these features into the scheme, 1.15 which customers use, was already released some time ago, anyway :-( So probably the core patch is the only efficient way to solve my problem? Dmitriy

3 6

Status update on test framework deployment
by Rob Lanphier 02 Dec '10

02 Dec '10

Hi everyone, It's been a while since I've updated the notes from our test framework meetings, so I just did so today: http://www.mediawiki.org/wiki/Meetings/Test_framework The meeting earlier today is here: http://www.mediawiki.org/wiki/Meetings/Test_framework/2010-12-02 Not a lot of context in those, so I'll provide a summary. Markus Glaser has been doing a lot of work over the past month getting the Selenium framework in shape for adding new tests. He also documented what parameters are necessary to run Selenium tests on our test grid, which gives everyone access to many different browsers to test against: http://www.mediawiki.org/wiki/Selenium_Configuration#Sample_configuration_t… Concurrently with that, Nadeesha and Jinseh at Calcey Technologies have been ramping up on the framework, and have a number of tests that Nadeesha will be committing in trunk soon. Our conversation today was brief, and mainly a mundane runthrough of action items. One conversation we did drift into was one about installer testing, after figuring out that that is a weak spot in our coverage right now (as many people refreshing their installs from trunk don't run the installer every time they refresh, and it's one of the big features for the next release of MediaWiki). The framework currently isn't well suited to test prior to the db and everything being set up, so the folks at Calcey are going to spend some time thinking about that. Since we don't have a manual testing plan for the installer, I've put a stub here: http://www.mediawiki.org/wiki/New_installer/Test_plan ...and I've asked Calcey to flesh it out. The idea is that once we all agree on what makes sense to test at all (manually, automated, or otherwise), then we can talk about what makes sense to automate. The installer testing is a plan we've cooked up today, so we haven't even run it past Chad yet, for example (/me waves at Chad). If you'd like to participate in the meetings, let me know. Our IRC meetings obviously require no RSVP (next one is next week, December 9 at 8am PST on #mediawiki), but our voice meetings we'd like you to RSVP for, since they're still kind of a pain to get going (next one is the week after next, December 16 at 8am PST). Rob

1 0

Re: [Wikitech-l] No more syntax errors!
by Chad 02 Dec '10

02 Dec '10

Nope, committers can continue doing what they do. You should only notice a change if you try to commit broken code :) -Chad On Nov 30, 2010 10:34 AM, "Krinkle" <krinklemail(a)gmail.com> wrote: > On Tue, Nov 30, 2010 at 10:19 AM, Chad <innocentkiller(a)gmail.com> > wrote: >> On Tue, Nov 30, 20... if/when this is enabled. Does this require anything from the commiters ? Do I need to install something or run a command in addition to or instead of 'svn commit -m "" ' ? Sounds nice as an additional check :) -- Krinkle _______________________________________________ Wikitech-l mailing list Wikitech-l(a)lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

3 3

Creating a Media handler extension for molecular files ?
by Nicolas Vervelle 01 Dec '10

01 Dec '10

Hello, I am interested in developing an extension for handling molecular files (files containing informations about chemical molecules : atoms, bonds, ...). If I understand correctly it will enable me to display specific informations in the File:... page, like what MediaWiki does for simple images. Something like existing extensions (FlvHandler, OggHandler, PagedTiffHandler, PNGHandler, TimedMediaHandler in SVN trunk for example). I have read several pages on MediaWiki about writing extensions, but they are not very detailed for media handler extensions. I have also written an extension to display and interact with molecules<http://wiki.jmol.org/index.php/Jmol_MediaWiki_Extension>, but I still have several questions on how I can create a handler for molecular files in MediaWiki. Any help or links to some explanations will be appreciated. Molecular files exist in several formats : pdb, cif, mol, xyz, cml, ... Usually they are detected as simple MIME types (either text/plain or application/xml) by MediaWiki and not as more precise types (even if this types exist : chemical/x-pdb, chemical/x-xyz, ...). It seems that to register a Media handler, I have to add an entry to $wgMediaHandlers[] : $wgMediaHandler['text/plain'] = 'MolecularHandler'; Will it be a problem to use such a general MIME type to register the handler ? Especially for files of the same MIME type but that are not molecular files ? Are there some precautions to take into account ? (like letting an other handler deal with the file if it's not a molecular file, ...) I want to use the Jmol <http://www.jmol.org/> applet for displaying the molecule in 3d, and allowing the user to manipulate it. But the applet is about 1M in size, so it takes time to load the first time, then to start and load the molecular file. I would like to start showing a still image (generated on the server) and a button to let the user decide when loading the applet if interested in. Several questions for doing this with MediaWiki : - What hook / event should I use to be able to add this content in the File:... page ? - Is there a way to start displaying the File:... page, compute the still image in the background,and add it in the File:... page after ? - Are there any good practices for doing this kind of things ? Is it also possible to create thumbnails in articles if they include links to a molecular file (like [[File:example.pdb]]) ? What hook should I use ? Is it possible to compute the thumbnail in the background ? Any other advice for writing a media handler extension ? Or other possibilities that could enhance the extension ? Among the few handler extensions in SVN, which is the better example ? Thanks for any help Nico

3 5

Re: [Wikitech-l] [Ticket#2010112810016598] I would like to provide a different search engine for Wikimedia
by Skip Garner 01 Dec '10

01 Dec '10

Dear Wikiteam, Guy Chapman requested that I post to the mailing list to ask how we can proceed to getting a copy of Wikipedia so that we can offer it as a database in our free search service, in response to the request in the following paragraph. He made me aware of its size, but that is not an issue. I would like to obtain a copy and then establish a routine for automated synced downloads like we do for the other databases we have in our system. I have had several requests to add Wikipedia to our eTBLAST text similarity search engine. This is to improve reference finding as well as novelty assessment. Our search tool is widely used, widely published and is free. Please see etblast.org or http://en.wikipedia.org/wiki/ETBLAST. I would like to create a searchable copy of Wikipedia locally with links back to Wikipedia for hits, and of course acknowledge Wikimedia. We do this for several open text datasets and are prepared to keep a local, synced copy of Wikipedia, if you are interested. I am certain that our mutual users would like and benefit from our working together. Cheers, and thank you, Skip ----- Original Message ----- From: "Wikipedia information team" <info-en(a)wikimedia.org> To: "Skip Garner" <garner(a)vbi.vt.edu> Cc: "Dominik L. Borkowski" <dom(a)vbi.vt.edu>, "Johnny Sun" <szhaohui(a)vbi.vt.edu> Sent: Wednesday, December 1, 2010 9:43:25 AM Subject: Re: [Ticket#2010112810016598] I would like to provide a different search engine for Wikimedia Dear Skip Garner, Thank you for your email. Our response follows your message. 11/29/2010 16:23 - Skip Garner wrote: > Guy, > Thank you for the information. I would like to move forward on this, for I think it will be of mutual value. The size of the database is not an issue, and we are always expanding our storage and serving capabilities. We regularly work with data in the 100's of T in size. One issue would be getting the first copy, but we could probably handle that by fed-x. > Can you tell me how we can proceed? > > Cheers, > Skip The best bet is probably to email the wikitech mailing list, which is where the devs hang out. <https://lists.wikimedia.org/mailman/listinfo/wikitech-l> They will have the best idea of the practicalities. Yours sincerely, Guy Chapman -- Wikipedia - http://en.wikipedia.org --- Disclaimer: all mail to this address is answered by volunteers, and responses are not to be considered an official statement of the Wikimedia Foundation. For official correspondence, please contact the Wikimedia Foundation by certified mail at the address listed on http://www.wikimediafoundation.org -- Harold "Skip" Garner Executive Director Virginia Bioinformatics Institute Virginia Tech Washington Street (0477) Blacksburg, VA 24061 http://www.vbi.vt.edu Phone: 540.231.2582 Fax: 540.231.1388 Assistant: Renee Nester renee(a)vbi.vt.edu 540.231.2582

2 1

Re: [Wikitech-l] Commons ZIP file upload for admins
by bawolff 30 Nov '10

30 Nov '10

> Message: 5 > Date: Wed, 24 Nov 2010 15:46:24 -0800 > From: Erik Moeller <erik(a)wikimedia.org> > Subject: Re: [Wikitech-l] Commons ZIP file upload for admins > To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org> > Message-ID: > <AANLkTimD7kXngs4azgPanR_84Ok_th9T1DsANc7stkSh(a)mail.gmail.com> > Content-Type: text/plain; charset=ISO-8859-1 > > [Kicking this thread back to life, full-quoting below only for quick reference.] > > I've collected some additional notes on this here: > http://commons.wikimedia.org/wiki/Commons:Restricted_uploads > > Would appreciate feedback & will circulate further in the Commons community. > > Thanks, > Erik Personally I think it would be nicer if you could associate source files with the final files. Something like: *User uploads jpeg of 3D image (or whatever) *on the image description page for the jpg, there is an upload "source" file link *Users (who have appropriate permissions) can upload the associated source files with this link. *These source files might appear as a subpage of the primary image/document/media, or they might just appear in list form at the bottom of the image description page of the main image/media. Either way, the source files would be associated with a single "main" file. Doing it this way would limit the feature to source files of actually uploaded files (so less random cruft lying around, no orphaned source files, less chance of people abusing the feature to get around file type restrictions). I also personally don't like the idea of uploading archives. Instead I think it would be better just to upload all the source files needed. (although that might fall apart if you're uploading source files for something very complex which has many source files in a specific directory structure). There could also be a download all option where all the source files get tar'ed together on the server side for an easy download. -bawolff

8 14

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l December 2010