Wikitech-l May 2008

wikitech-l@lists.wikimedia.org

94 participants
131 discussions

by Brion Vibber

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Added: mfarag (Meno25) - Arabic localization updates pmwx (Viral Gupta) - Purple Numbers extension multichill (Maarten Dammers) - Pywikipediabot stuff dantman (Daniel Friesen) - Title casing alternate branch nicdumz (Nicolas Dumazet) - Pywikipediabot stuff - -- brion vibber (brion @ wikimedia.org) -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.8 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkf/5SAACgkQwRnhpk1wk46OLACeOqs8fjG+WDHz5HpPtbTSOrFT 3ZsAoMFChZYKsEp+rg416924DYZG3YHr =mSe+ -----END PGP SIGNATURE-----

15 years, 11 months

Download titles + word category (E.G. verb/noun/acronym)?

by Azu

Hello There are many different archives available for download from Wikipedia so I am not sure which one to get. Please tell me which one has a list of page titles and category For example Sit-Verb Cat-Noun-Animal Him-Pronoun Dog-Noun-Animal Happy-Adjective Washington-Noun-Place Metallica-Noun-Band What is the URL to the archive that I need to download to get this kind of information? I don't even care what format it is in. XML, CSV, SQL, I don't care which as long as it's parse-able.

15 years, 11 months

Re: [Wikitech-l] [MediaWiki-CVS] SVN: [34543] trunk/phase3/includes/Database.php

by Roan Kattouw

aaron(a)svn.wikimedia.org schreef: > Revision: 34543 > Author: aaron > Date: 2008-05-10 00:48:07 +0000 (Sat, 10 May 2008) > > Log Message: > ----------- > Add a way to do different JOINs with $tables Whoo hoo! This'll make implementing JOINs in the API much easier, and provides a way to combine FORCE INDEX with JOINs, which used to be impossible to do portably. Roan Kattouw (Catrope)

15 years, 11 months

Request to allow Google to search list archives again

by Michael Bimmler

[courtesy copy to foundation-l, though I suggest that discussion, if any, be centralised on wikitech-l] Hi all, the search index for the mailinglist archives was last rebuilt in January. Now, after having made quite a few queries about this here and at other places, I learnt (and obviously had to accept) that rebuilding the search index is quite a resources-consuming process which resulted in crashes. To put it bluntly, I dare suggest from a non-technical POV that the "htdig" (that's the name, isn't it?) experiment has failed. If we can only update our search index every 6 months or so, it is pointless to have it. Instead, I suggest that http://lists.wikimedia.org/robots.txt be modified as to allow Google (and other search engines) to crawl /pipermail/ again. I do not really see the privacy issues of this, nabble, gmane etc. are google-searchable as well and I really don't see the point in barring Google from our own archive. If I am very honest, I do not even remember anymore, why we decided to bar Google from http://lists.wikimedia.org/pipermail. Was it due to privacy concerns? If so, which, and why is lists.wikimedia.orgas an archive different from Nabble/Gmane? Thanks, Michael -- Michael Bimmler mbimmler(a)gmail.com

15 years, 11 months

Re: [Wikitech-l] [MediaWiki-CVS] SVN: [34431] trunk/phase3/includes/api

by Brion Vibber

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 catrope(a)svn.wikimedia.org wrote: > * Removed FORCE INDEX (rc_timestamp) from ApiQueryRecentchanges: it's > nigh impossible to integrate with addJoin() and it doesn't seem to be > necessary anyway (my MySQL instance automatically chooses > rc_timestamp) Got hit by a large rash of filesorts bringing a couple of DB servers to a crawl due to this. Since it's mixed in with a large number of other changes, I just reverted the entire API directory to r34430 for now (in r34527). - -- brion vibber (brion @ wikimedia.org) -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.8 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkgkkmwACgkQwRnhpk1wk44IcACeNrBVBGVSJlntItHlsHFD3Dge bqcAnRAsDGoWWzXml4mfyHJO21vB2eLP =ieh5 -----END PGP SIGNATURE-----

15 years, 11 months

Re: [Wikitech-l] [MediaWiki-CVS] SVN: [34431] trunk/phase3/includes/api

by Bryan Tong Minh

On Thu, May 8, 2008 at 2:33 PM, <catrope(a)svn.wikimedia.org> wrote: > Revision: 34431 > Author: catrope > Date: 2008-05-08 12:33:20 +0000 (Thu, 08 May 2008) > > Log Message: > ----------- > API: > * Added ApiQueryBase::addJoin() which provides a cleaner interface to construct JOIN queries. Behind the scenes this still uses the old, ugly way, but it'll be easy to rewrite when/if the Database class gets its own function for JOINs > * Used addJoin() in query modules where necessary > * Removed FORCE INDEX (rc_timestamp) from ApiQueryRecentchanges: it's nigh impossible to integrate with addJoin() and it doesn't seem to be necessary anyway (my MySQL instance automatically chooses rc_timestamp) > I've heard rumours on #wikimedia-tech that MySQL 4 sometimes chooses the wrong index unless forced. So I don't know whether this actually works. Bryan

15 years, 12 months

Re: [Wikitech-l] [MediaWiki-CVS] SVN: [34388] trunk/phase3/includes/api

by Greg Sabino Mullane

> Revision: 34388 > `ug1`.`ug_user`=`user_id`"; Ugh. Please don't hardcode backticks: not only are they unneeded here, but they horribly break any chance we have of cross-database compatibility. -- Greg Sabino Mullane greg(a)turnstep.com PGP Key: 0x14964AC8 200805071519 http://biglumber.com/x/web?pk=2529DF6AB8F79407E94445B4BC9B906714964AC8

15 years, 12 months

Re: [Wikitech-l] SVN: [34400] trunk/extensions/Cite

by Steve Sanbeg

On Wed, 07 May 2008 21:05:21 +0000, brion wrote: > Revision: 34400 > Author: brion > Date: 2008-05-07 21:05:21 +0000 (Wed, 07 May 2008) > > Log Message: > ----------- > Revert r34398 for now; near-duplicate of existing tag seems a bit odd to me > I thought there was a wide consensus, both on this list and on wikipedia, that a second tag was wanted even if the behavior was identical to ref, just because it's shorter than <ref group=note>. And to me, it seems neater to have two separate tags than to try and overload another behavior into the existing tag, both in the implementation and in avoiding an interface that looks like you could have references in the same group with different types. > Modified Paths: > -------------- > trunk/extensions/Cite/Cite.i18n.php > trunk/extensions/Cite/Cite.php > > Modified: trunk/extensions/Cite/Cite.i18n.php > =================================================================== > --- trunk/extensions/Cite/Cite.i18n.php 2008-05-07 21:02:28 UTC (rev 34399) > +++ trunk/extensions/Cite/Cite.i18n.php 2008-05-07 21:05:21 UTC (rev 34400) > @@ -67,7 +67,6 @@ > # Although I could just use # instead of <li> above and nothing here that > # will break on input that contains linebreaks > 'cite_references_prefix' => '<ol class="references">', > - 'cite_references_prefix_a' => '<ol type="a" class="references">', > 'cite_references_suffix' => '</ol>', > ); > > > Modified: trunk/extensions/Cite/Cite.php > =================================================================== > --- trunk/extensions/Cite/Cite.php 2008-05-07 21:02:28 UTC (rev 34399) > +++ trunk/extensions/Cite/Cite.php 2008-05-07 21:05:21 UTC (rev 34400) > @@ -67,7 +67,7 @@ > * </code> > * > * This works because: > - * * PHP's datastructures are guaranteed to be returned in the > + * * PHP's datastructures are guarenteed to be returned in the > * order that things are inserted into them (unless you mess > * with that) > * * User supplied keys can't be integers, therefore avoiding > @@ -82,7 +82,7 @@ > * > * @var int > */ > - static $mOutCnt = 0; > + var $mOutCnt = 0; > var $mGroupCnt = array(); > > /** > @@ -92,7 +92,7 @@ > * > * @var int > */ > - static $mInCnt = 0; > + var $mInCnt = 0; > > /** > * The backlinks, in order, to pass as $3 to > @@ -282,9 +282,9 @@ > if ( $key === null ) { > // No key > //$this->mRefs[$group][] = $str; > - $this->mRefs[$group][] = array('count'=>-1, 'text'=>$str, 'key'=>++self::$mOutCnt); > + $this->mRefs[$group][] = array('count'=>-1, 'text'=>$str, 'key'=>++$this->mOutCnt); > > - return $this->linkRef( $group, self::$mInCnt++ ); > + return $this->linkRef( $group, $this->mInCnt++ ); > } else if ( is_string( $key ) ) { > // Valid key > if ( ! isset( $this->mRefs[$group][$key] ) || ! is_array( $this->mRefs[$group][$key] ) ) { > @@ -292,10 +292,10 @@ > $this->mRefs[$group][$key] = array( > 'text' => $str, > 'count' => 0, > - 'key' => ++self::$mOutCnt, > + 'key' => ++$this->mOutCnt, > 'number' => ++$this->mGroupCnt[$group] > ); > - self::$mInCnt++; > + $this->mInCnt++; > return > $this->linkRef( > $group, > @@ -373,7 +373,7 @@ > * > * @return string XHTML ready for output > */ > - function referencesFormat($group, $prefix='cite_references_prefix') { > + function referencesFormat($group) { > if (( count( $this->mRefs ) == 0 ) or (empty( $this->mRefs[$group] ) )) > return ''; > > @@ -383,7 +383,7 @@ > foreach ( $this->mRefs[$group] as $k => $v ) > $ent[] = $this->referencesFormatEntry( $k, $v ); > > - $prefix = wfMsgForContentNoTrans( $prefix ); > + $prefix = wfMsgForContentNoTrans( 'cite_references_prefix' ); > $suffix = wfMsgForContentNoTrans( 'cite_references_suffix' ); > $content = implode( "\n", $ent ); > > @@ -516,12 +516,6 @@ > } > } > > - function refCounterString($counter) { > - global $wgContLang; > - return $wgContLang->formatNum($counter); > - } > - > - > /** > * Return an id for use in wikitext output based on a key and > * optionally the number of it, used in <references>, not <ref> > @@ -570,18 +564,19 @@ > * @param int $count The index of the key, used for distinguishing > * multiple occurances of the same key > * @param int $label The label to use for the link, I want to > - * use the same label for all occurances of > + * use the same label for all occourances of > * the same named reference. > * @return string > */ > function linkRef( $group, $key, $count = null, $label = null, $subkey = '' ) { > + global $wgContLang; > return > $this->parse( > wfMsgForContentNoTrans( > 'cite_reference_link', > $this->refKey( $key, $count ), > $this->referencesKey( $key . $subkey ), > - (($group == CITE_DEFAULT_GROUP)?'':"$group ").$this->refCounterString( is_null( $label ) ? ++$this->mGroupCnt[$group] : $label ) > + (($group == CITE_DEFAULT_GROUP)?'':"$group ").$wgContLang->formatNum( is_null( $label ) ? ++$this->mGroupCnt[$group] : $label ) > ) > ); > } > @@ -685,8 +680,8 @@ > */ > function clearState() { > $this->mGroupCnt = array(); > - self::$mOutCnt = -1; > - self::$mInCnt = 0; > + $this->mOutCnt = -1; > + $this->mInCnt = 0; > $this->mRefs = array(); > > return true; > @@ -737,51 +732,7 @@ > /**#@-*/ > } > > - > - > - class Note extends Cite > - { > - > - /** > - * Constructor > - */ > - function Note() { > - $this->setHooks(); > - } > - > - /** > - * Initialize the parser hooks > - */ > - function setHooks() { > - global $wgParser, $wgHooks; > - > - $wgParser->setHook( 'note' , array( &$this, 'ref' ) ); > - $wgParser->setHook( 'footnotes' , array( &$this, 'references' ) ); > - > - $wgHooks['ParserClearState'][] = array( &$this, 'clearState' ); > - } > - > - function refCounterString($counter) { > - return $this->referencesFormatEntryAlternateBacklinkLabel( $counter-1 ); > - } > - > - > - /** > - * Make output to be returned from the references() function > - * > - * @return string XHTML ready for output > - */ > - function referencesFormat($group, $prefix='cite_references_prefix_a') { > - return parent::referencesFormat($group, $prefix); > -} > - > - } > - > - > - > - > new Cite; > - new Note; > } > > /**#@-*/

15 years, 12 months

Re: [Wikitech-l] [MediaWiki-CVS] SVN: [34358] trunk/extensions/CentralAuth

by Brion Vibber

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 tstarling(a)svn.wikimedia.org wrote: > Revision: 34358 > Author: tstarling > Date: 2008-05-07 06:43:58 +0000 (Wed, 07 May 2008) This breaks the site. Overloads the central DB. Reverted. - -- brion -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.8 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkgh7mgACgkQwRnhpk1wk45/SACfXsY3c9JdWINT+1J7lOIRzG5n O4YAnRQ2xUDISSAP2Atx1pzntEfn1K+I =Qbd6 -----END PGP SIGNATURE-----

15 years, 12 months

Re: [Wikitech-l] [MediaWiki-CVS] SVN: [34405] trunk/phase3/includes/DatabaseSqlite.php

by Brion Vibber

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 nad(a)svn.wikimedia.org wrote: > Add SQLite database class Cool! :D Couple notes after a quick pass over it... > + if ("$wgSQLiteDataDir" == '') $wgSQLiteDataDir = dirname($_SERVER['DOCUMENT_ROOT']).'/data'; > + if (!is_dir($wgSQLiteDataDir)) mkdir($wgSQLiteDataDir,0700); This default sounds a bit insecure, as the raw database files would be exposed to the web unless PHP's running as a different user from the static web server. That means deleted data, user email-addresses, password hashes, etc would be exposed to download. > + /** > + * Use MySQL's naming (accounts for prefix etc) but remove surrounding backticks > + */ > + function tableName($name) { > + $t = parent::tableName($name); > + if (!empty($t)) $t = substr($t,1,-1); I believe this will produce bad output for anything using an explicit DB, eg `dbname`.`prefix_table`. Dunno whether that'd actually work here anyway, though. :) - -- brion vibber (brion @ wikimedia.org) -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.8 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkgiQRsACgkQwRnhpk1wk45EZQCg0OKYyarZJ7lTXgqn28W9/YHU 4ZQAniCaE+x+dNhh6E8kV+sIj2LsKv9u =Wd1O -----END PGP SIGNATURE-----

15 years, 12 months

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l May 2008