Made some tweaks to the profiling; it can now be set to log only
profiling data (without other debug junk), and to log it only when the
total time spent > X seconds.
Currently logging to /apache/profile/en.profile on larousse. The first
bit will be without any limit; then with 1.0 second limit, then with the
title-parsing code filtered out (always fairly fast, but a lot of them,
it ends up being useless noise), then with a 5.0 second limit.
I noticed also that the user_newtalk table didn't have any index on it,
which may explain why a lot of newtalk check queries were fairly slow. I
added indexes, but they're still sometimes oddly slow.
alter table user_newtalk add key(user_id), add key(user_ip);
Will try to process the data some in a bit...
-- brion vibber (brino @ pobox.com)
This will make you laugh:
> Your membership in the mailing list WikiEN-l has been disabled
> due to excessive bounces The last bounce received from you was
> dated 01-Oct-2003. You will not get any more messages from
> this list until you re-enable your membership. You will
> receive 3 more reminders like this before your membership in
> the list is deleted.
I don't know what that's about, unless I've posted too many times in one
day? It would be ironic if the LIST ADMINISTRATOR himself got deleted
from the mailing list!! ^_^
I'd have to go in, *as administrator*, and re-instate myself.
Ed Poor
Wow, I'm just the bearer of good news today!
The second hard drive on pliny, the one that holds most of the of the
database, has stopped responding.
Log extract attached.
-- brion vibber (brion @ pobox.com)
I've just gotten word that Jason will be going to San Diego tonight to
upgrade the machines! Of course, nothing ever goes wrong with
hardware upgrades, and computers always work, so we can expect to be
fully upgraded and functional very quickly.
Or, reality check, let's all hope for the best. :-)
--Jimbo
Major oddness at:
http://wikimediafoundation.org/
Warning: Cannot modify header information - headers
already sent by (output started at
/usr/local/apache/htdocs-foundation/extract.php:14) in
/usr/local/apache/common/php/DatabaseFunctions.php on
line 85
--mav
__________________________________
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
http://shopping.yahoo.com
Erik, - re: massive fundraising campaign.
Well, I'd be willing to donate a few hundred dollars. Where do I send
it?
I originally applied to become a "Developer" because I hoped I might be
able to do something to speed up the response time. Unfortunately, I
haven't made the effort to wade through all the source code - and last
time I checked, there weren't any Requirements Document or Architectural
Design Document.
I've had quite a bit of experience with client-server programming, and
I've managed to get more speed out of various systems. It's often a
matter of using a profiling tool to identify bottlenecks.
How many hits an hour do we get during primetime?
Ed Poor
When are the servers going to be upgraded? This is
holding up distribution of the press release (we've
already hit the 300,000 figure) since the downtime
associated with the upgrade is not something we want
to present potential news users or donators to. It
would also be nice for them to have responsive page
load times. Either way I would still like to delay the
English press release distribution one week after
non-English distribution.
-- mav
__________________________________
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
http://shopping.yahoo.com
In my quest to squeeze more performance out of the machines as they are
until the hardware upgrades arrive, I tried to upgrade the kernel on
larousse, to 2.4.22 plus a patch for /dev/epoll support, which is highly
recommended for memcached.
I ran a 'make oldconfig' on the config file for the stock kernel and
didn't change any settings. I tried compiling the same kernel version
and config on my Linux box at home (Red Hat 8.0, not quite the same as
Red Hat 9.0 but close) and it boots here just great.
But, alas, larousse didn't come back up. I woke poor Jason up to reboot
it so it should have fallen back to the previous kernel, but it again
never came up, at least not to the network.
Obviously I'm a bit annoyed with myself, but I did take what precautions
I could, and well, desperate times... :(
I don't know if the boot manager is fouled up, or just the kernel, or if
something related the library troubles we had last month reared up again
so it's not getting past init. Hopefully we'll get it sorted out fairly
soon, but in the meantime larousse is offline.
Pliny has taken over its address and is serving www.wikipedia.org for
now. (So, don't be alarmed if you try to login to larousse and get "HOST
IDENFITICATION HAS CHANGED! IT IS POSSIBLE THAT SOMEONE IS DOING
SOMETHING NASTY!" from ssh. Just log in to pliny direct.)
I hate computers! grrr
Good news is, no more www vs en2 functionality troubles! ;)
-- brion vibber (brion @ pobox.com)
I've started merging in memcached support for user/newtalk info,
interwiki prefixes, and the UTF-8 conversion tables into the stable
branch. It's not 100% clean and clear, and I may have to adjust the
server config to get it all running, so _don't_ update the files in
/apache/common/php from stable just yet.
Memcached has to be turned on and shared for both www on pliny and en2
on larousse simultaneously or they could get out of sync.
I'll have another go at it when I'm more awake.
-- brion vibber (brion @ pobox.com)
I wanted to add search of National library of Serbia (http://www.nbs.bg.ac.yu)
to Special:Booksources, but it needs unique ID for every search. I could make
a PHP script that would go around this, would it be included in Wikipedia?