I suspect the problem is somewhere in MediaWiki. If knew where I'd be posting it here.
- I've stripped away other things on the server. Pretty much the only thing left is the most recent version of MediaWiki (1.23.3) and Debian (stable) packages. - I ran 'debsums' to check whether any of the Debian packages are corrupt. - I am not aware of any LAMP bugs in Debian.
The MediaWiki install is near fresh. I did a manual upgrade for version 1.23.1 and then used the patches to get to 1.23.3. The upgrade from 1.23.1 to 1.23.2 had a bug in it-- but I think that was inconsequential. In any case, that upgrade was done July 30, several weeks preceding the problems.
Here is a snippet from 'ps aux': ----- USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND ... www-data 10518 0.0 2.8 291376 57052 ? S 20:39 0:03 /usr/sbin/apache2 -k start www-data 10567 0.0 2.5 288076 51480 ? S 20:42 0:02 /usr/sbin/apache2 -k start www-data 10568 0.0 2.6 290496 54140 ? S 20:42 0:04 /usr/sbin/apache2 -k start www-data 10569 0.0 2.5 288820 51840 ? S 20:42 0:02 /usr/sbin/apache2 -k start www-data 10570 0.0 2.6 291384 53036 ? S 20:42 0:02 /usr/sbin/apache2 -k start www-data 10571 0.0 2.9 293316 58812 ? S 20:42 0:05 /usr/sbin/apache2 -k start www-data 10572 0.0 2.7 290976 55360 ? S 20:42 0:04 /usr/sbin/apache2 -k start www-data 10573 0.0 2.7 290888 55820 ? S 20:42 0:05 /usr/sbin/apache2 -k start www-data 10649 0.0 2.7 290728 54860 ? S 20:53 0:05 /usr/sbin/apache2 -k start www-data 10650 0.0 2.7 293000 55924 ? S 20:53 0:04 /usr/sbin/apache2 -k start ... ----- The memory seems to be going into apache2.
Earlier this morning I rebooted the server. About three hours later the images were gone again. After rebooting this morning... the server has been working okay (so far about 13 hours). I don't understand the cycle: why it breaks in 3 hours... or goes for more than 12.
Some ideas I have: 1. Running a 'diff' of my active server against the tarball for the most recent MediaWiki-- to look for corrupted files.
2. At this point I am thinking about the extensions and doing a fresh install of MediaWiki... with the hope that will resolve things.
3. I have bimonthly images going back a year-- I can dump the database, rollback and grab the latest database changes.
My inclination is to try #2. It isn't that hard to do... if it works I can be pretty sure it was MediaWiki... and it solves the problem I have at the moment.
Any thoughts/ideas are welcome.
Michael
I have written a couple of posts about disappearing images -- links to those posts are at the bottom of this email.
The wiki I am running: ----- Version info ( http://librepathology.org/wiki/index.php/Special:Version ): MediaWiki 1.23.5 PHP 5.4.4-14+deb7u14 (apache2handler) MySQL 5.5.38-0+wheezy1 Lua 5.1.5
$ apt-cache show imagemagick Package: imagemagick Version: 8:6.7.7.10-5+deb7u3 -----
The symptoms: 1. Occasionally, the images the wiki pulled from the WikiCommons (via "InstantCommons") are gone. Pages with images are left with broken links to the files (e.g. "File:Name_of_image") and a 'Category' (automatically) appears at the bottom of the pages (? "Pages with broken links"). When the problem is present, the image pages created when the files were copied from the InstantCommons (e.g. "File:Name_of_image") do not exist.
2. The problem does not happen with an image file ( Atypical_ductal_hyperplasia_-_very_high_mag.jpg ) that is local to the wiki itself, i.e. an image not pulled from the InstantCommons.
3. A server re-boot resolves the issue.
4. The thumbnailing continues to work for the image local to the wiki.
librepathology.org/wiki/thumb.php?f=Atypical_ductal_hyperplasia_-_very_high_mag.jpg&w=200
5. I started caching files on the server for performance reasons. The cached version of the pages display fine, i.e. anonymous (not logged in users) see the images (in the cached files). The logged in users (when the problem is present) do not see the (InstantCommons) images.
6. The memory status of the server (when the problem is present) seems to be fine. Several times when the problem is present physical memory was still available according to the command 'top'.
7. I see no obvious association with server load.
Things I have tried: 1. Fresh install of 'MediaWiki'. 2. 'diff' comparison between the active (installed) mediawiki and a fresh download of mediawiki. (No significant differences found.) 2. Upgrading the server's RAM 1 GB to 2 GB 3. Ran 'debsums' (to look for corrupt files) php/apache2/mysql/operating system files 4. Looked for bug report in the LAMP stack (Debian GNU/Linux). 5. Increased "memory_limit" variable in "php.ini" (/etc/php5/apache2/php.ini) to '256M' from '128M'. 6. Increased '$wgMaxShellMemory' to '512000'. (I wonder if this is making the loading of the pages more sluggish.)
The problem started in late August and I cannot temporally associate it with any particular change. I rolled back a number of changes I made in August and the intermittent problem reoccurred.
The wiki is on a virtual server... I can access all the logs. I am happy to take suggestions on where to look... or tests I could do.
Unfortunately, I cannot reproduce the problem. I don't really have an idea what triggers it.
Some of the previous messages -- https://lists.wikimedia.org/pipermail/mediawiki-l/2014-September/043292.html https://lists.wikimedia.org/pipermail/mediawiki-l/2014-September/043294.html https://lists.wikimedia.org/pipermail/mediawiki-l/2014-September/043340.html
Thanks, Michael
I'm having the same error
https://www.mediawiki.org/wiki/Thread:Project:Support_desk/Thumbnail_errors
*Mlpearc* Founder Everything Food & Drink.org everythingfoodanddrink.org http://www.everythingfoodanddrink.org/w/index.php/Main_Page
On Wed, Oct 15, 2014 at 10:58 PM, Dr. Michael Bonert < michael@librepathology.org> wrote:
I have written a couple of posts about disappearing images -- links to those posts are at the bottom of this email.
The wiki I am running:
Version info ( http://librepathology.org/wiki/index.php/Special:Version ): MediaWiki 1.23.5 PHP 5.4.4-14+deb7u14 (apache2handler) MySQL 5.5.38-0+wheezy1 Lua 5.1.5
$ apt-cache show imagemagick Package: imagemagick Version: 8:6.7.7.10-5+deb7u3
The symptoms:
- Occasionally, the images the wiki pulled from the WikiCommons
(via "InstantCommons") are gone. Pages with images are left with broken links to the files (e.g. "File:Name_of_image") and a 'Category' (automatically) appears at the bottom of the pages (? "Pages with broken links"). When the problem is present, the image pages created when the files were copied from the InstantCommons (e.g. "File:Name_of_image") do not exist.
- The problem does not happen with an image file (
Atypical_ductal_hyperplasia_-_very_high_mag.jpg ) that is local to the wiki itself, i.e. an image not pulled from the InstantCommons.
A server re-boot resolves the issue.
The thumbnailing continues to work for the image local to the wiki. librepathology.org/wiki/thumb.php?f=Atypical_ductal_
hyperplasia_-_very_high_mag.jpg&w=200
- I started caching files on the server for performance reasons. The
cached version of the pages display fine, i.e. anonymous (not logged in users) see the images (in the cached files). The logged in users (when the problem is present) do not see the (InstantCommons) images.
- The memory status of the server (when the problem is present) seems to
be fine. Several times when the problem is present physical memory was still available according to the command 'top'.
- I see no obvious association with server load.
Things I have tried:
- Fresh install of 'MediaWiki'.
- 'diff' comparison between the active (installed) mediawiki and a fresh
download of mediawiki. (No significant differences found.) 2. Upgrading the server's RAM 1 GB to 2 GB 3. Ran 'debsums' (to look for corrupt files) php/apache2/mysql/operating system files 4. Looked for bug report in the LAMP stack (Debian GNU/Linux). 5. Increased "memory_limit" variable in "php.ini" (/etc/php5/apache2/php.ini) to '256M' from '128M'. 6. Increased '$wgMaxShellMemory' to '512000'. (I wonder if this is making the loading of the pages more sluggish.)
The problem started in late August and I cannot temporally associate it with any particular change. I rolled back a number of changes I made in August and the intermittent problem reoccurred.
The wiki is on a virtual server... I can access all the logs. I am happy to take suggestions on where to look... or tests I could do.
Unfortunately, I cannot reproduce the problem. I don't really have an idea what triggers it.
Some of the previous messages -- https://lists.wikimedia.org/pipermail/mediawiki-l/2014- September/043292.html https://lists.wikimedia.org/pipermail/mediawiki-l/2014- September/043294.html https://lists.wikimedia.org/pipermail/mediawiki-l/2014- September/043340.html
Thanks, Michael
MediaWiki-l mailing list To unsubscribe, go to: https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
Make sure that all your /images directories and their sub directories are set to at least permission 775 & may require that the owner is the webserver Apache, inginex, etc owner. mediawiki needs to be able to write the thumbnails to the server via the web server. At least that help me with a similar issue.
On 10/16/2014 12:58 AM, Dr. Michael Bonert wrote:
I have written a couple of posts about disappearing images -- links to those posts are at the bottom of this email.
The wiki I am running:
Version info ( http://librepathology.org/wiki/index.php/Special:Version ): MediaWiki 1.23.5 PHP 5.4.4-14+deb7u14 (apache2handler) MySQL 5.5.38-0+wheezy1 Lua 5.1.5
$ apt-cache show imagemagick Package: imagemagick Version: 8:6.7.7.10-5+deb7u3
The symptoms:
- Occasionally, the images the wiki pulled from the WikiCommons
(via "InstantCommons") are gone. Pages with images are left with broken links to the files (e.g. "File:Name_of_image") and a 'Category' (automatically) appears at the bottom of the pages (? "Pages with broken links"). When the problem is present, the image pages created when the files were copied from the InstantCommons (e.g. "File:Name_of_image") do not exist.
- The problem does not happen with an image file (
Atypical_ductal_hyperplasia_-_very_high_mag.jpg ) that is local to the wiki itself, i.e. an image not pulled from the InstantCommons.
A server re-boot resolves the issue.
The thumbnailing continues to work for the image local to the wiki.
librepathology.org/wiki/thumb.php?f=Atypical_ductal_hyperplasia_-_very_high_mag.jpg&w=200
- I started caching files on the server for performance reasons. The
cached version of the pages display fine, i.e. anonymous (not logged in users) see the images (in the cached files). The logged in users (when the problem is present) do not see the (InstantCommons) images.
- The memory status of the server (when the problem is present) seems
to be fine. Several times when the problem is present physical memory was still available according to the command 'top'.
- I see no obvious association with server load.
Things I have tried:
- Fresh install of 'MediaWiki'.
- 'diff' comparison between the active (installed) mediawiki and a
fresh download of mediawiki. (No significant differences found.) 2. Upgrading the server's RAM 1 GB to 2 GB 3. Ran 'debsums' (to look for corrupt files) php/apache2/mysql/operating system files 4. Looked for bug report in the LAMP stack (Debian GNU/Linux). 5. Increased "memory_limit" variable in "php.ini" (/etc/php5/apache2/php.ini) to '256M' from '128M'. 6. Increased '$wgMaxShellMemory' to '512000'. (I wonder if this is making the loading of the pages more sluggish.)
The problem started in late August and I cannot temporally associate it with any particular change. I rolled back a number of changes I made in August and the intermittent problem reoccurred.
The wiki is on a virtual server... I can access all the logs. I am happy to take suggestions on where to look... or tests I could do.
Unfortunately, I cannot reproduce the problem. I don't really have an idea what triggers it.
Some of the previous messages -- https://lists.wikimedia.org/pipermail/mediawiki-l/2014-September/043292.html
https://lists.wikimedia.org/pipermail/mediawiki-l/2014-September/043294.html
https://lists.wikimedia.org/pipermail/mediawiki-l/2014-September/043340.html
Thanks, Michael
MediaWiki-l mailing list To unsubscribe, go to: https://lists.wikimedia.org/mailman/listinfo/mediawiki-l
mediawiki-l@lists.wikimedia.org