Hello all,
to speed-up the decreasing of the replag of s1 (english wikipedia) on thyme, we will move the user-databases of thyme to rosemary on Wednesday. During the move the user-databases will be read-only. The moving will start at
Wednesday, 12:00 UTC
and will take a unknown time to finish. We will message you when s1 is read/write again.
If you have any question, please send them to the mailing-list.
Sincerely, DaB.
DaB. wrote:
Hello all,
to speed-up the decreasing of the replag of s1 (english wikipedia) on thyme, we will move the user-databases of thyme to rosemary on Wednesday. During the move the user-databases will be read-only. The moving will start at
Wednesday, 12:00 UTC
and will take a unknown time to finish. We will message you when s1 is read/write again.
If you have any question, please send them to the mailing-list.
Hi.
thyme has a number of issues, including possible corruption (cf. https://jira.toolserver.org/browse/TS-1414). Are you planning to re-import enwiki from the master this week? I realize it's a big headache, but if replag could decrease and the corruption could be fixed at the same time, that would be great!
Thanks in advance for your work on this, as always. :-)
MZMcBride
Hello, At Tuesday 14 August 2012 13:17:10 DaB. wrote:
thyme has a number of issues, including possible corruption (cf. https://jira.toolserver.org/browse/TS-1414). Are you planning to re-import enwiki from the master this week? I realize it's a big headache, but if replag could decrease and the corruption could be fixed at the same time, that would be great!
I wrote an eMail to Asher asking for a dump. The problem is not the importing, but to get a fresh dump first. Let us see what happens.
Sincerely, DaB.
Hello,
quick status update: The dumping of the user-databases (and MMP-databases) is done already, the import is running. You can follow the progress under [1].
Below is a list of the top 25 dump-file-size (sizes in bytes). If a database of you is on the list, maybe you can look if you can truncate or drop some old tables when the import is done (if you need all these data, that's fine too of corse).
Sincerely, DaB.
3233476437 u_svick_cleanup.dump.gz 1625001282 u_lvova_golem_s1_en.dump.gz 1264547908 u_mashiah_golem_s1_en.dump.gz 819265680 u_stwalkerster_el.dump.gz 753985677 p_enwp10.dump.gz 538200248 u_daniel.dump.gz 488784920 u_drh08_dbextract.dump.gz 435088422 u_dschwen.dump.gz 391664976 p_dpl_p.dump.gz 362242687 u_catrope.dump.gz 336165718 u_tb.dump.gz 315670740 u_ferschke.dump.gz 216187230 u_dispenser_p.dump.gz 215390437 u_svick_enwiki_page_creators_p.dump.gz 180122285 u_swalker.dump.gz 129716183 u_drh08_dbextract_sample.dump.gz 128496840 u_mzmcbride_enwiki_page_creators_p.dump.gz 122525482 u_qq.dump.gz 95671182 u_dispenser.dump.gz 84671934 u_jason_p.dump.gz 74407504 u_dcoetzee.dump.gz 68616734 u_platonides.dump.gz 56097135 u_mzmcbride_p.dump.gz 53619639 u_nipu.dump.gz 39480676 u_kolossos_yarrow.dump.gz
[1] https://jira.toolserver.org/browse/MNT-1262
On 15 August 2012 16:44, DaB. WP@daniel.baur4.info wrote:
Hello,
quick status update: The dumping of the user-databases (and MMP-databases) is done already, the import is running. You can follow the progress under [1].
Great - thanks all! If this works and kills some of the lag, you'll make a lot of people very relieved :-)
On Wed, Aug 15, 2012 at 5:44 PM, DaB. WP@daniel.baur4.info wrote:
68616734 u_platonides.dump.gz
I seem to have a db in thyme listing the hashes of enwiki images and their size, but I don't remember setting up that thing.
Is it possible that such db belongs to anyone else and got missasigned in some db move?
You don't need to import that, DaB.
Regards
Hello, At Thursday 16 August 2012 13:31:27 DaB. wrote:
Is it possible that such db belongs to anyone else and got missasigned in some db move?
You don't need to import that, DaB.
I can not guarantee that there wasn't a mistake somewhen in the past, but I doubt it. But I would say we solve it in the practical way: Just drop what you don't need :-) (if somebody would miss it, he/she would have already tell us, wouldn't he/she?)
Sincerely, DaB.
On Thu, Aug 16, 2012 at 1:33 PM, DaB. WP@daniel.baur4.info wrote:
Hello, At Thursday 16 August 2012 13:31:27 DaB. wrote:
Is it possible that such db belongs to anyone else and got missasigned in some db move?
You don't need to import that, DaB.
I can not guarantee that there wasn't a mistake somewhen in the past, but I doubt it. But I would say we solve it in the practical way: Just drop what you don't need :-) (if somebody would miss it, he/she would have already tell us, wouldn't he/she?)
Maybe I created them for some temporary thing, then forget it. Part of the reason of this mail was to see if someone came up saying "those are my tables!"
Tables dropped from rosemary.
Regards
Hello, At Thursday 16 August 2012 13:26:02 DaB. wrote:
We will message you when s1 is read/write again.
The move to rosemary is done now, sql-s1-user is writable again.
For the topic of re-import of s1 on thyme: I am in contact with Asher and we will try a new way for importing (if this success getting new "dumps" in future will be much faster).
Sincerely, DaB.
toolserver-l@lists.wikimedia.org