Commit graph

129 commits

Author SHA1 Message Date
Aaron Schulz
a2ea6116af Fixed some <code> tags for doxygen
Change-Id: I550b8760556e4916ee9b63ee244bbbcb4d926142
2015-04-29 06:01:59 +01:00
jenkins-bot
a576e4066a Merge "Added $wgTrxProfilerLimits and slow query limits" 2015-04-28 08:26:06 +00:00
Aaron Schulz
7ea13643f5 Added $wgTrxProfilerLimits and slow query limits
* Limits are now configurable instead of being hard-coded

Change-Id: I99133586eb82e8e9e84061548c8d1a99695fde5c
2015-04-28 10:18:11 +02:00
Aaron Schulz
9c6721e38e Removed "empty" cache key from JobQueueDB for simplicity
Bug: T91815
Change-Id: I74d3f8257c728f3ec5d223cf8ca5e2f93aceab13
2015-04-27 20:49:35 +00:00
Aaron Schulz
7c821caef5 Added $wgJobSerialCommitThreshold setting
* This is used to avoid lag by certain jobs

Bug: T95501
Change-Id: Id707c9a840fa23d56407e03aaae4e25149a1f906
2015-04-24 11:38:16 -07:00
Aaron Schulz
d834197821 Moved ActiveUsers updates to recent changes jobs
* This avoids writes on view and is more reliable
* Also made the wfWaitForSlaves() there actually work

Bug: T95501
Bug: T92357
Bug: T89027
Change-Id: I0a006fc92a9268feb185c9d88aa04002ea51ecd3
2015-04-22 19:13:37 +00:00
Aaron Schulz
ef23382324 Added max lag comment to JobRunner
Change-Id: I9bb9948190d349d563f65d3e15bf1c6fa0d8adec
2015-04-22 07:45:53 -07:00
Aaron Schulz
05a5ec406d Lowered $maxAllowedLag to 3 in JobRunner
Change-Id: I7cb771c667bac21e9b67069e31c6243d9314dac5
2015-04-22 06:11:25 -07:00
Aaron Schulz
b4b932b5eb Lowered JobRunner lag check interval from 3 => 1 second
Change-Id: I4a2147316a6c43199587bb7b28aeaec2fc252c84
2015-04-21 12:47:35 -07:00
Ori.livneh
787f2dfc36 Revert "Added per-wiki queue stats information"
Creates too many metrics.
This reverts commit 340220080e.

Task: T95913
Change-Id: Ifa478996febcdd6b3687c4cb64b215495514a899
2015-04-20 19:31:03 +00:00
Aaron Schulz
6c9e517a70 Made showJobs.php show claimed jobs too
Change-Id: Ifc5eeff10fdcdbbe4ade7b32e5388fee4eb94bcf
2015-04-17 12:35:39 -07:00
Aaron Schulz
c8d039482b Merge "Avoid using local main page title in JobSpecification" 2015-04-13 22:32:32 +00:00
Aaron Schulz
a68e3c89a9 Avoid using local main page title in JobSpecification
* They may not work well on the wiki that runs the jobs

Bug: T92789
Change-Id: I496974b11bd865ede9dd6d2cd534e0abdd7fa3f7
2015-04-13 15:03:52 -07:00
Aaron Schulz
f7f49dfb00 Made job factory() callers use Title::makeTitle
* The titles are not from user input and this simplifies the code

Change-Id: I067049cca5661b387076f0c28bc0b71d22162a0f
2015-04-13 21:31:29 +00:00
Aaron Schulz
6525642cf2 Made JobRunner avoid slave lag more aggressively
Bug: T95501
Change-Id: Ibba6d2947638a17c86edcdaadf484c7aa45cd1c6
2015-04-10 04:39:29 +00:00
Aaron Schulz
fcb0872e8b Warn when jobs do large DB writes at once
Change-Id: I57e9bb630accd5b262188ab16b17b558cd3a2bc1
2015-04-08 15:47:58 -07:00
Bryan Davis
1195e11a8a Move MWLogger classes to MediaWiki\Logger namespace
Move the MWLogger PSR-3 logging related classes into the
MediaWiki\Logger namespace. Create shim classes to ease migration of
existing MWLoggerFactory usage to the namespaced classes.

Bug: T93406
Change-Id: I359cc81fbd2dcf8937742311dcc7d3dee08747b0
2015-04-03 11:32:24 -07:00
Aaron Schulz
9720c6c410 Made showJobs.php include abandoned jobs in --list
Change-Id: I7ae8dd2470d5e15fd66c6c06f3feb6d70527daa3
2015-03-26 12:17:10 -07:00
Aaron Schulz
83111f29e2 Use ksort() in getDeduplicationInfo for sanity
Change-Id: Id23cc987b3f1e23b35b0eedbfc5c9978774a0ebd
2015-03-19 10:45:39 -07:00
jenkins-bot
4f1067e27e Merge "Removed odd "partitionsNoPush" setting to simplify the code" 2015-03-18 23:06:50 +00:00
jenkins-bot
38f3c96674 Merge "Made JobQueueFederated::supportsDelayedJobs() check all the partition queues" 2015-03-13 06:09:10 +00:00
Aaron Schulz
b480ec3353 Made JobQueueFederated no longer need "checkDelay" for delaying
This reverts commit b9fd0f311c.

Change-Id: Ibff28591c268689d593cb56a58e0b33c22292eba
2015-03-11 11:15:40 -07:00
Aaron Schulz
ce33c484ed Made JobQueueFederated::supportsDelayedJobs() check all the partition queues
Change-Id: Id451faedd6286a84f993fa183e67e0bf35d21c41
2015-03-11 11:10:12 -07:00
Legoktm
b9fd0f311c Revert "Made JobQueueFederated no longer need "checkDelay" for delaying"
Breaks Cirrus and Wikibase

This reverts commit c8f96384aa.

Change-Id: I15278d52806bf30d6ea6c6b9eb8586160f65c42b
2015-03-11 17:10:18 +00:00
Aaron Schulz
c8f96384aa Made JobQueueFederated no longer need "checkDelay" for delaying
* Cleaned up the weird logic for checking if delays are supported

Change-Id: I3a1a78bb48b4950b76f445bf8c27b5868d3dc89c
2015-03-10 15:13:18 -07:00
jenkins-bot
eec1a53036 Merge "Added EnqueueJob class that handles routing jobs to queues" 2015-03-06 20:03:11 +00:00
Aaron Schulz
5085a4b5cf Made wfFindFile/wfLocalFile callers use explicit "latest" flags
* Callers that should not use caches won't
* Aliased the old "bypassCache" param to "latest"

bug: T89184
Change-Id: I9f79e5942ced4ae13ba4de0b4c62908cc746e777
2015-03-06 04:18:50 +00:00
Aaron Schulz
8e3721a2b9 Added EnqueueJob class that handles routing jobs to queues
Bug: T89308
Change-Id: Iadb34f24d8bbe94c0f9f119e530c0bbe1060df0a
2015-03-04 13:55:54 -08:00
jenkins-bot
41253c2122 Merge "Moved some JobQueueAggregator logic out of JobQueueGroup" 2015-03-04 06:16:51 +00:00
Aaron Schulz
6846ff953f Removed odd "partitionsNoPush" setting to simplify the code
* A maintenance script already exist for copying jobs to other queues

Change-Id: Id105e7e60fae4b8a30cda74a45597a2a2e548a91
2015-03-03 22:00:43 -08:00
Aaron Schulz
37042262e3 Moved some JobQueueAggregator logic out of JobQueueGroup
Change-Id: I28ba1a25db225d4cf5f503a6c0f4405f13118151
2015-03-03 21:56:15 -08:00
jenkins-bot
ea3646b476 Merge "Removed overzealous caching from JobQueueFederated" 2015-03-04 05:48:38 +00:00
Chad Horohoe
c33f4de066 Profile all external HTTP requests from MW
Change-Id: Ie980b080da2ef21ec7d9fc32f1accc55710de140
2015-03-03 20:54:30 -08:00
jenkins-bot
74a2757d62 Merge "Removed old HTMLCacheUpdateJob b/c code" 2015-03-03 21:46:50 +00:00
jenkins-bot
5a00a50635 Merge "Removed pointless memcached JobQueueAggregator class" 2015-03-03 20:56:02 +00:00
Aaron Schulz
b15ac8eb48 Removed pointless memcached JobQueueAggregator class
* On a basic/default install there is only a single wiki 
  and nothing uses this. Larger wikis would want to use redis.

Change-Id: Ie5bf1a644ae60b2c6ca72b165fa5510113717611
2015-03-03 20:46:52 +00:00
Aaron Schulz
27decacdd5 Removed old HTMLCacheUpdateJob b/c code
* Also supports simple per-title jobs now

Change-Id: I9c976cdf93b8d1e171988722adc3695935ac43e0
2015-03-03 20:21:00 +00:00
Aaron Schulz
bd649e6566 Made JobRunner bail sooner for bogus job --type parameters
Change-Id: I1259682b8a6543e76f1c9a4d99324b457115a277
2015-03-03 12:20:12 -08:00
Aaron Schulz
32684df25f Moved JobQueueFederated partition exceptions to their own log
Change-Id: If495e9b1a631b587cb3b8d83974837eef1d2d4c6
2015-03-02 11:15:40 -08:00
jenkins-bot
cb4f6e9341 Merge "Removed doCascadeProtectionUpdates method to avoid DB writes on page views" 2015-02-23 01:18:05 +00:00
Aaron Schulz
df5ef8b5d7 Removed doCascadeProtectionUpdates method to avoid DB writes on page views
* Use special prioritized refreshLinksJobs instead, which triggers when
  transcluded pages are changed
* Also added a triggerOpportunisticLinksUpdate() method to handle
  dynamic transcludes

bug: T89389
Change-Id: Iea952d4d2e660b7957eafb5f73fc87fab347dbe7
2015-02-22 13:36:13 -08:00
Marius Hoch
53d0c94c2f Wait for slaves in RecentChangesUpdateJob
Change-Id: Iba8dca2f92d1c9ba2e5ab064aae828e4d88779bb
2015-02-22 22:21:38 +01:00
Aude
2664ccdc43 Revert "Removed doCascadeProtectionUpdates method to avoid DB writes on page views"
due to breakage at least in phpunit tests for mysql:

https://travis-ci.org/wikimedia/mediawiki-extensions-Wikibase/jobs/51490784

This reverts commit 132f7bb89f.

Change-Id: I85d19ab5ad30e8d13a956d7b7467a94c9e73219d
2015-02-20 13:17:41 +00:00
Aaron Schulz
132f7bb89f Removed doCascadeProtectionUpdates method to avoid DB writes on page views
* Use special prioritized refreshLinksJobs instead, which triggers when
  transcluded pages are changed
* Also added a triggerOpportunisticLinksUpdate() method to handle
  dynamic transcludes

bug: T89389
Change-Id: I8e5a6ddb643c12e0fb5c1c68bc83f912944e6e8d
2015-02-20 03:16:18 +00:00
Marius Hoch
2c788bddc0 Flush any implicit transactions in RecentChangesUpdateJob
Bug: T89806
Change-Id: Ibd71966225de3dfb392002fc3fd181b2ff521b9d
2015-02-18 09:44:05 +01:00
Aaron Schulz
d8a12160a2 Removed overzealous caching from JobQueueFederated
Change-Id: Id3a80dc89e5b46d6d95180e73e753b38a476eb36
2015-02-16 14:33:44 -08:00
Aaron Schulz
e3da87e3f2 Removed deprecated RefreshLinksJob2 class
Change-Id: Id5659c7fe0c6ebcbee0ef435ee4a95c1033cda47
2015-02-12 14:19:06 -08:00
Aaron Schulz
867aa23133 Made RecentChangesUpdateJob lock wiki specific
Change-Id: I566d81affcd3d60cd5e8da090db9ea79495e7722
2015-02-11 09:54:34 -08:00
jenkins-bot
23650785ef Merge "Moved RecentChange::purgeExpiredChanges to a job" 2015-02-10 21:32:55 +00:00
Aaron Schulz
f826b15bd2 Only support "daemonized" mode for redis job queues to avoid code duplication
Change-Id: I83bf61734fc48feea8a2f93adfe70f7d3a066b9e
2015-02-10 12:18:13 -08:00