Commit graph

34 commits

Author SHA1 Message Date
Benjamin Lees
02e4701b82 (bug 19289) importDump.php can now handle bzip2 and 7zip.
I split out our 7zip stream wrapper into its own file, 7zip.inc.
2009-08-07 00:53:21 +00:00
Chad Horohoe
567f244e36 Revert r54244 which was stupid and fix this properly. Require commandLine.inc/Maintenance.php using the full path every time. 2009-08-03 21:56:41 +00:00
Brion Vibber
7901baa10b Fix a silly bug that isn't the mystery dump bug we were looking for, but could result in infinite loop during text pass if it fails just at the right time. 2009-05-06 23:47:31 +00:00
Chad Horohoe
be374a912a War on wfElement() and friends. Call the Xml members directly, rather than using old wrappers. 2008-12-14 19:14:21 +00:00
Tim Starling
1daa0dc318 Don't break vim syntax highlighting 2008-06-04 01:48:25 +00:00
Alexandre Emsenhuber
087a9f70c5 WARNING: HUGE COMMIT
Doxygen documentation update:
* Changed alls @addtogroup to @ingroup. @addtogroup adds the comment to the group description, but doesn't add the file, class, function, ... to the group like @ingroup does. See for example http://svn.wikimedia.org/doc/group__SpecialPage.html where it's impossible to see related files, classes, ... that should belong to that group.
* Added @file to file description, it seems that it should be explicitely decalred for file descriptions, otherwise doxygen will think that the comment document the first class, variabled, function, ... that is in that file.
* Removed some empty comments
* Removed some ?>

Added following groups:
* ExternalStorage
* JobQueue
* MaintenanceLanguage

One more thing: there are still a lot of warnings when generating the doc.
2008-05-20 17:13:28 +00:00
Brion Vibber
30420e6ffd tweak paths more 2008-01-08 23:58:16 +00:00
Brion Vibber
01aa30f1a1 fix include path regressions with text prefetch 2008-01-08 23:53:20 +00:00
Brion Vibber
60c13d2853 * (bug 12184) Exceptions now sent to stderr instead of stdout for command-line
scripts, making for cleaner reporting during batch jobs. PHP errors will also
  be redirected in most cases on PHP 5.2.4 and later, switching 'display_errors'
  to 'stderr' at runtime.
2007-12-06 21:07:49 +00:00
Brion Vibber
54fa21ca82 Do text normalization in dumpTextPass rather than fetchText, to ensure that the force-loaded ICU plugin will be used in the parent process. 2007-11-20 17:34:42 +00:00
Brion Vibber
48f14d8955 Initial implementation of restartable subprocess for text fetching in dumpTextPass.php 2007-11-20 12:58:34 +00:00
Brion Vibber
24cc59f3b9 Quick fix for dump problem:
Errors are ignored on a connection once it's died, so additional exceptions weren't getting thrown.
We weren't detecting this case and ended up spitting out the rest of the XML without any more text.
Should now die correctly once the timeouts finish.
2007-08-02 04:15:30 +00:00
Aryeh Gregor
a15c419b3d Remove ?>'s from files. They're pointless, and just asking for people to mess with the files and add trailing whitespace. (Yes, I looked over every one and reverted those that were bogus. Slash-enter a million times in less worked well enough, although it was a bit mind-numbing.) 2007-06-29 01:19:14 +00:00
Brion Vibber
72a4abe588 * Skip additional setting of include_path in commandLine.inc (for non-Wikimedia mode)
* Fix some scripts that assumed include_path was set with various additional directories
Stuff now seems to mostly work when not overriding include_path.
Taking that out of LocalSettings is the next step... whee!
2007-06-06 16:01:14 +00:00
Brion Vibber
3caa998c8c prettify:
* set_timeout() -> setTimeout()
* remove a couple obsolete references from dump code
2007-03-09 15:26:41 +00:00
Antoine Musso
c771fc9c96 Use Doxygen @addtogroup instead of phpdoc @package && @subpackage 2007-01-20 15:09:52 +00:00
Tim Starling
e174a4ddfb Abolished $wgDBname as a unique wiki identifier, it doesn't work with the new-fangled feature we call "table prefixes". Instead use wfWikiID() for an identifier containing the DB name and the prefix if there is one, and wfMemcKey() for cache key construction.
Caches for wikis with table prefixes will be lost on upgrade, caches for wikis without table prefixes will be preserved. Custom cache keys in extensions can be migrated at leisure. Extensions which write to core cache keys should be migrated ASAP, as I have done with Special:Makesysop.
2006-10-04 09:06:18 +00:00
Tim Starling
3005679b0e * Removed lots of explicit require_once statements. The autoloader should theoretically be faster, because it always uses an absolute path, eliminating the need for a search, and it is never called unnecessarily. Absolute paths are also more robust in the face of odd configurations or usage patterns. Moved a few constants around to support this, they always have to be available before the method call.
* Deleted DatabaseMysql.php, no longer necessary, database classes are autoloaded. 
* Moved wfGetMimeMagic() to MimeMagic::singleton()
* Fixed a couple of __CLASS__.'::'.__FUNCTION__ things.
2006-10-03 13:00:52 +00:00
Brion Vibber
3f76e12ffb * Try to reconnect after transitory database errors in dumpTextPass.php 2006-09-27 19:48:50 +00:00
Brion Vibber
aa3aab547d * dumpTextPass can now use 7zip files for prefetch 2006-05-12 11:14:40 +00:00
Brion Vibber
f8e629a6ea * dumpTextPass progress includes percentage of items prefetched 2006-05-12 08:50:14 +00:00
Brion Vibber
f05b857c4f * dumpTextPass now skips goes to database for entries that were blank in the
previous dump, as this may indicate a broken dump.
2006-05-11 22:56:19 +00:00
Brion Vibber
f2c29baf9f Update the FSF's address in all these GPL stub headers 2006-04-05 07:43:17 +00:00
Brion Vibber
ae741e3ec7 * Fix --report interval option for dumpTextPass 2006-02-19 23:00:00 +00:00
Brion Vibber
67736735bf * Use revision rate for ETA in dump generation; it tends to be more stable
than the per-page count for full-history dumps.
2006-01-26 08:06:05 +00:00
Brion Vibber
8c63b503b1 some more die-with-proper-return-code 2006-01-14 08:04:38 +00:00
Brion Vibber
92724d269e * Allow input of the stub from a compressed file instead of stdin
for dumpTextPass.php; easier to get errors back on the shell
2006-01-14 05:46:48 +00:00
Ævar Arnfjörð Bjarmason
a26d5a49d7 * s~\t+$~~ 2006-01-07 13:31:29 +00:00
Ævar Arnfjörð Bjarmason
7bbe971aec * s~ +$~~ 2006-01-07 13:09:30 +00:00
Brion Vibber
82c5f3e84c * Fixed --server override on dumpTextPass.php 2005-12-13 22:26:15 +00:00
Brion Vibber
e8cdf678de Fixlet for two-pass dump: strip carriage returns to normalize newlines. 2005-10-19 20:51:01 +00:00
Brion Vibber
189d24ef2d Test case files and fixes for text-prefetch two-and-a-half-pass dump.
Will want to test a little more before making another dump. :P
2005-10-19 00:05:22 +00:00
Brion Vibber
b393b81d97 Support using gzip and bzip2 decompression wrappers on the prefetch XML
source (--prefix=bzip2:foo.xml.bz2)
2005-10-16 23:34:20 +00:00
Brion Vibber
ee372c3951 * Two-pass data dump for friendliness to the DB (--stub, then dumpTextPass.php)
* Data dump 'prefetch' mode to read normalized text from a prior dump
  (requires PHP 5, XMLReader extension)
Maybe these will keep dammit from killing our dump runs...
2005-10-16 17:33:41 +00:00