Jump to content

Wikix

From IdeaWazaWiki
Revision as of 20:06, 24 April 2007 by wikademia>Jmerkey (New page: '''Wikix''' is a 'C' based program that will read any XML dump provided by the foundation, extract all image names from the XML dump which it may reference, then generate a series of BASH ...)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Wikix is a 'C' based program that will read any XML dump provided by the foundation, extract all image names from the XML dump which it may reference, then generate a series of BASH or Bourne Unix style scripts which can be invoked to download all images from Wikipedia Commons and Wikipedia.

The program relies on Curl, an automated web spyder, to download referenced images. The program will also convert text based utf8 characters into actual utf8 strings for those dumps which may contain imporperly formatted names for specific images. The program can be configured to generate 16 parallel scripts which will download all images from Wikipedia.

On a cable modem, the entire set of Wikipedia images can be downloaded in about 36 hours using this program.


Source Code