Wikix: Difference between revisions
wikademia>Jmerkey |
wikademia>Jmerkey No edit summary |
||
| Line 1: | Line 1: | ||
'''Wikix''' is a 'C' based program written by Jeffrey Vernon Merkey that will read any XML dump provided by the foundation, extract all image names from the XML dump which it may reference, then generate a series of BASH or Bourne Unix style scripts which can be invoked to download all images from Wikipedia Commons and Wikipedia. | '''Wikix''' is a 'C' based program written by Jeffrey Vernon Merkey that will read any XML dump provided by the foundation, extract all image names from the XML dump which it may reference, then generate a series of BASH or Bourne Unix style scripts which can be invoked to download all images from Wikipedia Commons and Wikipedia. | ||
The program relies on Curl, an automated web spyder, to download referenced images. The program will also convert text based utf8 characters into actual utf8 strings for those dumps which may contain | The program relies on Curl, an automated web spyder, to download referenced images. The program will also convert text based utf8 characters into actual utf8 strings for those dumps which may contain improperly formatted names for specific images. The program can be configured to generate 16 parallel scripts which will download all images from Wikipedia. The program includes Jeff Bezanson's utf8 libraries. | ||
On a cable modem, the entire set of Wikipedia images can be downloaded in about 36 hours using this program. | On a cable modem, the entire set of Wikipedia images can be downloaded in about 36 hours using this program. | ||