markjgsmith

Linkblog

Indexing all of Wikipedia, on a laptop - Out of all the talk of using publically available data for AI training and copyright etc, suprisingly this is the first time I've heard mention using Wikipedia. Most of this is over my head, it's just interesting it can be done on a personal laptop. You need Linux, lots of storage space (~190GB) and lots of ram (~28GB). foojay.io #

For enquiries about my consulting, development, training and writing services, aswell as sponsorship opportunities contact me directly via email. More details about me here.