Parallelizing Quickref

From LRDE

Abstract

Quickref is a global documentation project for Common Lisp software. It builds a website containing reference manuals for Quicklisp libraries. Each library is first compiledloaded, and introspected. From the collected information, a Texinfo file is generated, which is then processed into an HTML one. Because of the large number of libraries in Quicklisp, doing this sequentially may require several hours of processing. We report on our experiments in parallelizing Quickref. Experimental data on the morphology of Quicklisp libraries has been collected. Based on this data, we are able to propose a number of parallelization schemes that reduce the total processing time by a factor of 3.8 to 4.5, depending on the exact situation.

Documents

Bibtex (lrde.bib)

@InProceedings{	  verna.19.els,
  author	= {Didier Verna},
  title		= {Parallelizing Quickref},
  booktitle	= {12th European Lisp Symposium},
  year		= 2019,
  month		= apr,
  address	= {Genova, Italy},
  isbn		= 9782955747438,
  doi		= {10.5281/zenodo.2632534},
  pages		= {89-96},
  abstract	= {Quickref is a global documentation project for Common Lisp
		  software. It builds a website containing reference manuals
		  for Quicklisp libraries. Each library is first compiled,
		  loaded, and introspected. From the collected information, a
		  Texinfo file is generated, which is then processed into an
		  HTML one. Because of the large number of libraries in
		  Quicklisp, doing this sequentially may require several
		  hours of processing. We report on our experiments in
		  parallelizing Quickref. Experimental data on the morphology
		  of Quicklisp libraries has been collected. Based on this
		  data, we are able to propose a number of parallelization
		  schemes that reduce the total processing time by a factor
		  of 3.8 to 4.5, depending on the exact situation.}
}