Notes on Refactoring Exponential Macros in Common Lisp Or: Multiple @Body Considered Harmful

Citation

Michael Wessel, arXiv:2305.02991, https://doi.org/10.48550/arXiv.2305.02991

Abstract

I recently consulted for a very big Common Lisp project having more than one million lines of code (including comments). Let’s call it “System X” in the following. System X suffered from extremely long compilation times; i.e., a full recompile took about 33:17 minutes on a 3.1 GHz MacBook Pro Intel Core i7 with SSD and 16 GBs of RAM, using ACL 10.1. It turns out that a number of macros were causing an exponential code blowup. With these macros refactored, the system then recompiled in 5:30 minutes – a speedup by a factor of ~ 6. In this experience report, I will first illuminate the problem, and then demonstrate two potential solutions in terms of macro refactoring techniques. These techniques can be applied in related scenarios.

Notes on Refactoring Exponential Macros in Common Lisp Or: Multiple @Body Considered Harmful

Keywords: Common Lisp, Macros, Exponential Code Blowup, Macro Refactor- ing, Very Large Lisp Systems


Read more from SRI

  • An arid, rural Nevada landscape

    Can AI help us find valuable minerals?

    SRI’s machine learning-based geospatial analytics platform, already adopted by the USGS, is poised to make waves in the mining industry.

  • Two students in a computer lab

    Building a lab-to-market pipeline for education

    The SRI-led LEARN Network demonstrates how we can get the best evidence-based educational programs to classrooms and students.

  • Code reflected in a man's eyeglasses

    LLM risks from A to Z

    A new paper from SRI and Brazil’s Instituto Eldorado delivers a comprehensive update on the security risks to large language models.