Copyright Notice:

The documents distributed by this server have been provided by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Publications of SPCL

S. Matsuoka, J. Domke, M. Wahib, A. Drozd, T. Hoefler:

 Myths and Legends in High-Performance Computing

(The International Journal of High Performance Computing Applications. Vol 37, Nr. 3-4, pages 245-259, SAGE Publications, Jul. 2023)

Publisher Reference

Abstract

In this thought-provoking article, we discuss certain myths and legends that are folklore among members of the high-performance computing community. We gathered these myths from conversations at conferences and meetings, product advertisements, papers, and other communications such as tweets, blogs, and news articles within and beyond our community. We believe they represent the zeitgeist of the current era of massive change, driven by the end of many scaling laws such as Dennard scaling and Moore's law. While some laws end, new directions are emerging, such as algorithmic scaling or novel architecture research. Nevertheless, these myths are rarely based on scientific facts, but rather on some evidence or argumentation. In fact, we believe that this is the very reason for the existence of many myths and why they cannot be answered clearly. While it feels like there should be clear answers for each, some may remain endless philosophical debates, such as whether Beethoven was better than Mozart. We would like to see our collection of myths as a discussion of possible new directions for research and industry investment.

Documents

download article:
access preprint on arxiv:
 

BibTeX

@article{matsuoka2023myths,
  author={Satoshi Matsuoka and Jens Domke and Mohamed Wahib and Aleksandr Drozd and Torsten Hoefler},
  title={{Myths and Legends in High-Performance Computing}},
  journal={The International Journal of High Performance Computing Applications},
  year={2023},
  month={7},
  pages={245-259},
  volume={37},
  number={3-4},
  publisher={SAGE Publications},
  doi={10.1177/10943420231166608},
}