Skip to main content

Cross-Language Compiler Benchmarking: Are We Fast Yet?

Marr, Stefan, Daloze, Benoit, Mössenböck, Hanspeter (2016) Cross-Language Compiler Benchmarking: Are We Fast Yet? In: ACM SIGPLAN Notices. DLS 2016 Proceedings of the 12th Symposium on Dynamic Languages. 52 (2). pp. 120-131. ACM ISBN 978-1-4503-4445-6. (doi:10.1145/2989225.2989232) (KAR id:63815)

PDF Author's Accepted Manuscript
Language: English
Download (273kB)
[thumbnail of dls16-marr-et-al-cross-language-compiler-benchmarking-are-we-fast-yet.pdf]
This file may not be suitable for users of assistive technology.
Request an accessible format
Official URL:


Comparing the performance of programming languages is difficult because they differ in many aspects including preferred programming abstractions, available frameworks, and their runtime systems. Nonetheless, the question about relative performance comes up repeatedly in the research community, industry, and wider audience of enthusiasts. This paper presents 14 benchmarks and a novel methodology to assess the compiler effectiveness across language implementations. Using a set of common language abstractions, the benchmarks are implemented in Java, JavaScript, Ruby, Crystal, Newspeak, and Smalltalk. We show that the benchmarks exhibit a wide range of characteristics using language-agnostic metrics. Using four different languages on top of the same compiler, we show that the benchmarks perform similarly and therefore allow for a comparison of compiler effectiveness across languages. Based on anecdotes, we argue that these benchmarks help language implementers to identify performance bugs and optimization potential by comparing to other language implementations.

Item Type: Conference or workshop item (Proceeding)
DOI/Identification number: 10.1145/2989225.2989232
Divisions: Divisions > Division of Computing, Engineering and Mathematical Sciences > School of Computing
Depositing User: Stefan Marr
Date Deposited: 08 Nov 2017 22:29 UTC
Last Modified: 09 Dec 2022 00:46 UTC
Resource URI: (The current URI for this page, for reference purposes)
Marr, Stefan:
  • Depositors only (login required):


Downloads per month over past year