Skip to main content

Cross-Language Compiler Benchmarking: Are We Fast Yet?

Marr, Stefan, Daloze, Benoit, Mössenböck, Hanspeter (2016) Cross-Language Compiler Benchmarking: Are We Fast Yet? In: ACM SIGPLAN Notices. DLS 2016 Proceedings of the 12th Symposium on Dynamic Languages. 52 (2). pp. 120-131. ACM ISBN 978-1-4503-4445-6. (doi:10.1145/2989225.2989232)

PDF - Author's Accepted Manuscript
Download (242kB) Preview
[img]
Preview
Official URL
http://doi.org/10.1145/2989225.2989232

Abstract

Comparing the performance of programming languages is difficult because they differ in many aspects including preferred programming abstractions, available frameworks, and their runtime systems. Nonetheless, the question about relative performance comes up repeatedly in the research community, industry, and wider audience of enthusiasts. This paper presents 14 benchmarks and a novel methodology to assess the compiler effectiveness across language implementations. Using a set of common language abstractions, the benchmarks are implemented in Java, JavaScript, Ruby, Crystal, Newspeak, and Smalltalk. We show that the benchmarks exhibit a wide range of characteristics using language-agnostic metrics. Using four different languages on top of the same compiler, we show that the benchmarks perform similarly and therefore allow for a comparison of compiler effectiveness across languages. Based on anecdotes, we argue that these benchmarks help language implementers to identify performance bugs and optimization potential by comparing to other language implementations.

Item Type: Conference or workshop item (Proceeding)
DOI/Identification number: 10.1145/2989225.2989232
Divisions: Faculties > Sciences > School of Computing
Depositing User: Stefan Marr
Date Deposited: 08 Nov 2017 22:29 UTC
Last Modified: 29 May 2019 19:38 UTC
Resource URI: https://kar.kent.ac.uk/id/eprint/63815 (The current URI for this page, for reference purposes)
Marr, Stefan: https://orcid.org/0000-0001-9059-5180
  • Depositors only (login required):

Downloads

Downloads per month over past year