Validation of experimental results from papers
We have been developing a common methodology and tools to support open, collaborative, reproducible and reusable research since 2008!
About Artifacts Committee Submission Reviewing FAQ Prior AE
Important Dates
Paper decision: 15 November 2018
Artifact submission: 23 November 2018
Artifact notification: 20 December 2018
Camera-ready paper: 4 January 2019

PPoPP'19 AE Chairs
Flavio Vella (Free University of Bozen-Bolzano)
Grigori Fursin (dividiti/cTuning foundation)

PPoPP'19 AE Committee
View

Artifact Evaluation for PPoPP 2019

[ Back to PPoPP 2019 conference website ]


Artifact evaluation is over - see accepted artifacts here !

News: We received a record number of artifacts for evaluation: 20 out of 29 papers! Some artifacts even require an access to a supercomputer! A great motivation for our experiment automation initiative (see recent SCC18 example)!

Authors of accepted papers are invited to formally submit their supporting materials to the Artifact Evaluation process (AE). AE is run by a separate committee whose task is to assess how submitted artifacts support the work described in accepted papers while reproducing at least some experiments. This submission is voluntary and will not influence the final decision regarding the papers.

Prepare your submission and Artifact Appendix using the following guidelines and register it at the PPoPP AE website. Your submission will be then reviewed according to the following guidelines. Please, do not forget to provide a list of hardware, software, benchmark and data set dependencies in your artifact abstract - this is essential to find appropriate evaluators!

The papers that successfully go through AE will receive a set of ACM badges of approval printed on the papers themselves and available as meta information in the ACM Digital Library (it is now possible to search for papers with specific badges in ACM DL). Authors of such papers will have an option to include Artifact Appendix to the final paper (up to 2 pages).

If you have questions, please check AE FAQs, get in touch with the AE chairs, contact steering committee, or join AE google group.

Maintained by the cTuning foundation
Grigori Fursin and volunteers!
          
Powered by Collective Knowledge
           Share           
  
  
  
           Visitors