add README for benchmarks

Open
#67 7 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
2/5
Estimated time
1-3 hours
Newbie friendliness
35/100
Issue type
Documentation
Clarity
Needs clarification
Activity status
Stale
Tech stack
python

Research direction

Start in Tools/benchmarks and review the benchmark variants and command lines shown in the issue. Add a README that explains how to run these programs and documents the observed differences between the original, static, and static_basic variants, including the relevant -X options; done means the benchmark setup and results are understandable to a new reader.

Written by the indexing model from the issue text.

Description

staticpython

When I build Cinder and run the programs in Tools/benchmarks, the static and static_basic variants seem to be slower than the originals. Am I doing something wrong?

(update: -X jit helps, but full static is only about 15% faster?)

$ ./configure && make
$ cd Tools/benchmarks

$ time ../../python.exe fannkuch.py 5
real	0m6.963s

$ time ../../python.exe fannkuch_static_basic.py 5
real	0m7.500s
$ time ../../python.exe -X install-strict-loader fannkuch_static_basic.py 5
real	0m12.140s
$ time ../../python.exe -X install-strict-loader -X jit fannkuch_static_basic.py 5
real	0m6.988s

$ time ../../python.exe fannkuch_static.py 5
real	1m12.689s
$ time ../../python.exe -X install-strict-loader fannkuch_static.py 5
real	0m55.872s
$ time ../../python.exe -X install-strict-loader -X jit fannkuch_static.py 5
real	0m6.071s
Dominant language
Python
Stars
3.8k
Forks
139
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from facebookincubator/MetaPython

All issues in facebookincubator/MetaPython

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.