Keeping track of the performance

まず benchmark/Project.toml の環境と、pull request 82 で参照されている更新済みのベンチマークを確認します。この issue で、リリース向けにベンチマークを繰り返し実行できる方法が引き続き必要かどうかを判断します。完了時には、意図したパフォーマンス結果をリリース間で比較できるようにします。

We have added a few benchmarks and can run them every time a new release is out. This is the first one.
edit in the PR https://github.com/jump-dev/ParametricOptInterface.jl/pull/82 we changed some benchmarks. This is the run with the updated benchmarks

Pkg status:
      Status `C:\Users\guilhermebodin\Documents\Github\ParametricOptInterface1.jl\benchmark\Project.toml`
  [6e4b80f9] BenchmarkTools v1.3.1
  [4076af6c] JuMP v1.0.0
  [b8f27783] MathOptInterface v1.4.0
  [0ce4ce61] ParametricOptInterface v0.3.0

variables on a MOIU.Model.
  227.000 μs (63 allocations: 658.20 KiB)
variables on a POI.Optimizer.
  417.500 μs (137 allocations: 1.01 MiB)
parameters on a POI.Optimizer.
  171.500 μs (100 allocations: 608.34 KiB)
parameters and variables on a POI.Optimizer.
  305.400 μs (158 allocations: 1.16 MiB)
alternating parameters and variables on a POI.Optimizer.
  317.300 μs (152 allocations: 1.00 MiB)
SAF constraint with variables on a MOIU.Model.
  2.940 ms (677 allocations: 31.19 MiB)
SAF constraint with variables on a POI.Optimizer.
  3.270 ms (752 allocations: 31.55 MiB)
SAF constraint with variables and parameters on a POI.Optimizer.
  18.362 ms (4184 allocations: 97.07 MiB)
SQF constraint with variables on a MOIU.Model{Float64}.
  5.178 ms (877 allocations: 46.46 MiB)
SQF constraint with variables on a POI.Optimizer.
  5.891 ms (952 allocations: 46.82 MiB)
SQF constraint with product of variables and parameters on a POI.Optimizer.
  29.708 ms (6112 allocations: 110.91 MiB)
SQF constraint with product of parameters on a POI.Optimizer.
  18.699 ms (3412 allocations: 50.43 MiB)
SAF objective with variables on a MOIU.Model.
  2.478 ms (562 allocations: 31.18 MiB)
SAF objective with variables on a POI.Optimizer.
  2.956 ms (737 allocations: 31.54 MiB)
SAF objective with variables and parameters on a POI.Optimizer.
  20.071 ms (3758 allocations: 89.42 MiB)
SQF objective with variables on a MOIU.Model.
  6.929 ms (762 allocations: 46.45 MiB)
SQF objective with variables on a POI.Optimizer.
  7.418 ms (937 allocations: 46.82 MiB)
SQF objective with product of variables and parameters on a POI.Optimizer.
  24.425 ms (5676 allocations: 110.89 MiB)
SQF objective with product of parameters on a POI.Optimizer.
  17.687 ms (2976 allocations: 50.40 MiB)
Update parameters in SAF constraint with variables and parameters on a POI.Optimizer.
  26.699 ms (4244 allocations: 97.47 MiB)
Update parameters in SAF objective with variables and parameters on a POI.Optimizer.
  39.061 ms (5810 allocations: 93.81 MiB)
Update parameters in SQF constraint with product of variables and parameters on a POI.Optimizer.
  10.178 s (12006793 allocations: 37.68 GiB)
Update parameters in SQF constraint with product of parameters on a POI.Optimizer.
  34.103 ms (3777 allocations: 50.83 MiB)
Update parameters in SQF objective with product of variables and parameters on a POI.Optimizer.
  6.278 s (4456821 allocations: 37.50 GiB)
Update parameters in SQF objective with product of parameters on a POI.Optimizer.
  47.142 ms (5027 allocations: 54.72 MiB)