Using a benchmark target's return value in a column · dotnet/BenchmarkDotNet#784

(22 留言) (29 反應) (0 負責人)C# (11,415 star) (1,054 fork)batch import

help wantedup-for-grabs

描述

I'm writing a deserialization library that is basically taking a file stream and producing a List<T>:

        [Benchmark(Description = "Achievement (WDC1)")]
        public StorageList<WDC1.AchievementEntry> WDC1()
        {
            using (var fs = OpenFile("Achievement.WDC1.db2"))
                return new StorageList<WDC1.AchievementEntry>(fs);
        }

And it goes on for a couple versions.

However, the execution times don't make much sense since they are a measurement of the total amount of entries per file, which changes per version (I have no control over the data). It would make a lot more sense to display the average time needed to load one single element of each version.

I'd love to be able to have an implementation of IColumn that is able to obtain the return value from a benchmark target and work on it.

I have a local project that is basically a dumbed down performance meter but it has its limitations, namely in regards to results output - producing histograms is a chore.

Is there a way to do that, or am I out of luck? By giving the source a quick glance through ILspy, I don't see much.

貢獻者指南

技術棧: csharp
領域: performancetooling
議題類型: feature
難度: 3
預計時間: 1-2 days
活動狀態: stale
清晰度: mostly clear
前置要求: Understanding of BenchmarkDotNet internalsKnowledge of C#
新手友善度: 40
研究方向: Explore the IColumn interface and how return values of benchmark methods are captured. Look at existing column implementations like BaselineCustomColumn to understand the pattern. Check if there's a way to access benchmark target's return value via BenchmarkCase or Descriptor. Consider proposing a new base class for columns that can access return values, and discuss with maintainers.