microsoft/restler-fuzzer

[Feature Request] improve reporting for missing/incorrect examples

開放

#588 建立於 2022年7月26日

 (1 則留言) (1 個反應) (1 位負責人)Python (329 個分叉)auto 404
help wanted

倉庫指標

星標
 (2,929 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

💡 Idea

Today, RESTler does not provide detailed diagnostics on which request types do not have associated examples or which examples did not match the schema of the spec (and hence were only partially used / may contain errors). This is useful to have in order to more quickly fix examples to improve coverage.

Design Notes

One way to improve this is for the compiler to produce an output file with any detected problems in examples, which would contain this information. For example, as a starting point the file could simply include requests which do not contain examples and for which examples do not match the schema.

{
  "/customer": {
    "post": {   
           "examples": {  
              "first example": {
                  "matches_schema": false
              }    
          }    
        }
   },
  "/customer/{id}": {
     "get": {
         "examples": {}
     }
  }
}

貢獻者指南