trailofbits/manticore

Add the logic bomb examples to test manticore

Open

#1487 opened on Jul 15, 2019

View on GitHub
 (2 comments) (0 reactions) (0 assignees)Python (3,469 stars) (481 forks)batch import
Hacktoberfestchallengegood first issuehelp wantedresearchtesting

Description

There are more than 60 different small C programs to test the input generation in the logic bombs benchmark. Manticore [native] could integrate them in the testing to make sure these difficult examples are correctly handled.

Contributor guide

Tech stack
pythonc
Domain
testingtooling
Issue type
test
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
mostly clear
Prerequisites
PythonC programmingManticore basics
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
40
Research direction
Review the logic bombs benchmark repository at https://github.com/hxuhack/logic bombs/pull/14 to understand the structure of the C programs. Then examine Manticore's existing test suite to determine how to add new test cases. Focus on the testing framework used (likely pytest) and how native tests are integrated. Consider creating a script to compile and run the logic bomb examples with Manticore's symbolic execution engine.