donkirkby/live-py-plugin

Extend fuzz testing

Open

#540 opened on Apr 8, 2023

View on GitHubContributor guide
 (1 comment) (0 reactions) (0 assignees)Python (63 forks)auto 404
good first issue

Repository metrics

Stars
 (302 stars)
PR merge metrics
 (PR metrics pending)

Description

The current fuzz test includes assignments, printing, and for loops. Add more types of statements to generate_statements().

To learn how, read about abstract syntax trees and then generate trees from sample code using the dump_syntax.py script. Whatever code you generate, the test just checks if it gets displayed the same way after tracing.

See a list of the issues that fuzz testing has already found.

Contributor guide

Research direction
Read test/PySrc/tests/fuzz.py and examine the existing generate statements() function. Use test/PySrc/tools/dump syntax.py to explore AST structures for different statement types. Try adding one new statement at a time and run the fuzz test to confirm the displayed trace matches the source. Also review the 'fuzz find' issues for examples of bugs caught by fuzzing.
Tech stack
python
Domain
testing
Issue type
Test
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
PythonGit
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
75