yt-project/yt

Friendly, readable test failure comments

Open

#1,495 opened on Jul 16, 2017

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Python (315 forks)auto 404
enhancementhelp wantednew contributor friendlytests: running tests

Repository metrics

Stars
 (556 stars)
PR merge metrics
 (PR metrics pending)

Description

Right now, the yt testing framework gets run on an instance of jenkins, which integrates with the pull request system on github. This is useful and valuable, but what it doesn't do quite as well is surface the actual issues. Figuring out what's wrong requires a couple clicks in unfamiliar UI for newcomers, and this can be intimidating. If fido were able to directly comment on the pull request, update those comments, and surface the areas of failure (maybe even state how to re-run them) it would be a bit easier to see where the errors are coming from. All this information is there, just a bit below the surface.

This would be a good project for a newcomer to the community.

Contributor guide

Research direction
Investigate the yt testing framework's integration with Jenkins and the GitHub API for commenting on pull requests. Focus on extracting failure details and formatting them readably.
Tech stack
python
Domain
devopstesting qa
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GitPython
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
85