Codec doesn't work in Logstash 5.0, each line calls `decode` separately
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 30/100
Research direction
Start by comparing this codec's decode handling with the solution referenced in issue #2 and the Logstash 5.0 invocation shown here. Reproduce the behavior with a CloudFront gzip file and verify whether per-line calls can produce an event; done means the codec parses the file without requiring the workaround from #2.
Written by the indexing model from the issue text.
Description
Even after applying #3 this codec plugin does not work. I put some debugging into it and found the decode method is being called for each individual line, so no event is raised:
[2016-11-17T10:16:34,395][INFO ][logstash.codecs.cloudfront] Cloudfront: Parsing event #Version: 1.0
[2016-11-17T10:16:34,396][INFO ][logstash.codecs.cloudfront] Cloudfront: Parsing event #Fields: date time x-edge-location sc-bytes c-ip cs-method cs(Host) cs-uri-stem sc-status cs(Referer) cs(User-Agent) cs-uri-query cs(Cookie) x-edge-result-type x-edge-request-id x-host-header cs-protocol cs-bytes time-taken x-forwarded-for ssl-protocol ssl-cipher x-edge-response-result-type cs-protocol-version
[2016-11-17T10:16:34,396][INFO ][logstash.codecs.cloudfront] Cloudfront: Parsing event 2016-11-17 04:42:51 MEL50 882 x.x.x.x GET arandomstring.cloudfront.net / 403 - curl/7.43.0 - - Error anencryptedhash example.com https 79 0.000 - TLSv1.2 ECDHE-RSA-AES128-GCM-SHA256 Error HTTP/1.1
The solution provided in #2 is the only way to parse events.
- Dominant language
- Ruby
- Stars
- 5
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from logstash-plugins/logstash-codec-cloudfront
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
logstash-plugins/logstash-codec-cloudfront#2 · 17 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
All issues in logstash-plugins/logstash-codec-cloudfront
Similar issues
-
Feature Feature Parity
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
valkey-io/valkey-glide-ruby#369 ·
Maintainers usually reply within 2 days
-
Difficulty 2/5 1-3 hours Newbie friendliness 85/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
Maintainers usually reply within 3 days
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
thewca/worldcubeassociation.org#16088 ·
Maintainers usually reply within 1 day