Investigate accepting a stream of tokens as input

Open
#202 6 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
25/100
Issue type
Feature
Clarity
Needs clarification
Activity status
Stale
Tech stack
cpp
Domain
compilers

Research direction

The issue names no files, tests, or entry points. Begin by surveying the parser's existing input interface and the token models mentioned in the discussion, including lexrtl and CTRE-style tokens. Done means documenting a feasible token-stream input design and resolving what token abstraction the library should accept.

Written by the indexing model from the issue text.

Description

Not sure exactly how this should work -- should it take some abstract notion of a token, a lexrtl token, something I create, a CTRE-style thing, or what?

But it definitely deserves at least some investigation. Some parsers are very hard to write (or even ambiguous) without lexing first.

Dominant language
C++
Stars
182
Forks
28
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from boostorg/parser

All issues in boostorg/parser

Similar issues

More C++ issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.