dselivanov/text2vec

Definitions of pos_remove characters?

Open

#279 opened on Aug 18, 2018

View on GitHub
 (1 comment) (0 reactions) (0 assignees)R (837 stars) (134 forks)batch import
docseasyhelp wanted

Description

I would like to know what all the abbreviations mean? Some I can guess, like "PUNCT", but no idea what "X" might be. I want to retain contractions, but hard to choose options without documentation.

Thanks. Great performance code!

Contributor guide

Tech stack
r
Domain
documentation
Issue type
documentation
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
1
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
under 1 hour
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
None
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
95
Research direction
The issue asks for explanation of POS tag abbreviations like 'PUNCT' and 'X'. Look in the text2vec source code (e.g., R/pos remove.R) or documentation to find the tagset used (likely Universal Dependencies). Then update the documentation (e.g., function help page or a vignette) to list all abbreviations and their meanings.