Problem with unrecognized argument

Open

#70 opened on Apr 25, 2022 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty: 2/5
Estimated time: 1-3 hours
Newbie friendliness: 35/100

Issue type: Bug
Clarity: Mostly clear
Activity status: Stale
Tech stack: python
Domain: cli

Research direction

Start at codegen_sources/preprocessing/preprocess.py and reproduce the reported command to inspect how its argument parser handles the supplied positional values. Compare the command with the usage output and existing preprocessing guidance, then verify the expected invocation or parser behavior with a focused run.

Written by the indexing model from the issue text.

Description

question

When I run the CodeGen, the preprocessing.py it is asking for various arguments and when I pass those argument its showing unrecognized arguments. Below are my codes.
%run codegen_sources/preprocessing/preprocess data/test_dataset 20 python obfuscation 8 500 200 400 roberta False data/bpe/cpp-java-python/vocab False data/bpe/cpp-java-python --1

usage: preprocess.py [-h] [--local LOCAL]
[--local_parallelism LOCAL_PARALLELISM]
[--langs LANGS [LANGS ...]]
[--mode {obfuscation,monolingual,monolingual_functions,obfuscation_functions}]
[--train_splits TRAIN_SPLITS] [--job_mem JOB_MEM]
[--tokenization_timeout TOKENIZATION_TIMEOUT]
[--bpe_timeout BPE_TIMEOUT]
[--train_bpe_timeout TRAIN_BPE_TIMEOUT]
[--bpe_mode {fast,roberta}]
[--fastbpe_use_vocab FASTBPE_USE_VOCAB]
[--fastbpe_vocab_path FASTBPE_VOCAB_PATH]
[--keep_comments KEEP_COMMENTS]
[--fastbpe_code_path FASTBPE_CODE_PATH] [--ncodes NCODES]
[--percent_test_valid PERCENT_TEST_VALID]
input_path
preprocess.py: error: unrecognized arguments: 20 python obfuscation 8 500 200 400 roberta False data/bpe/cpp-java-python/vocab False data/bpe/cpp-java-python --1

Dominant language: Python
Stars: 777
Forks: 144
PR merge metrics: No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

Read the whole issue, then the project's contributing guide.
Comment on the issue to say you are picking it up — it saves two people doing the same work.
Fork the repository and make your change on a branch.
Open a pull request that references the issue number.

Similar issues

validate-structure inspecte challenge/work/.terraform et rend faux les labs qui ont un provider en cache Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 75/100

stephrobert/dsoxlab#238 · Opened Sep 24, 2026
Uniform probability densities use the upper bound as an interval width Open

Difficulty 2/5 1-3 hours Newbie friendliness 75/100

nasa/fmdtools#40 · Opened Sep 24, 2026
_common_folder() treats a single file as the common folder; single-file archives can't be installed (4.2.8) / crash (master) Open

Difficulty 2/5 1-3 hours Newbie friendliness 75/100

sublimehq/package_control#1780 · Opened Sep 24, 2026
Set 'Sample' input in 'autorun.py' to utilize 'Sample' Tab in eLog Open

Difficulty 2/5 1-3 hours Newbie friendliness 65/100

pcdshub/mfx#309 · 2 comments · Opened Sep 24, 2026
niri config file addition does not respect existing optional include Open

Difficulty 2/5 1-3 hours Newbie friendliness 70/100

nwg-piotr/nwg-displays#145 · Opened Sep 24, 2026

More Python issues