pytorch/text

torchtext main branch doesn't support pytorch2.0

Open

#2,052 opened on Feb 10, 2023

View on GitHub
 (1 comment) (0 reactions) (0 assignees)Python (3,396 stars) (822 forks)batch import
good first issue

Description

Hi,

I want to build torchtext from source by using 'python setup.py clean install'. the version of pytorch I used is 2.0.0. But it report the following error:

Installed /home/yangqun/miniconda3/envs/pt/lib/python3.8/site-packages/torchtext-0.15.0a0+9db75ab-py3.8-linux-x86_64.egg
Processing dependencies for torchtext==0.15.0a0+9db75ab
error: torch 2.0.0a0+git13b3d86 is installed but torch==1.13.1 is required by {'torchdata'}

When I try to import torchtext, the following error is reported;

>>> import torch
>>> import torchtext
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/yangqun/text/torchtext/__init__.py", line 6, in <module>
    from torchtext import _extension  # noqa: F401
  File "/home/yangqun/text/torchtext/_extension.py", line 64, in <module>
    _init_extension()
  File "/home/yangqun/text/torchtext/_extension.py", line 56, in _init_extension
    raise ImportError("torchtext C++ Extension is not found.")
ImportError: torchtext C++ Extension is not found.

Could anyone point me how can I use torchtext with torch 2.0.0 ?

Contributor guide

Tech stack
pythonpytorch
Domain
machine learningdata
Issue type
bug
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
PythonPyTorchdependency management
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
30
Research direction
Investigate the dependency chain: torchtext requires torchdata, which pins torch==1.13.1. Look at setup.py or requirements files in both torchtext and torchdata to update the version constraint to support torch 2.0. Also examine the C++ extension build failure in extension.py, which may be due to API changes in PyTorch 2.0. Check if there are any existing pull requests or discussions addressing this compatibility issue.