Need to support Baichuan2

Description

Contributor guide

Tech stack

pythonpytorch

Domain

backendmachine learning

Issue type

feature

DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.

4

Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.

3-5 days

Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.

active

ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.

unclear

Prerequisites

PythonPyTorchFastChat model integration

Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.

20

Research direction

Investigate how other models (e.g., Vicuna, Llama) are integrated into FastChat. Look at the model registration in fastchat/model/model adapter.py and conversion scripts. Determine the architecture and tokenizer of Baichuan2 and implement support similar to existing models. Check comments in the issue for any additional requirements or guidance from maintainers.