[Question]: LLMLingua requires too much GPU memory, and it takes a lot of time to compress long text, such as 16k, etc. How to make it and LLM work at the same time

Assessment

This issue has not been assessed yet.

Description

Contributor guide

No contributing guide indexed for this repository

First steps

1. Read the whole issue, then the project's contributing guide.
2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
3. Fork the repository and make your change on a branch.
4. Open a pull request that references the issue number.

More from microsoft/LLMLingua

• Code Review Observations & Questions from a Developer Exploring the Project Open

  Difficulty 5/5 Over a week Newbie friendliness 42/100

  microsoft/LLMLingua#249 · 1 reaction · Opened Jun 10, 2026

• [Bug]: When calling slingua through PromptCompressor, use_llmlingua2 should also be set to true. Open
  bug

  Difficulty 2/5 1-3 hours Newbie friendliness 55/100

  microsoft/LLMLingua#235 · Opened Jan 29, 2026

• [Question]: Is this repo still relevant? Open
  question

  Difficulty 1/5 Under an hour Newbie friendliness 20/100

  microsoft/LLMLingua#234 · 2 comments · Opened Jan 20, 2026

• [Bug]: XLMRobertaForTokenClassification.forward() got an unexpected keyword argument 'past_key_values' Open
  bug

  Difficulty 4/5 3-5 days Newbie friendliness 35/100

  microsoft/LLMLingua#232 · 1 comment · 1 reaction · Opened Dec 25, 2025

• [Question]: Significant performance drop on LongBench using LongChat-7b-v1.5-32k compared to official full-context baseline Open
  question

  Difficulty 4/5 3-5 days Newbie friendliness 25/100

  microsoft/LLMLingua#231 · Opened Dec 11, 2025

All issues in microsoft/LLMLingua

Similar issues

• [BUG] GkeTpuCluster queries metadata.google.internal for MEGASCALE_SLICE_ID even when TPU_SKIP_MDS_QUERY is set Open

  Difficulty 2/5 1-3 hours Newbie friendliness 88/100

  jax-ml/jax#40854 · Opened Sep 22, 2026

• [pcied] Honour PCIE_DETACH_INFO on platforms that are not smartswitches Open

  Difficulty 2/5 1-3 hours Newbie friendliness 82/100

  sonic-net/sonic-platform-daemons#900 · Opened Sep 21, 2026

• MCP client has no httpx timeout, so the event stream fails after 5 seconds Open

  Difficulty 2/5 1-3 hours Newbie friendliness 78/100

  Azure/azure-functions-agents-runtime#228 · Opened Sep 21, 2026

• feat(mcp): friendlier error when `run_cloud_sync` is called on a disabled connection Open
  enhancement

  Difficulty 2/5 1-3 hours Newbie friendliness 72/100

  airbytehq/PyAirbyte#1205 · Opened Sep 21, 2026

• pn7160: reader goes permanently deaf — post-read IRQ-low check fails reads that succeeded Open

  Difficulty 2/5 1-3 hours Newbie friendliness 74/100

  esphome/esphome#19452 · Opened Sep 21, 2026

More Python issues