space efficient non-isolated caches? or use deps solver like `micromamba`?

Discussed in https://github.com/pypa/pipx/discussions/1167

Originally posted by goyalyashpal December 24, 2023 hi all! greetings of the day.

i just found pipx & was thinking to use it for things like:

• ides:thonny, jupyterlab,
• python devtools: ruff black mypy autopep8 flake8
• utils like: pygments
• ... etc

currently,

• other than few shared/Lib like pip, setuptools
• rest all go to their own isolated dirs (right?)
• which will increase the duplicacy over time and consume lots of space
• like i want to use pygments as an app for myself, but other python apps like jupyter use it as a lib too, so, unnecessary duplication for isolation is just plain wastage of resources

so, i was thinking if it would be possible to:

• store atomic & versioned package in one common cache dir
• and then link the required libs from there using symlinks etc...

this seems to be similar to the way

• the proper dependency solvers like micromamba do it in python world,
• or the pnpm does for the node world.
• or the nix does for the system-level packages and configurations

Similar issues elsewhere:

• https://github.com/pypa/packaging-problems/issues/328
• https://github.com/pdm-project/pdm/issues/2604#issuecomment-1923755234