Regularization spikes in the linear method

Open
#552 7 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
30/100
Issue type
Bug
Clarity
Needs clarification
Activity status
Stale
Tech stack
python
Domain
backend

Research direction

Start at the linear method minimizer and reproduce the reported jump in regularization from 0.001 to above 1 while tracking gradient norms. Determine whether the spike is intentional or caused by tangent-space conditioning; the issue is complete when the cause and a validated mitigation or expected behavior are documented.

Written by the indexing model from the issue text.

Description

The linear method minimizer has an issue where the regularization can spike from 0.001 to >1 in just one iteration which freezes the optimization even when the norm of the gradients are still on the order of ~1e-5 to ~1e-4. To deduce if the optimizer has converged, we often expect something like the grad of the norm to go to ~1e-8. As you can see, the gradient also freezes and flatlines when the regularization spikes.

Image

I don't know if this is intentional, or due to ill-conditioning of the tangent space? Any way to mitigate this?

Dominant language
Python
Stars
116
Forks
50
Avg merge
2h 1m
Merged PRs (30d)
8

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from Qiskit/ffsim

All issues in Qiskit/ffsim

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.