SQL Server: every stream lookup by name does a key lookup to get `Version`
I maintainer di solito rispondono entro 7 giorni
Valutazione
- Difficoltà
- 3/5
- Tempo stimato
- 1-2 giorni
- Idoneità per principianti
- 25/100
Direzione di ricerca
Start with the schema in src/SqlServer/src/Eventuous.SqlServer/Scripts/1_Schema.sql, where the Streams table and UQ_StreamName are defined, and with check_stream, append_events and the CATCH block that matches the constraint name. Pull request #621 is already open against this issue, so check it before starting. Done means the lookup by name becomes a covered index seek, existing databases get an upgrade step, and the concurrency tests from #598 still pass.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Summary
check_stream, read_stream_forwards, and read_stream_backwards all start with the same query:
SELECT
@current_version = [Version],
@stream_id = StreamId
FROM __schema__.Streams
WHERE StreamName = @stream_name;
The only index on StreamName is the unique constraint UQ_StreamName. It holds StreamName and the clustered key StreamId, but not Version. So SQL Server seeks UQ_StreamName and then does a key lookup into PK_Streams to get Version. This occurs once for every append and every stream read.
How I found it
We capture the actual execution plans from our integration tests and analyze them with Performance Studio. It reports this statement as a critical "Key Lookup":
Key Lookup — SQL Server found rows via a nonclustered index but had to go back to the clustered index for additional columns. Columns fetched: Streams.Version
Statement in the plan (from check_stream, called by append_events):
SELECT @current_version = [Version], @stream_id = StreamId
FROM eventuous.Streams
WHERE StreamName = N'InventoryNodeStock-102'
Environment: Eventuous 0.17.0, SQL Server 2022. The schema in src/SqlServer/src/Eventuous.SqlServer/Scripts/1_Schema.sql on dev has the same index, so the plan shape is the same there.
Suggested change
Replace the unique constraint with a unique index that has the same name and includes Version:
CREATE TABLE __schema__.Streams
(
StreamId INT IDENTITY (1,1) NOT NULL,
StreamName NVARCHAR(850) NOT NULL,
[Version] INT DEFAULT (-1) NOT NULL,
CONSTRAINT PK_Streams PRIMARY KEY CLUSTERED (StreamId) WITH (OPTIMIZE_FOR_SEQUENTIAL_KEY = ON),
CONSTRAINT CK_VersionGteNegativeOne CHECK ([Version] >= -1),
INDEX UQ_StreamName UNIQUE NONCLUSTERED (StreamName) INCLUDE ([Version])
);
A UNIQUE constraint cannot have INCLUDE columns, so it must become a unique index. Keep the name UQ_StreamName: the CATCH block in check_stream looks for that name in the error message, and already handles both error 2627 (constraint) and 2601 (unique index).
Trade-offs
- Benefit: The lookup by name becomes one index seek. This saves a few logical reads on each append and each stream read, and the read path touches one index instead of two.
- Cost: The
UPDATE ... SET [Version]inappend_eventsmust now also write the nonclustered index.Versionis a 4-byteINT, so the index stays narrow, but it is one more index write for each append. - Locking:
check_streamtakesUPDLOCKon the row it reads. With a covering index, that read locks only theUQ_StreamNamekey, not the clustered row. Two concurrent appends to the same stream still meet on the sameUQ_StreamNamekey, so they must still be serialized, but the concurrency tests added in #598 should confirm this. - Existing databases:
1_Schema.sqlcreates the table onlyIF OBJECT_ID(...) IS NULL, so existing databases do not get the change. The change needs an upgrade step (drop the constraint, create the index), or a note in the release notes.
The gain for each call is small. But this query runs on the hot path of every append and every aggregate load, so I think the change is worth it. I can open a PR if you agree with the approach.
- Lingua principale
- C#
- Stelle
- 512
- Fork
- 99
- Merge medio
- 5g 6h
- PR unite (30g)
- 5
Preparare l'ambiente
- Include un Dockerfile o un file Docker Compose
- Nessun modello di pull request
- Leggi la guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di Eventuous/eventuous
-
MongoDB integration tests fail on newer GitHub Actions runner kernelsForse già presa @nmummau l’ha presa 1 giorno fa. Aperta
Difficoltà 2/5 1-3 ore Idoneità per principianti 74/100
Eventuous/eventuous#626 · 2 commenti ·
I maintainer di solito rispondono entro 7 giorni
-
`dotnet format style --verify-no-changes` fails with naming violations and unnecessary importsForse già presa @nmummau l’ha presa 1 giorno fa. Aperta
Difficoltà 2/5 1-3 ore Idoneità per principianti 80/100
Eventuous/eventuous#624 · 1 commento ·
I maintainer di solito rispondono entro 7 giorni
-
Difficoltà 5/5 Più di una settimana Idoneità per principianti 35/100
Eventuous/eventuous#627 · 1 commento ·
I maintainer di solito rispondono entro 7 giorni
-
SQL Server: `append_events` does not need the `@inserted` table variableForse già presa @nmummau l’ha presa 7 giorni fa. Aperta
Difficoltà 3/5 1-2 giorni Idoneità per principianti 20/100
Eventuous/eventuous#619 · 1 commento ·
I maintainer di solito rispondono entro 7 giorni
-
SQL Server: stream reads do one key lookup per event, and `IDX_EventsStream` duplicates `UQ_StreamIdAndStreamPosition`Forse già presa @nmummau l’ha presa 7 giorni fa. Aperta
Difficoltà 3/5 1-2 giorni Idoneità per principianti 18/100
Eventuous/eventuous#618 · 1 commento ·
I maintainer di solito rispondono entro 7 giorni
Tutte le issue di Eventuous/eventuous
Issue simili
-
The test-platform skill doesn't say what three of its failures look likeForse già presa @yasmoradi l’ha presa oggi. Aperta
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
bitfoundation/bitplatform#14022 ·
I maintainer di solito rispondono entro 1 giorno
-
area-TableView bug needs-triage team-Controls
Difficoltà 2/5 1-3 ore Idoneità per principianti 66/100
microsoft/microsoft-ui-xaml#12351 · 1 commento ·
I maintainer di solito rispondono entro 2 giorni
-
AudioClient and ImageClient file path overloads send the full local path as the multipart file nameForse già presa @sebxt l’ha presa oggi. Apertaarea: audio area: images feature-request
Difficoltà 2/5 1-3 ore Idoneità per principianti 76/100
openai/openai-dotnet#1453 ·
I maintainer di solito rispondono entro 1 giorno
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 73/100
I maintainer di solito rispondono entro 1 giorno
-
Runtime diagnostics settings report canManage=true for every callerForse già presa Una pull request collegata a questa issue è aperta o già unita. Apertaneeds-triage
Difficoltà 2/5 1-3 ore Idoneità per principianti 78/100
elsa-workflows/elsa-foundation#3130 ·
I maintainer di solito rispondono entro 1 giorno