Make `SourceTextData` thread-safe with `ConcurrentDictionary` - #20113

Open

xperiandri wants to merge 6 commits into

dotnet:mainfrom

xperiandri:copilot/fix-source-text-data-thread-safety

Commits on Sep 11, 2026

Make SourceTextData thread-safe with ConcurrentDictionary

Copilot
and
xperiandri
committed
0827bee
Avoid redundant allocations in Tokenizer.fs hot paths
xperiandri
committed
a46b6a8
Convert FSharpLineTokenizer.ScanToken to allocation-free voption struct return
xperiandri
committed
3bc9ea7
Add VS release notes entry for SourceTextData thread-safety fix (PR #20113)
xperiandri
committed
db09534
Add concurrent SourceTextData cache test; fix stale lex-state read it caught

xperiandri
and
claude
committed
a2ea410
Restore ScanToken's signature; add ScanTokenValue for the allocation-free path

xperiandri
and
claude
committed
1ab584a