try to fix TSAN error about memory ordering #1771

Job	Run time
macos-CPU (MacOS) (clang, Debug)	2m 1s
macos-CPU (MacOS) (clang, Debug)	1m 59s
CPU (Windows) (msvc, Debug)	18m 13s
CPU (Windows) (msvc, Debug)	20m 13s
macos-CPU (MacOS) (clang, Release)	2m 1s
macos-CPU (MacOS) (clang, Release)	2m 4s
CPU (Windows) (msvc, Release)	19m 27s
CPU (Windows) (msvc, Release)	19m 21s
CPU (clang 13, Debug, ubuntu 20.04)	3m 42s
CPU (clang 13, Debug, ubuntu 20.04)	1m 26s
CPU (clang 13, Release, ubuntu 20.04)	4m 15s
CPU (clang 13, Release, ubuntu 20.04)	1m 9s
CPU (gcc 11, Debug, ubuntu 22.04)	3m 58s
CPU (gcc 11, Debug, ubuntu 22.04)	1m 12s
CPU (gcc 11, Release, ubuntu 22.04)	3m 28s
CPU (gcc 11, Release, ubuntu 22.04)	1m 4s
CPU (gcc 11, Release, ubuntu 22.04, TSAN)	3m 46s
CPU (gcc 11, Release, ubuntu 22.04, TSAN)	1m 27s
CPU (gcc 11, Release, ubuntu 22.04, ASAN)	4m 46s
CPU (gcc 11, Release, ubuntu 22.04, ASAN)	1m 22s
CI (CPU) (MacOS)	1s
CI (CPU) (MacOS)	1s
CI (CPU)	1s
CI (CPU)	1s
CI (CPU) (Windows)	3s
CI (CPU) (Windows)	1s
	1h 57m 2s

Provide feedback