Fix macos arm64 build (#1939) #3517

Job	Run time
Lint	3m 25s
Lint for Docs	13s
Linux	22m 46s
macOS	10m 42s
Bazel Linux	41m 55s
Bazel macOS	23m 0s
Build Number	2s
Bazel Windows	16m 58s
Wheel ${{ matrix.python }} Windows	0s
Test ${{ matrix.python }} Windows	0s
Nightly ${{ matrix.python }} Windows	0s
Wheel 3.9 macOS	37s
Wheel 3.10 macOS	30s
Wheel 3.11 macOS	39s
Test 3.9 macOS	56m 37s
Nightly 3.9 macOS	6s
Nightly 3.10 macOS	7s
Nightly 3.11 macOS	10s
Wheel 3.9 Linux	1m 1s
Wheel 3.10 Linux	1m 2s
Wheel 3.11 Linux	1m 8s
Nightly 3.9 Linux	6s
Release	18s
Nightly 3.10 Linux	2s
Nightly 3.11 Linux	5s
Test 3.9 Linux	30m 13s
Docker Nightly	0s
Nightly	0s
Release Candidate	32s
Docker Release	0s
	3h 32m 14s

Provide feedback