[GPU] Fix weightless caching with low precision models #44539

Job	Run time
Smart_CI	24s
Docker	1m 13s
Build / Build	6m 23s
Debian Packages	0s
PyTorch Models tests	0s
OpenVINO JS API / OpenVINO JS API	1m 42s
Samples / Samples	5m 56s
CPU functional tests / CPU functional tests	5m 15s
C++ unit tests / C++ unit tests	12m 18s
JAX Layer Tests / JAX Layer Tests	1m 21s
ONNX Runtime Integration / ONNX Runtime Integration	3m 56s
OpenVINO tokenizers extension / OpenVINO tokenizers extension	2m 9s
Python API tests / Python API tests	2m 48s
Python unit tests / Python unit tests	3m 6s
Pytorch Layer Tests / PyTorch Layer Tests	2m 31s
TensorFlow Models tests	0s
TensorFlow Layer Tests / TensorFlow Layer Tests	4m 3s
ci/gha_overall_status_linux_arm64	1s
	53m 6s

Provide feedback