Base on the paper https://arxiv.org/abs/2106.02795
@misc{li2021learnable,
title={Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding},
author={Yang Li and Si Si and Gang Li and Cho-Jui Hsieh and Samy Bengio},
year={2021},
eprint={2106.02795},
archivePrefix={arXiv},
primaryClass={cs.LG}
}
and the Pytorch implementation:
https://github.com/willGuimont/learnable_fourier_positional_encoding