- Get hand key-points with Mediapipe
- bring distal phalanges from hand key-points to get fingerprints
- extend the fingertip position to the end of the finger.
- Get end of the finger and distal phalanges vector to calculate orthogonal vectors, and get coordinate of the box.
After apply those models appropriately, the result is below.