question about fail rate

[KennyNH]

Thanks for your wonderful work.

My question is how to calculate the fail rate (FR) metric. It seems that Gaode Map API always returns something even though you input a non-existent POI.

[YihongT]

Hi, thanks for the question. We use the Map API along with string match scores from the thefuzz package to determine whether a POI is "failed." Specifically, we filter out POIs with string match scores below a certain threshold (e.g., 60 in our implementation). I hope this helps.

[Luyunfei0728]

Hello, do you plan to open source the codes of the implementation methods of RR, AM, OL and other indicators proposed in your experiment? Are you planning to open source?