You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, I am still having issues replicating your results by following the instructions and algorithms in the paper.
I have found that the schedules described in the paper are not consistent with what is present in the code, and I think that schedule optimization is a very relevant issue for performance. Indeed, there is high variability of fooling rates between schedules.
As an example, this is the schedule for Patch-RS as described in the paper (page 15):
And this is what I have found in the code (rs_attack.py 200):
The text was updated successfully, but these errors were encountered:
the schedule in the code should be the correct one, I think the one in the text wasn't changed from the previous version of the paper. Thanks for noticing it, I'll make sure to update it. Note however that, with the parameters we use, the size of the updates becomes 1x1 (so cannot decrease) at iteration 2000, so the remaining reductions do not change the updates. Also, at iteration 6000 (for untargeted image-specific patches) the single-channel updates start.
Which kind of differences in the results compared to what reported do you get?
Well I have been long struggling as I cannot manage to replicate your results with my code, even by following your directions as detailed in the paper. I would have used your code but it is very hard to understand and modify for my purposes, so I am going through it trying to decipher the functioning, but it seems to me like there is some piece missing.
I am not sure whether it's in the optimizer but I think that is my best guess. I will continue working on it and maybe I'll find it :)
Hi, I am still having issues replicating your results by following the instructions and algorithms in the paper.
I have found that the schedules described in the paper are not consistent with what is present in the code, and I think that schedule optimization is a very relevant issue for performance. Indeed, there is high variability of fooling rates between schedules.
As an example, this is the schedule for Patch-RS as described in the paper (page 15):
![image](https://user-images.githubusercontent.com/1367018/127979872-541b6810-a82d-46a2-970f-47de5212be0f.png)
And this is what I have found in the code (rs_attack.py 200):
![image](https://user-images.githubusercontent.com/1367018/127980289-234bdd05-0fd0-42a3-a53e-d1d865f719e4.png)
The text was updated successfully, but these errors were encountered: