You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1. Download and extract CLEVR_v1.0 dataset: http://cs.stanford.edu/people/jcjohns/clevr/
6
6
@@ -12,21 +12,22 @@ This repository contains the code for reproducing results from our paper: [link]
12
12
13
13
3. Move into the cloned repository and run
14
14
```
15
+
chmod u+x *.sh
15
16
./setup.sh path/to/CLEVR_v1.0
16
17
```
17
18
substituting ```path/to/CLEVR_v1.0``` with the path to your CLEVR extracted folder. This script will download RMAC features for CLEVR dataset and precalculated GED distances (ground-truth). Then, it will extract features from 2S-RN using pretrained IR model.
18
19
19
20
20
21
## Results
21
22
### Spearman-Rho correlation
22
-
This section is aimed at reproducing Spearman-Rho correlation values for RMAC, RN and 2S-RN features against the generated GT.
23
+
In order to reproduce Spearman-Rho correlation values for RMAC, RN and 2S-RN features against the generated GT, run
23
24
```
24
25
./compute_results.sh -d path/to/CLEVR_v1.0
25
26
```
26
-
This script will setup a virtual environment for computing all RMAC, RN and 2S-RN distances for both soft and hard matches.
27
-
**NOTE**:The first time this script is run may take some time; once finished, results will be cached and final spearman-rho metrics will be immediately available at every successive run.
27
+
This script will compute distances, rankings and correlation values for both soft and hard matches.
28
+
**NOTE**:The first time this script is run may take some time; once finished, results are cached and final spearman-rho metrics will be immediately available at every successive run.
28
29
29
-
This script prints spearman-rho correlation values in the current terminal and creates a graphical visualization storing it in pdf files in the ```output``` folder.
30
+
This script prints Spearman-Rho correlation values in the current terminal and creates a graphical visualization storing it in pdf files in the ```output``` folder.
30
31
31
32
In order to modify parameters such as *start* and *end* query indexes or number of processes used to compute GED distances, run
32
33
```
@@ -38,8 +39,8 @@ It is possible to view the top relevant images using RMAC, RN and 2S-RN features
38
39
```
39
40
./compute_visual_results.sh -d path/to/CLEVR_v1.0
40
41
```
41
-
This script will create a pdf file in the main folder called ```visual_results.pdf``` showing retrieval results for every query image.
42
-
By default, only 10 query images are used. To change the range of query images to use you can specify parameters ```-s``` and ```-e```. For more informations, run
42
+
This script will create a pdf file in the ```output``` folder called ```visual_results.pdf``` showing retrieval results for every query image.
43
+
By default, only 10 query images are used. In order to change the range of query images to use you can specify parameters ```-s``` and ```-e```. For more informations, run
0 commit comments