From 071c729355b221354093d364a53cc68af59737ac Mon Sep 17 00:00:00 2001 From: Harsha Vardhan Simhadri Date: Mon, 2 Oct 2023 21:02:33 -0700 Subject: [PATCH 1/3] Added prelim plots on azure VM --- neurips23/README.md | 19 +++++++++++++++---- 1 file changed, 15 insertions(+), 4 deletions(-) diff --git a/neurips23/README.md b/neurips23/README.md index f97d0464..1dba2b8b 100644 --- a/neurips23/README.md +++ b/neurips23/README.md @@ -130,18 +130,29 @@ To make the results available for post-processing, change permissions of the res sudo chmod 777 -R results/ ``` +The following command will summarize all results files into a single csv file `res.csv` suitable for further processing. + +``` +python data_export.py --out res.csv +``` + To plot QPS vs recall, you can use `plot.py` as follows: ``` python plot.py --dataset yfcc-10M --neurips23track filter ``` This will place a plot into the *results/* directory. Please note that you have to provide the correct competition track to the script. +The following are plots generated on Azure Standard D8lds v5 (8 vCPUs and 16GB DRAM) VM. -The following command will summarize all results files into a single csv file `res.csv` suitable for further processing. +**Sparse track** +![sparse-full](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/2009131b-c5fb-4ae3-a3bd-4b647672caef) + +**Filter track** +![yfcc-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/09439f77-f1b1-49e4-a90d-05b5d6848375) + +**OOD** +![text2image-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/79850d1f-be61-4c2b-81ea-3b7b80179d1c) -``` -python data_export.py --out res.csv -``` ### Starting_Your_Development From 6b164e9eec1215d133d5d8c8ca54a7edae84f0eb Mon Sep 17 00:00:00 2001 From: Harsha Vardhan Simhadri Date: Mon, 2 Oct 2023 21:05:06 -0700 Subject: [PATCH 2/3] Update README.md --- neurips23/README.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/neurips23/README.md b/neurips23/README.md index 1dba2b8b..e12a1626 100644 --- a/neurips23/README.md +++ b/neurips23/README.md @@ -145,13 +145,13 @@ Please note that you have to provide the correct competition track to the script The following are plots generated on Azure Standard D8lds v5 (8 vCPUs and 16GB DRAM) VM. **Sparse track** -![sparse-full](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/2009131b-c5fb-4ae3-a3bd-4b647672caef) +![sparse-full](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/2009131b-c5fb-4ae3-a3bd-4b647672caef = 300x) **Filter track** -![yfcc-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/09439f77-f1b1-49e4-a90d-05b5d6848375) +![yfcc-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/09439f77-f1b1-49e4-a90d-05b5d6848375 = 300x) -**OOD** -![text2image-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/79850d1f-be61-4c2b-81ea-3b7b80179d1c) +**OOD track** +![text2image-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/79850d1f-be61-4c2b-81ea-3b7b80179d1c = 300x) ### Starting_Your_Development From 09f013905f2bb70dd08d5e9c71bb85a36b1f25cb Mon Sep 17 00:00:00 2001 From: Harsha Vardhan Simhadri Date: Mon, 2 Oct 2023 21:07:19 -0700 Subject: [PATCH 3/3] Update README.md --- neurips23/README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/neurips23/README.md b/neurips23/README.md index e12a1626..f15c2fae 100644 --- a/neurips23/README.md +++ b/neurips23/README.md @@ -145,13 +145,13 @@ Please note that you have to provide the correct competition track to the script The following are plots generated on Azure Standard D8lds v5 (8 vCPUs and 16GB DRAM) VM. **Sparse track** -![sparse-full](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/2009131b-c5fb-4ae3-a3bd-4b647672caef = 300x) +![sparse-full](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/2009131b-c5fb-4ae3-a3bd-4b647672caef) **Filter track** -![yfcc-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/09439f77-f1b1-49e4-a90d-05b5d6848375 = 300x) +![yfcc-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/09439f77-f1b1-49e4-a90d-05b5d6848375) **OOD track** -![text2image-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/79850d1f-be61-4c2b-81ea-3b7b80179d1c = 300x) +![text2image-10M](https://github.com/harsha-simhadri/big-ann-benchmarks/assets/5590673/79850d1f-be61-4c2b-81ea-3b7b80179d1c) ### Starting_Your_Development