Skip to content

Commit

Permalink
Merge pull request #2 from morpheus1820/fixes
Browse files Browse the repository at this point in the history
  • Loading branch information
francescotaioli authored Mar 16, 2024
2 parents bd080d4 + e359dca commit 097b3a9
Show file tree
Hide file tree
Showing 3 changed files with 20 additions and 21 deletions.
13 changes: 6 additions & 7 deletions dataset.html
Original file line number Diff line number Diff line change
Expand Up @@ -112,22 +112,21 @@ <h1 class="title is-2 publication-title">Dataset
<div class="columns is-centered ">

<div class="column is-full">
<h2 class="title is-4">R2R-IE-CE v1<span class="tag is-warning is-light">Available upon acceptance</span></h2>
<h2 class="title is-4">R2R-IE-CE v1<span class="tag is-warning is-light">To be released</span></h2>

<div class="content has-text-justified">
<p>
This dataset is used to benchmark the task of <i>Detection and Localization of Instruction Errors</i>, presented in our paper.
You will find the dataset explanation here, as well as the Habitat Integration to use it.
You will find the dataset explanation here, as well as the Habitat integration tools to use it.
</p>
</div>

<h5 class="title is-5">Val Unseen</h5>
<p>Here we show how our json.gz dataset are formed:</p>
<h5 class="title is-5">Format of {split}_bertidx.json.gz</h5>

<pre><code class="language-json line-numbers">
{"episodes": [
{
"episode_id": "//integer number",
"episode_id": "integer number representing an episode id",
"trajectory_id": "integer number representing the gt trajectory",
"scene_id": "string representing the scene",
"start_position": "list of float representing the start position",
Expand All @@ -143,10 +142,10 @@ <h5 class="title is-5">Val Unseen</h5>
"error_type": "integer representing the error type",
"token_swapped": [
{
"old_word": "string representing the old word",
"new_word": "string representing the new word",
"token_id" : ["list of bert token id of this word"],
"token_id_position": ["list of integer representing the index of the swapped words in the new instruction"],
"old_word": "string representing the old word",
}]
}
"old_episode_id": "integer number representing the episode id from which this episode was generated"
Expand All @@ -157,7 +156,7 @@ <h5 class="title is-5">Val Unseen</h5>
]}
</code></pre>

<h5 class="title is-5">Habitat Integration</h5>
<h5 class="title is-5">Habitat integration</h5>
<p>In Progress</p>
</div>

Expand Down
19 changes: 9 additions & 10 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -137,15 +137,15 @@ <h1 class="title is-1 publication-title">
<span class="icon">
<i class="fab fa-github"></i>
</span>
<span>Code (upon acceptance)</span>
<span>Code (to be released)</span>
</a>
</span>
<span class="link-block">
<a href="dataset.html" class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fas fa-database"></i>
</span>
<span>Dataset (upon acceptance)</span>
<span>Dataset (to be released)</span>
</a>
</span>

Expand Down Expand Up @@ -236,9 +236,9 @@ <h2 class="title is-3">Scenario</h2>
<hr>
<div class="is-full">
<h3 class="title is-3">Effect of Direction error</h3>
<p>We reported the scenario depicted in the <b>Fig.1</b> of the paper (also reported in the <i>Scenario</i>
Section above).</p>
The videos shows the full trajectories of the agent following the perturbed and correct instructions.
<p>We show the full episode for the example reported in the <i>Scenario</i>
section above (also <b>Fig.1</b> in the paper).</p>
The videos shows the agent following the perturbed and correct instructions respectively.

<div class="columns is-desktop">

Expand Down Expand Up @@ -329,14 +329,13 @@ <h3 class="title is-3">IEDL for detecting <span style="color: red;">errors</span


</h3>
<p>In our paper, we answered the following question: <i><b>What if we apply <b>IEDL</b> on the R2R-CE
<p>We answer the following question: <i><b>What if we apply <b>IEDL</b> on the R2R-CE
dataset?</i></b>
</p>
<p>Our method, <b>IEDL</b>, detected 8 episodes from R2R-CE standard Val Unseen dataset that should be
deleted.</p>
<p>Here, we report the video showing the trajectories of these particular episodes.</p>
<p>Our method helped to detect 8 episodes from R2R-CE Val Unseen dataset that present different issues.</p>
<p>Here we show the BEVBert trajectories for these episodes, as well as the detected issue.</p>
<br>
<b>Note</b>: we report the instruction as given in the dataset.
<b>Note</b>: any typos in the instructions are reported verbatim from the dataset.

<div class="columns is-desktop">
<!-- video one -->
Expand Down
9 changes: 5 additions & 4 deletions rxr_videos.html
Original file line number Diff line number Diff line change
Expand Up @@ -120,10 +120,11 @@ <h3 class="title is-3 publication-title">


<!-- RXR-CE -->
<div class="is-full">

<p>We report also the episode to be removed from the validation split of RxR-CE.</p>

<div class="is-full">
<p>Our method helped to detect 10 episodes from RxR-CE Val Unseen dataset that present different issues.</p>
<p>Here we show the BEVBert trajectories for these episodes, as well as the detected error.</p>
<br>
<b>Note</b>: any typos in the instructions are reported verbatim from the dataset.
</div>

<div class="columns">
Expand Down

0 comments on commit 097b3a9

Please sign in to comment.