Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Observed usability flaws #156

Closed
NMO13 opened this issue May 16, 2018 · 7 comments
Closed

Observed usability flaws #156

NMO13 opened this issue May 16, 2018 · 7 comments

Comments

@NMO13
Copy link
Contributor

NMO13 commented May 16, 2018

  • Selecting spikes in detail view should be possible in order to change single selector
  • The x-axis tick marks are overlapping => hard to find desired epoch
  • Selecting datasets is very cumbersome (e.g. selecting same run with only different learning rate
    needs to scroll through the whole list)
  • Showing class size for each run separately
  • Calculate mean precision over all classes in order to estimate best run and model
  • app performance for 1 epoch granularity is bad
  • show loading icon if loading takes long
  • show correctly classified images as heatmaps (not just misclassified images)
  • Single epoch marker is currently not very helpful
  • I didn't use the range selector of the timelines because I just needed to see an overall view
  • Accuracy is missing
  • For comparing a broader range of parameters, it would be helpful to have more than 4 runs selectable
  • Altering the timeline selection resets the detail view which is annoying
  • Digging deeper:
    • I want to know which images are misclassified. Are always the same images misclassified if oscillation is high?
    • Why gets an image mispredicted? Which layers/filters are causing mispredictions?
@mstreit
Copy link
Member

mstreit commented May 16, 2018

That's very useful. Can you please also propose solutions and point to the corresponding tickets (or create one if there is none)?

@NMO13
Copy link
Contributor Author

NMO13 commented May 17, 2018

Yes I do when I have time.

@gfrogat
Copy link
Contributor

gfrogat commented May 20, 2018

  • show loading icon if loading takes long

do you mean the initial loading of the data or also when updating the views?

  • show correctly classified images as heatmaps (not just misclassified images)

I don't get this, what do you mean by that?

@NMO13
Copy link
Contributor Author

NMO13 commented May 22, 2018

do you mean the initial loading of the data or also when updating the views?

The initial loading of datasets. The timelines could blink (similar to blinking stacked bar charts in taco)
But you are right with saying updating views: When the detail views need to load something then we need a similar concept.

show correctly classified images as heatmaps (not just misclassified images)

Ja during playing around I noticed that I want to see if there are patterns in the diagonal as well.
But I am not sure if this is really important. Supposedly not.

@thinkh thinkh added the Epic label May 22, 2018
@thinkh
Copy link
Member

thinkh commented Jul 3, 2018

@NMO13 Can you please check which points are done and which are missing. If every point is available as separate ticket, close this issue.

@thinkh
Copy link
Member

thinkh commented Jul 3, 2018

I just noticed that this is the epic. We should wait until all depending issues have been closed.

@thinkh
Copy link
Member

thinkh commented Aug 29, 2018

I will close this epic, because of the issues are already implemented.

@thinkh thinkh closed this as completed Aug 29, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants