Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[back] feat: include entity contexts in the public dataset? #1902

Open
GresilleSiffle opened this issue Jan 29, 2024 · 1 comment
Open

[back] feat: include entity contexts in the public dataset? #1902

GresilleSiffle opened this issue Jan 29, 2024 · 1 comment
Labels
Backend Back-end code of Tournesol Question Further information is requested

Comments

@GresilleSiffle
Copy link
Collaborator

GresilleSiffle commented Jan 29, 2024

Context

The entity contexts are designed to inform the users, to make them aware of specific events before comparing videos.

Because they can influence the user's judgements, and impact the individual and collective scores, should we include them in the public dataset? It may have value for the researchers.

See the initial discussion here: #1873 (comment) (if we add the contexts to the public dataset, we can then update the ComparisonSerializer as discussed in the previous comment)

@GresilleSiffle GresilleSiffle added Backend Back-end code of Tournesol Question Further information is requested labels Jan 29, 2024
@GresilleSiffle
Copy link
Collaborator Author

GresilleSiffle commented Jan 29, 2024

I think it's a good idea to include the entity contexts in the public dataset. Without them, the individual score cannot be fully "explained" by the data already present in the dataset, or the video metadata / scripts.

If we include them, we could also add a column publication date so that researchers can make a distinction between comparisons made before a context was published, and comparisons made after.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Backend Back-end code of Tournesol Question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant