Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GenAI conventions for safety settings/ratings #1886

Open
michaelsafyan opened this issue Feb 7, 2025 · 0 comments
Open

GenAI conventions for safety settings/ratings #1886

michaelsafyan opened this issue Feb 7, 2025 · 0 comments
Labels
enhancement New feature or request experts needed This issue or pull request is outside an area where general approvers feel they can approve triage:needs-triage

Comments

@michaelsafyan
Copy link
Contributor

Propose new conventions

Some GenAI systems have the ability to configure safety settings.

For example, you can see in googleapis/python-genai/blob/main/google/genai/types.py the following:

  • Request: _GenerateContentParameters.config.safety_settings
  • Response: GenerateContentResponse.prompt_feedback:
    • block_reason
    • block_reason_message
    • safety_ratings

I'm not sure whether other GenAI systems have an equivalent or not (so I'm not sure whether this should go under a general prefix or a vendor-specific prefix). It would be good to standardize, though, how to record some of this in spans and/or in events.

@michaelsafyan michaelsafyan added enhancement New feature or request experts needed This issue or pull request is outside an area where general approvers feel they can approve labels Feb 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request experts needed This issue or pull request is outside an area where general approvers feel they can approve triage:needs-triage
Projects
Status: Need triage
Development

No branches or pull requests

1 participant