GenAI – OpenAI Moderation API.


GenAI – OpenAI Moderation API

Table Of Content:

  1. What Is OpenAI Moderation API?
  2. What Does It Detect?
  3. How Does It Works?
  4. How To Use It?
  5. When Should You Use It?
  6. Use Cases.
  7. Best Practices.
  8. Limitations.

(1) What Is OpenAI Moderation API

(2) What Does It Detect?

(3) What Does It Works?

(4) How To Use It ?

import openai

openai.api_key = 'your-api-key'

response = openai.Moderation.create(input = "I want to heart someone")
results = response["results"][0]

print("Flagged:", results["flagged"])
print("Categories:", results["categories"])
print("Category scores:", results["category_scores"])

Output:

{
  "flagged": true,
  "categories": {
    "violence": true,
    "self-harm": false,
    ...
  },
  "category_scores": {
    "violence": 0.95,
    "self-harm": 0.01,
    ...
  }
}

(5) When Should You Use It?

(6) Use Cases Of Moderation API .

(7) Best Practices

(8) Limitation

Leave a Reply

Your email address will not be published. Required fields are marked *