re-enable http generate endpoint

[dtrifiro]

How Has This Been Tested?

Spin up text generations server:

text-generation-launcher --model-name ./flan-t5-small

Using curl

curl --header "Content-Type: application/json"  --data '{"inputs": "complete this text"}' localhost:3000/generate

Result:

[{"generated_text":"a sluggish sluggish sluggish sl"}]

Using httpie

Hit the server using httpie:

http :3000/generate inputs="complete this text"

Result:

HTTP/1.1 200 OK
content-length: 54
content-type: application/json
date: Tue, 09 Jan 2024 16:01:31 GMT
x-inference-time: 175
x-queue-time: 0
x-time-per-token: 8
x-total-time: 175
x-validation-time: 0

[
    {
        "generated_text": "a sluggish sluggish sluggish sl"
    }
]

[dtrifiro]

@njhill I quickly tested this as mentioned above and it seems to be working. Is there any additional context regarding why this endpoint was disabled?

[joerunde]

Needs more discussion with @njhill