Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable streaming through the APIServer #289

Open
4 tasks
logan-markewich opened this issue Oct 4, 2024 · 0 comments
Open
4 tasks

Enable streaming through the APIServer #289

logan-markewich opened this issue Oct 4, 2024 · 0 comments
Assignees

Comments

@logan-markewich
Copy link
Contributor

logan-markewich commented Oct 4, 2024

Implement the equivalent of what we have in workflows:

handler = workflow.run()
async for event in handler.stream_events():
    # do something with event
    pass

for Llama Deploy through the API Server, something like GET http://apiserver.local/my-deployment/events

Sub Tasks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: In Progress
Development

No branches or pull requests

2 participants