Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build a Connector for Iggy #818

Open
tbar4 opened this issue Jan 2, 2025 · 0 comments
Open

Build a Connector for Iggy #818

tbar4 opened this issue Jan 2, 2025 · 0 comments

Comments

@tbar4
Copy link

tbar4 commented Jan 2, 2025

Iggy is the persistent message streaming platform written in Rust, supporting QUIC, TCP and HTTP transport protocols, capable of processing millions of messages per second. Considering Iggy is written in Rust, it would be interesting if there was a connector that was designed to take iggy messages and process them in arroyo.

You could stream iggy directly into DataFusion for processing (similar to Arroyo's architecture) but it would be nice to just build your producer in iggy and have Arroyo be the consumer for stream processing.

https://iggy.rs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant