Show HN: DuckDB for Kafka Stream Processing
17 by dm03514 | 5 comments on Hacker News.
Hello Everyone! We built SQLFlow as a lightweight stream processing engine. We leverage DuckDB as the stream processing engine, which gives SQLFlow the ability to process 10's of thousands of messages a second using ~250MiB of memory! DuckDB also supports a rich ecosystem of sinks and connectors! https://ift.tt/Klyp86v https://ift.tt/42WNdm1 We were tired of running JVM's for simple stream processing, and also of bespoke one off stream processors I would love your feedback, criticisms and/or experiences! Thank you
17 by dm03514 | 5 comments on Hacker News.
Hello Everyone! We built SQLFlow as a lightweight stream processing engine. We leverage DuckDB as the stream processing engine, which gives SQLFlow the ability to process 10's of thousands of messages a second using ~250MiB of memory! DuckDB also supports a rich ecosystem of sinks and connectors! https://ift.tt/Klyp86v https://ift.tt/42WNdm1 We were tired of running JVM's for simple stream processing, and also of bespoke one off stream processors I would love your feedback, criticisms and/or experiences! Thank you