Search the Community
Showing results for tags 'kafka connect'.
Found 1 result
-
Hello, I was wondering, would using a Kafka connect source to stream changes to account documents in Couchdb be likely to cause issues for Kazoo? I intend on try this soon with a basic install soon but was wondering if bypassing things like crossbar, amqp etc and monitoring changes in Couchdb directly in a readonly manner would be likely to cause issues? Looking to use, https://github.com/xebia/kafka-connect-couchdb but will only be sourcing data out of couchdb, not trying to sink into it. I think any updates to Kazoo should be made though the appropriate methods such as over crossbar etc. I know there is notifications for changes to account docs over AMQP but they lack the details of what specifically has changed requiring a call to crossbar to get that account doc, but with uncertainty over what has actually changed. So the idea would be to bypass this process and stream changes from couchdb directly to a Topic in Kafka for a stream processor to determine whats changed and then make updates to topic for sink connectors to effect other systems appropriately. Basically am wondering if there is anything about Kazoo which result in this being a no go? Or is there a better approach for determining changes to docs without putting an unnecessarily high load into Kazoo / Crossbar etc