Streaming & messaging

Message brokers sit on both sides of a data platform. On the way out, a transport can publish its rows as individual events so downstream consumers react as data arrives rather than waiting for a batch. On the way in, an incoming message is one of the six ways a transport run can start, which is how a pipeline becomes event-driven instead of scheduled. Kafka and Event Hubs do both, and can additionally carry alerts, so one connection can serve three purposes at once. Every capability is derived from the connector itself, so what a connection can be used for is never a matter of configuration.