Streaming data products

Some data products utilize a streaming API. This enables streaming of events using push technology and provides a subscription mechanism for receiving events in near-real-time. The streaming API subscription mechanism supports multiple types of events. The streaming API uses the Apache Kafka protocol. For information regarding Apache Kafka, see https://kafka.apache.org.

The publish/subscribe model transfers information that is initiated from a server to the subscriber. This type of communication is the opposite of pull technology (as with batch data products), in which a request for information is made from a subscriber to the data product. In push technology, the data product pushes out information to the Subscriber after the Subscriber has subscribed to a channel of information. For the Subscriber to receive the information, the Subscriber must maintain a connection to the data product.

The streaming API uses the Apache Kafka protocol. For information regarding Apache Kafka, see https://kafka.apache.org.

• Connecting as a subscriber

• Message reliability and durability