Amazon Kinesis Stream with AWS SDK for Java: Difference between revisions

From NovaOrdis Knowledge Base
Jump to navigation Jump to search
No edit summary
Line 23: Line 23:
{{External|https://docs.aws.amazon.com/streams/latest/dev/developing-consumers-with-sdk.html}}
{{External|https://docs.aws.amazon.com/streams/latest/dev/developing-consumers-with-sdk.html}}


{{External|[https://github.com/ovidiuf/playground/tree/master/amazon/kinesis/streams/02-get-records Playground Example]}}
{{External|[https://github.com/ovidiuf/playground/tree/master/amazon/kinesis/streams/02-get-records Playground Example - Consumer with a TRIM_HORIZON Shard Iterator]}}
{{External|[https://github.com/ovidiuf/playground/tree/master/amazon/kinesis/streams/02.1-get-records-latest-shard-iterator Playground Example - Consumer with a LATEST Shard Iterator]}}


Kinesis consumers developed with AWS SDK for Java use a pull model, where the client polls the stream. [[Amazon_Kinesis_Stream_with_Kinesis_Client_Library#Overview|Kinesis Client Library (KCL)]] on the other hand, uses a push model, which is more efficient. In addition, KCL provides failover, recovery and load balancing functionality.
Kinesis consumers developed with AWS SDK for Java use a pull model, where the client polls the stream. [[Amazon_Kinesis_Stream_with_Kinesis_Client_Library#Overview|Kinesis Client Library (KCL)]] on the other hand, uses a push model, which is more efficient. In addition, KCL provides failover, recovery and load balancing functionality.
Line 29: Line 30:
=<span id='Playground_Example'></span><span id='Playground_Examples'></span>Developing Stream Producers=
=<span id='Playground_Example'></span><span id='Playground_Examples'></span>Developing Stream Producers=


{{External|[https://github.com/ovidiuf/playground/tree/master/amazon/kinesis/streams/01-put-record Playground Kinesis Stream - Put Record]}}
{{External|[https://github.com/ovidiuf/playground/tree/master/amazon/kinesis/streams/01-put-record Playground Example - Record Producer]}}

Revision as of 21:05, 20 December 2018

External

Internal

Overview

Relevant Amazon Kinesis Stream concepts: stream name, partition key, sequence number.

Dependency

dependencies {
    implementation 'com.amazonaws:aws-java-sdk-kinesis:1.11.471'
}

Developing Stream Consumers

https://docs.aws.amazon.com/streams/latest/dev/developing-consumers-with-sdk.html
Playground Example - Consumer with a TRIM_HORIZON Shard Iterator
Playground Example - Consumer with a LATEST Shard Iterator

Kinesis consumers developed with AWS SDK for Java use a pull model, where the client polls the stream. Kinesis Client Library (KCL) on the other hand, uses a push model, which is more efficient. In addition, KCL provides failover, recovery and load balancing functionality.

Developing Stream Producers

Playground Example - Record Producer