Monitoring Amazon Kinesis Knowledge Streams | by Ross Rhodes | Sep, 2024

Exploring observability choices and suggesting enhancements

Launched in November 2013, Kinesis is a managed Amazon Net Companies (AWS) resolution for real-time processing and analytics of streaming information. Kinesis gives a pair totally different streaming companies:

• Knowledge Streams to course of information data with out managing servers.
• Video Streams to seize and retailer media streams, e.g. for playback.

There’s already an abundance of documentation on-line which dives into the workings of Kinesis. Amazon’s personal documentation can be an excellent reference to start with. On this weblog submit, we are going to concentrate on Kinesis Knowledge Streams monitoring, following the same format to my earlier submit about EventBridge Guidelines.

We are going to begin with an outline concerning how Kinesis metrics work earlier than masking present Knowledge Stream metric choices of notable curiosity. The place relevant, we are going to pay attention to their limitations. We are going to then end with urged steps that may add buyer worth to Knowledge Stream observability.

Like different AWS companies, Kinesis gives CloudWatch metrics to observe Knowledge Stream efficiency. Two ranges of metrics can be found: stream stage and shard stage. For…