This is a Splunk Modular Input Add-On for indexing records from Amazon Kinesis.
As this is a Modular Input , you can then configure your Kinesis inputs via Manager->Data Inputs->Kinesis.
Any log entries/errors will get written to $SPLUNK_HOME/var/log/splunk/splunkd.log
The default heap maximum is 64MB.
If you require a larger heap, then you can alter this in $SPLUNK_HOME/etc/apps/kinesis_ta/bin/kinesis.py on line 95
You can declare custom JVM System Properties when setting up new input stanzas.
Note : these JVM System Properties will apply to the entire JVM context and all stanzas you have setup
The way in which the Modular Input processes the received Kinesis records is enitrely pluggable with custom implementations should you wish.
To do this you code an implementation of the com.splunk.modinput.kinesis.AbstractMessageHandler class and jar it up.
Ensure that the necessary jars are in the $SPLUNK_HOME/etc/apps/kinesis_ta/bin/lib directory.
If you don't need a custom handler then the default handler com.splunk.modinput.kinesis.DefaultMessageHandler will be used.
Code examples are on GitHub : https://github.com/damiendallimore/SplunkModularInputsJavaFramework/tree/master/kinesis/src/com/splunk/modinput/kinesis
This project was initiated by Damien Dallimore , email@example.com
Added JSON Object parsing for Cloudwatch to the GZIP handler
tweaks to gzip handler
Pushed default charset decoding out of the main message processing flow and into custom handling , so custom handlers that you implement should in theory be able to process any binary or text payload.
Can now pass the raw payload bytes to your custom message handler ie: if you want to decode binary data
Added a custom GZIP decoder , com.splunk.modinput.kinesis.GZIPDataRecordDecoderHandler
Tweaked the HEC transport.
Added a new custom handler that allows you to declare the fieldnames in the JSON that hold the time and host values of the event.
message_handler_impl = com.splunk.modinput.kinesis.JSONBodyWithFieldExtraction
message_handler_params = timefield=foo,hostfield=goo
Added support to optional output to Splunk via a HEC (HTTP Event Collector) endpoint
Enabled TLS1.2 support by default.
Made the core Modular Input Framework compatible with latest Splunk Java SDK
Please use a Java Runtime version 7+
If you need to use SSLv3 , you can turn this on in bin/kinesis.py
SECURE_TRANSPORT = "tls"
#SECURE_TRANSPORT = "ssl"
Added a custom message handler that just dumps the JSON body.
message_handler_impl = com.splunk.modinput.kinesis.JSONOnlyMessageHandler
Initial Beta release
Splunk's App Certification program uses a specific set of criteria to evaluate the level of quality, usability and security your app offers to its users. In addition, we evaluate the documentation and support you offer to your app's users.
As a Splunkbase app developer, you will have access to all Splunk development resources and receive a 50GB license to build an app that will help solve use cases for customers all over the world. Splunkbase has 1000+ apps and add-ons from Splunk, our partners and our community. Find an app or add-on for most any data source and user need, or simply create your own with help from our developer portal.