icon/x Created with Sketch.

Splunk Cookie Policy

We use our own and third-party cookies to provide you with a great online experience. We also use these cookies to improve our products and services, support our marketing campaigns, and advertise to you on our website and other websites. Some cookies may continue to collect information after you have left our website. Learn more (including how to update your settings) here.
Accept Cookie Policy

We are working on something new...

A Fresh New Splunkbase
We are designing a New Splunkbase to improve search and discoverability of apps. Check out our new and improved features like Categories and Collections. New Splunkbase is currently in preview mode, as it is under active development. We welcome you to navigate New Splunkbase and give us feedback.
Log4Shell Vulnerability: Information and guidance for you. Get resources.

Accept License Agreements

This app is provided by a third party and your right to use the app is in accordance with the license provided by that third-party licensor. Splunk is not responsible for any third-party apps and does not provide any warranty or support. If you have any questions, complaints or claims with respect to this app, please contact the licensor directly.

Thank You

Downloading CrowdStrike Falcon Data Replicator (FDR) SQS Technical Add-On
SHA256 checksum (crowdstrike-falcon-data-replicator-fdr-sqs-technical-add-on_222.tgz) ef50f015ff779ce0471eff61321fcc9e4271384dabe94ee47c71b8e5ce15fe65 SHA256 checksum (crowdstrike-falcon-data-replicator-fdr-sqs-technical-add-on_220.tgz) 802c10b86a1c1b81590c578e9a9347ce16a6e2d5b3ec6f2a7af6ff329c5c9710 SHA256 checksum (crowdstrike-falcon-data-replicator-fdr-sqs-technical-add-on_200.tgz) 52c14386ec13a8eb6b24361a2521ec3e38e116d5d066850eb693078e444f77cb
To install your download
For instructions specific to your download, click the Details tab after closing this window.

Flag As Inappropriate

splunk

CrowdStrike Falcon Data Replicator (FDR) SQS Technical Add-On

Splunk Cloud
Overview
Details
IN ORDER TO MINIMIZE CONFUSION AND FRUSTRATION FOR CUSTOMERS THAT WANT TO INGEST FDR DATA INTO SPLUNK, CROWDSTRIKE WILL BE OFFICIALLY DECOMMISSIONING THIS ADD-ON. CUSTOMERS SHOULD MIGRATE THEIR INGESTION ARCHITECTURE TO LEVERAGE THE SPLUNK BUILT AND SUPPORTED ADD-ON: https://splunkbase.splunk.com/app/5579/
CROWDSTRIKE WILL CONTINUE TO MAINTAIN THE CURRENT FUNCTIONALITY AS WELL AS WORK TO ADDRESS IDENTIFIED BUGS FOR FDR:SQS TECHNICAL ADD-ON UNTIL FEB 2023

CrowdStrike Falcon Data Replicator (FDR): SQS Technical Add-On is designed to facilitate the ingestion of CrowdStrike FDR data from the CrowdStrike S3 bucket leveraging a CrowdStrike provided SQS queue. This TA was designed to give FDR customers the ability create multiple, distributed inputs to better handle large amounts of data. In addition since the data not filtered it's able to be bulk uploaded into Splunk resulting in faster processing.

IN ORDER TO MINIMIZE CONFUSION AND FRUSTRATION FOR CUSTOMERS THAT WANT TO INGEST FDR DATA INTO SPLUNK, CROWDSTRIKE WILL BE OFFICIALLY DECOMMISSIONING THIS ADD-ON. CUSTOMERS SHOULD MIGRATE THEIR INGESTION ARCHITECTURE TO LEVERAGE THE SPLUNK BUILT AND SUPPORTED ADD-ON: https://splunkbase.splunk.com/app/5579/

CROWDSTRIKE WILL CONTINUE TO MAINTAIN THE CURRENT FUNCTIONALITY AS WELL AS WORK TO ADDRESS IDENTIFIED BUGS FOR FDR:SQS TECHNICAL ADD-ON UNTIL FEB 2023

CrowdStrike Falcon Data Replicator (FDR): SQS Technical Add-On

This technical add-on is designed to connect to a CrowdStrike provided Falcon Data Replicator environment. It leverages the SQS queue to determine if there are available data files to download. Once identified the TA will attempt to download the data file, decompress it and post the data into Splunk.

In almost all cases, multiple inputs will be necessary to ingest the amount of data being produced by FDR in a timely manner.

This Add-On may not be appropriate for all environments.

The amount of data that the Falcon sensor collects is considerable. In some instances, customers may experience a large or growing latecy between the timestamps of events and the indexed time in Splunk. If this does occur, the first action should be to increase the number of inputs, which should allow for an increase in data consumption. While this can often be the solution to ingesting such large amounts of data, there are instances where the amount of data being produced should be handled by a dedicated collection system. This system can leverage a Splunk Universal Forwarder or the Splunk HEC to then push the data into Splunk.

Benefits of using the FDR SQS based TA

  • Multiple inputs can be configured on the same or different systems to increase data collection with minimal risk of data duplication
  • Since there is no data filtering the data is able to be processed faster
  • The SQS queue is leveraged to track when a message is available for processing so there is no checkpoint that needs to be created in Splunk
  • Bulk message posting decreases the amount of time the data is processed, increasing posting time

Considerations before using the FDR SQS based TA

  • There is no ability to filter data, all FDR data will be ingested into Splunk
  • Once a message has been posted to Splunk's internal API it is removed from the SQS queue and cannot be ingested again
  • Specific start dates are not configurable

Please note:

The data provided by FDR is not "real time" and not recommended for use in alerting use cases. The CrowdStrike Event Streams API is designed to facilitate rapid audit and alert data transfer, the Splunk Add-On for the Event Streams API can be found here: CrowdStrike Falcon Event Streams Technical Add-On

For customers interested collecting the AID Master data from FDR, it's also recommended to review the information that is available via the Falcon Devices API. The CrowdStrike Falcon Devices TA can facilitate ingestion of that data into Splunk and can be found here: CrowdStrike Falcon Devices Technical Add-On

This Technical Add-On provides support for:

  • Splunk v8+ with Python 3
  • CrowdStrike Provide FDR S3 and SQS infrastructures
  • CrowdStrike US based, EU and GovCloud environments
  • Multiple customer environments

Offical Documentation can be found here: CrowdStrike Resource Center: CROWDSTRIKE FALCON DATA REPLICATOR (FDR): SQS ADD-ON FOR SPLUNK

CrowdStrike Splunk Integrations:

CrowdStrike App
CrowdStrike Falcon Event Streams Technical Add-On
CrowdStrike Falcon Devices Technical Add-On
CrowdStrike Intel Indicator Technical Add-On
CrowdStrike Falcon Data Replicator (FDR) S3 Technical Add-On
CrowdStrike Falcon Spotlight Data Technical Add-on

Release Notes

Version 2.2.2
April 13, 2022

v2.2.2 replaces all previous versions

This release is primarily to address a reported issue with the way the add-on handled FDRv2 messages

Improvements:

  • Coding update to address reported bug found in the way the add-on handled FDRv2 Messages
  • Improved logging outputs enhanced to provide better tracking of coding changes

Bug Fixes:

  • Corrects a reported bug where inputs were FDRv2 messages were being handled improperly
Version 2.2.0
Dec. 10, 2021

v2.2.0 replaces all previous versions

This release is primarily to address a significant bug reported where the TA would only process the first file listed in the SQS message. This issue is specifically impactful in larger environments where FDR produces multi-part files (specifically in the data folder).

Improvements:

  • Coding update to address reported bug found in the way the add-on handled multiple file listings in SQS messages
  • Improved logging outputs enhanced to provide better tracking of coding changes

Bug Fixes:

  • Corrects a reported bug where inputs were only processing the first file listed in an SQS message
Version 2.0.0
Nov. 1, 2021

Subscribe Share

Are you a developer?

As a Splunkbase app developer, you will have access to all Splunk development resources and receive a 10GB license to build an app that will help solve use cases for customers all over the world. Splunkbase has 1000+ apps from Splunk, our partners and our community. Find an app for most any data source and user need, or simply create your own with help from our developer portal.

Follow Us:
Splunk, Splunk>,Turn Data Into Doing, Data-to-Everything, and D2E are trademarks or registered trademarks of Splunk Inc. in the United States and other countries. All other brand names,product names,or trademarks belong to their respective owners.