NLTK wrapper for Splunk
13.6.2018 Dominique Vocat

...should work on all major platforms

Supported actions are:
sentence_tokenize
tokenize_and_tag
word_tokenize
definitions
synonyms
antonyms
lemma
language_detect
sentiment_analysis

Requirements

You must install the Python for Scientific Computing Add-on before installing the Machine Learning Toolkit. Please download and install the appropriate version here:

Mac: https://splunkbase.splunk.com/app/2881/
Linux 64-bit: https://splunkbase.splunk.com/app/2882/
Linux 32-bit: https://splunkbase.splunk.com/app/2884/
Windows 64-bit: https://splunkbase.splunk.com/app/2883/

Installation

The app installation is straight forward
However you need to load the datasets you wish to use with NLTK
Place the packages into the nltk_data folder under bin

You can get all required data from https://github.com/nltk/nltk_data/tree/gh-pages/packages

A complete set of items would look like this:

/opt/splunk/etc/apps/SA-NLTK/bin/nltk_data> ll
total 136
drwx------ 2 splunk splunk 4096 Jun 8 14:01 chunkers
drwx------ 2 splunk splunk 4096 Jun 8 14:01 collections
drwx------ 2 splunk splunk 12288 Jun 8 14:01 corpora
drwx------ 2 splunk splunk 4096 Jun 8 14:01 grammars
drwx------ 2 splunk splunk 4096 Jun 8 14:01 help
-rwx------ 1 splunk splunk 58187 Jun 8 14:06 index.xml
-rwx------ 1 splunk splunk 2098 Jun 8 14:06 index.xsl
-rwx------ 1 splunk splunk 298 Jun 8 14:06 Makefile
drwx------ 2 splunk splunk 4096 Jun 8 14:01 misc
drwx------ 2 splunk splunk 4096 Jun 8 14:02 models
drwx------ 2 splunk splunk 4096 Jun 8 14:19 packages
-rwx------ 1 splunk splunk 127 Jun 8 14:06 README.txt
drwx------ 2 splunk splunk 4096 Jun 8 14:02 sentiment
drwx------ 2 splunk splunk 4096 Jun 8 14:02 stemmers
drwx------ 2 splunk splunk 4096 Jun 8 14:02 taggers
drwx------ 2 splunk splunk 4096 Jun 8 14:02 tokenizers
drwx------ 2 splunk splunk 4096 Jun 8 14:07 tools

NLP Natural Language Toolkit - NLTK wrapper

5