|
Java example source code file (StemmingPreprocessor.java)
The StemmingPreprocessor.java Java example source codepackage org.deeplearning4j.text.tokenization.tokenizer.preprocessor; import org.tartarus.snowball.ext.PorterStemmer; /** * This tokenizer preprocessor implements basic cleaning inherited from CommonPreprocessor + does english Porter stemming on tokens * * @author raver119@gmail.com */ public class StemmingPreprocessor extends CommonPreprocessor { @Override public String preProcess(String token) { String prep = super.preProcess(token); PorterStemmer stemmer = new PorterStemmer(); stemmer.setCurrent(prep); stemmer.stem(); return stemmer.getCurrent(); } } Other Java examples (source code examples)Here is a short list of links related to this Java StemmingPreprocessor.java source code file: |
... this post is sponsored by my books ... | |
#1 New Release! |
FP Best Seller |
Copyright 1998-2021 Alvin Alexander, alvinalexander.com
All Rights Reserved.
A percentage of advertising revenue from
pages under the /java/jwarehouse
URI on this website is
paid back to open source projects.