modnlp.dstruct

Class BagOfWords

java.lang.Object

java.util.AbstractMap<K,V>

java.util.HashMap

modnlp.dstruct.BagOfWords

All Implemented Interfaces:

java.io.Serializable, java.lang.Cloneable, java.util.Map

public class BagOfWords
extends java.util.HashMap

Store number of tokens indexed by types

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class java.util.AbstractMap

java.util.AbstractMap.SimpleEntry<K,V>, java.util.AbstractMap.SimpleImmutableEntry<K,V>

Constructor Summary

Constructors

Constructor and Description
BagOfWords()
BagOfWords(java.lang.String text)
BagOfWords(java.lang.String text, StopWordList swlist)

Method Summary

Methods

Modifier and Type	Method and Description
int	addToken(java.lang.String type)
void	addTokens(java.lang.String text)
void	addTokens(java.lang.String text, StopWordList swlist)
void	addTypesToFileCount(java.lang.String text) addToFileCount: tokenize text and add 1 for each type (not token) to the frequency list (text is assumed to be a single file)
boolean	containsTerm(java.lang.String type)
static java.util.Set	extractTermCollection(WordFrequencyPair[] wfp)
static java.lang.String[]	extractTermSet(WordFrequencyPair[] wfp)
static java.lang.String[]	extractTermSet(WordScorePair[] wfp)
int	getCount(java.lang.String type)
java.lang.String[]	getTermSet()
WordFrequencyPair[]	getWordFrequencyArray() Return an array of comparable objects (e.g.
WordScorePair[]	getWordScoreArray() Return an array of objects comparable by double-precision floating point numbers
boolean	isIgnoreCase() Get the value of ignoreCase.
java.util.Set	keySet()
void	removeLessThan(int noccur)
void	removeStopWords(StopWordList swl)
void	setIgnoreCase(boolean v) Set the value of ignoreCase.

Methods inherited from class java.util.HashMap

clear, clone, containsKey, containsValue, entrySet, get, isEmpty, put, putAll, remove, size, values

Methods inherited from class java.util.AbstractMap

equals, hashCode, toString

Methods inherited from class java.lang.Object

finalize, getClass, notify, notifyAll, wait, wait, wait

Methods inherited from interface java.util.Map

equals, hashCode

Constructor Detail

BagOfWords

public BagOfWords()

BagOfWords

public BagOfWords(java.lang.String text)

BagOfWords

public BagOfWords(java.lang.String text,
          StopWordList swlist)

Method Detail

addTokens

public void addTokens(java.lang.String text)

addTokens

public void addTokens(java.lang.String text,
             StopWordList swlist)

addTypesToFileCount

public void addTypesToFileCount(java.lang.String text)
                         throws java.io.IOException

addToFileCount: tokenize text and add 1 for each type (not token) to the frequency list (text is assumed to be a single file)

Throws:

java.io.IOException

addToken

public int addToken(java.lang.String type)

removeStopWords

public void removeStopWords(StopWordList swl)

removeLessThan

public void removeLessThan(int noccur)

getCount

public int getCount(java.lang.String type)

containsTerm

public boolean containsTerm(java.lang.String type)

getWordScoreArray

public WordScorePair[] getWordScoreArray()

Return an array of objects comparable by double-precision floating point numbers

getWordFrequencyArray

public WordFrequencyPair[] getWordFrequencyArray()

Return an array of comparable objects (e.g. for sorting)

getTermSet

public java.lang.String[] getTermSet()

extractTermCollection

public static java.util.Set extractTermCollection(WordFrequencyPair[] wfp)

extractTermSet

public static java.lang.String[] extractTermSet(WordFrequencyPair[] wfp)

extractTermSet

public static java.lang.String[] extractTermSet(WordScorePair[] wfp)

keySet

public java.util.Set keySet()

Specified by:

keySet in interface java.util.Map

Overrides:

keySet in class java.util.HashMap

isIgnoreCase

public boolean isIgnoreCase()

Get the value of ignoreCase.

Returns:

value of ignoreCase.

setIgnoreCase

public void setIgnoreCase(boolean v)

Set the value of ignoreCase.

Parameters:

v - Value to assign to ignoreCase.