Class NameTokenization

  • All Implemented Interfaces:
    java.io.Serializable, Annotatable, SymbolTokenization, Changeable

    public class NameTokenization
    extends WordTokenization
    Simple implementation of SymbolTokenization which uses the `name' field of the symbols. This class works with any non-cross-product FiniteAlphabet, and doesn't need any extra data to be provided.
    Since:
    1.2
    Author:
    Thomas Down
    See Also:
    Serialized Form
    • Constructor Detail

      • NameTokenization

        public NameTokenization​(FiniteAlphabet fab,
                                boolean caseSensitive)
      • NameTokenization

        public NameTokenization​(FiniteAlphabet fab)
        Construct a new NameTokenization, defaulting to case-insensitive.
    • Method Detail

      • finalize

        protected void finalize()
                         throws java.lang.Throwable
        Overrides:
        finalize in class java.lang.Object
        Throws:
        java.lang.Throwable
      • getNameToSymbol

        protected java.util.Map getNameToSymbol()
      • parseToken

        public Symbol parseToken​(java.lang.String token)
                          throws IllegalSymbolException
        Description copied from interface: SymbolTokenization
        Returns the symbol for a single token.

        The Symbol will be a member of the alphabet. If the token is not recognized as mapping to a symbol, an exception will be thrown.

        Parameters:
        token - the token to retrieve a Symbol for
        Returns:
        the Symbol for that token
        Throws:
        IllegalSymbolException - if there is no Symbol for the token