Patents in the field of Tokenization and Segmentation

• Sentence segmentation system

• Method and Device for Word Segmentation

• Sentence segmentation method and sentence segmentation apparatus, machine translation system, and program product using sentence segmentation method

• Single Word Segmentation Method

• Method for dividing sentences in Chinese language into words and its use in error checking system for texts in Chinese language

• Morphological analyzer, natural language processor, morphological analysis method and program

• Chinese Word Segmentation Apparatus

• Segmentation approach for speech recognition systems

• Method of segmentation of chains of words in the training phase of a connected word recognizer

• Method and apparatus for improved tokenization of natural language text

• System and iterative method for lexicon, segmentation and language model joint optimization

• Word segmentation in chinese text

• Method and Apparatus for flexibly assigning Tokenization Procedures

• Method for language-independent text tokenization using a character categorization

• System for chinese tokenization and named entity recognition

• Method and Apparatus for Efficient Segmentation of Compound Words using Probabilistic Breakpoint Traversal

• Character segmentation technique with integrated word search for handwriting recognition

• Customized tokenization of domain specific text via rules corresponding to a speech recognition vocabulary