This tool splits an HTML document at specified points into 'tokens' - words, lines, sentences, paragraphs or characters. The user can specify characters, patterns, or tags upon which to separate tokens, and choose to have the results listed separator removed, appearing before the split, or appearing after the split. Versions are also available for HTML and plain text within the TAPoR toolset.
Comments