Skip to content
TAPoR Text Analysis Portal for Research
Sign in

Tools

Sort by Name Rating ↑ Date

Natural Language Processing

Transkribus

Transkribus is an OCR platform for transcribing hand-written text. After manually transcribing 100 images, scholars can use a trained Handwritten Text Recognition (HTR) engine at the Technical University of Valencia to automate the transcription of the remaining pages of their documents. The platform has a number of tools and features for users in different disciplines.

Rated 0.0 out of 5.

Capture

import.io

import.io is a commercial tool for extracting and structuring web data.

Rated 0.0 out of 5.

Mann–Whitney U test

This test maps the occurrence of a term as it appears in corpora. Ranking them by how often they appear in each text.

Rated 0.0 out of 5.

Search

80legs

80legs is a web crawling service. You need to get an account and then you can create custom crawls that run in the cloud. They also let you filter their Giant Web Crawl and provide clean data about the web.

Rated 0.0 out of 5.

Search

Mozenda

Mozenda offers a web scraping tool/service that you can use to build agents that scrape and then organize how you want the data. You use a client side Windows. They have a free 30 day trial. Otherwise a commercial service.

Rated 0.0 out of 5.

TF-IDF

This tool calculates Term Frequency - Inverse Document Frequency (TF-IDF) for a collection of documents showing the salient words. It also does relative frequency.

Rated 0.0 out of 5.

Capture

Beautiful Soup 4 Gathering URLs from a Web Page

This code uses Beautiful Soup 4 to gather all the URLs present on a web page (including the redirect and meta data) and saves them in a csv

Rated 0.0 out of 5.

Search

Scraping A Webpage - Wikipedia and New York Times

This notebook examines how to scrap a webpage. Here we will be using Wikipedia and New York Times as an example.

Rated 0.0 out of 5.

Uncategorized

Vocabulary Word Lists (Word Banks)

A collection of word lists for different topics from Enchanted Learning. The word lists can be used to measure frequency of topic related words.

Rated 0.0 out of 5.

Plotting Characteristic Curve of Word Lengths

Code that reads a .txt files and plot the characteristic curve of words lengths of the text. Finally it graphs it using matplotlib

Rated 0.0 out of 5.