TAPoR Text Analysis Portal for Research

Sign in

Beautiful Soup 4 Gathering URLs from a Web Page

Beautiful Soup 4 Gathering URLs from a Web Page

Last Updated: 12/13/2018 12:00:00 AM
Site: https://github.com/TAPoR-3-Tools/Tapor-Coding-Tools/tree/master/tapor_coding_tools/Scraping%20Website/gathering%20url%20with%20beauitful%20soup%204

This code uses Beautiful Soup 4 to gather all the URLs present on a web page (including the redirect and meta data) and saves them in a csv

Documentation

Creator(s): Kynan Ly

Creator's Site:

Creator's Email:

Repository: https://github.com/TAPoR-3-Tools/Tapor-Coding-Tools

Attributes

Type of analysis: Capture Enrichment Gathering
Type of license: Free
Background Processing: Doesn't Run in Background
Ease of Use: Easy
Usage: New
TaDiRAH Goals: Capture Enrichment
TaDiRAH Methods: Cleanup Gathering

Tags

System wide tags

List this tool appear on

Comments

Bennett Kuwan Tchoh

Bennett Kuwan Tchoh

Beautiful Soup was mentioned in this research abstract https://dh2018.adho.org/en/flexibility-and-feedback-in-digital-standards-making-unicode-and-the-rise-of-emojis/

Rating

Suggested Tools