“The Google spreadsheet function =importHTM(””,”table”,N) will scrape a table from an HMTL web page into a Google spreadsheet. The URL of the target web page, and the target table element both need…
“Throughout the election process, our volunteers - more than 10,000 strong - will be entering data and information into OurVote live (developed by the Electronic Frontier Foundation), an interactive…
“Information that is supposed to be private can sometimes inadvertently leak onto the web, through careless coding, or scanning, or editing, or incorrect placement on a server.”
UK-focused but useful for U.S.-based reporting.
Add one insert query and you’re good to go.
Another Python script that can be useful for site scraping. This one will first check to see if anything on a site has changed before initializing the scrape.
Use the Parse Tree second of this Python-based parsing tool to scrape sites.
Need to search through thousands of listserv messages? Do it through email with this cheatsheet.
This a fantastic index of science and environment-related datasets produced by the U.S. government. Checkout DataFerrett (linked on page), which is the data extraction tool. It’s not easy to use, but…
