Exchange Item Description:
There is a lot of data out there if you just know where to look, how to harvest it and how to structure it into a larger data ecosystem. In addition to producing analyses, most of these sources also maintain institution profiles available through their web sites. These institution profile web pages have patterns to how their URLs are constructed. As example, NSF institution profiles URLs address by FICE, Scorecard URLs address by IPEDS UNITID, NIH URLs address by their internal OrgID and Collegeboard URLs address by the institution name where the spaces are replaced with hyphens. If you know the URL pattern you can code a hack to address all the institution profile pages for any given site and build a library of resources with little actual searching or harvesting. Such a resource library can then be used to crawl those sites for any data they might contain. All URLs are clickable.
Send corrections or additions to Joe Mantione - email@example.com