Zhiwen Wang 王志文

Global Sunrise & Sunset Data

Description: Global pixel level, daily data of the sunrise and sunset time from year 1700 to present.

• Python Code ↗ Modify to scrape data for any location and period.
• Stata Code ↗ Clean the scraped data.

Data Source: U.S. Naval Observatory

Related Paper: Nutrition, Labor Supply, and Productivity: Evidence from Ramadan in Indonesia

Global Temperature Data

Description: Global pixel level, daily data of average, minimum, and maximum temperature from 1979 to present.

• Python Code ↗ Transfer original NetCDF format data to CSV.
• Stata Code ↗ Merge and clean CSV data.

Data Source: Climate Prediction Center Global Temperature Time Series

Google Search Index Data

Description: Monthly to minutely, country to city level data of search index for selected keywords in all countries from 2004 to latest date.

• Python Code ↗ Scrape search index for any keyword in any region from 2004.

Data Source: Google Trends

Note: Daily, hourly, and minutely level data only available for past 90 days, 7 days, and 4 hours, respectively.

Book/Movie Ratings (Douban)

Description: Data from Douban, a leading book and movie review website with 0.2 billion users in China.

• Python Code ↗ Scrape book information (title, author, rating, etc.).

Data Source: Douban

Wikipedia Data

Description: Encyclopedia information about any object from Wikipedia.

• Python Code ↗ Scrape country code and official languages of any country.

Data Source: Wikipedia

Online Product Data

Description: Information about products sold on online shopping websites.

• Python Code ↗ Scrape product name, brand, shipping fees, etc.

Data Source: Newegg