​

Earth data

​

Global Sunrise & Sunset Data:

​

Description: Global pixel level, daily data of the sunrise and sunset time from year 1700 to present.

Python code: Modify the Python code to scrape the data in any location and any period.

Stata code: Modify the Stata code to clean above scraped data.

Source: U.S. Navel Observatory

Paper: Nutrition, Labor Supply, and Productivity: Evidence from Ramadan in Indonesia

​

 

Global Temperature Data:

 

Description: Global pixel level, daily data of the average, minimum, maximum temperature from 1979 to present.

Python code: Modify the Python code to transfer the original NetCDF format data to CSV.

Stata code: Modify the Stata code to merge and clean above CSV data.

Source: Climate Prediction Center Global Temperature Time Series

 

 

Internet data

​

Google Search Index Data:

​

Description: Monthly to minutely, country to city level data of search index of selected keywords in all countries from 2004 to latest date.

Python code: Modify the Python code to scrape the search index of any keyword in any region in any time from 2004.

Source: Google trends

Note: The search index data could be used to predict latest trends or as outcome variables to measure intention. Daily, hourly, minutely level data only available in past 90 days, past 7 days, and past 4 hours, respectively

 

​