top of page

DOGE Scraper

Tip Sheet: New Year, New Lawmakers

Reporting Recipe



ree

The DOGE receipt scraper project maintains a set of data tables tracking changes made to the “savings” website hosted by the Department of Government Efficiency (DOGE), formerly known as the United States Digital Service. Sunlight Research Center researcher and data specialist Michael Nolan wrote this script to support their data reporting work at the Minneapolis-based publication MinnPost by tracking DOGE’s reported funding cuts and how they impacted the people of Minnesota. The scraper code is written in python and can be found at the following github repository: https://github.com/m-nolan/doge-scrape


The scraper tracks changes made to the data tables on DOGE’s website — added items, removed items, and changed items — and saves them in more accessible and analyzable CSV files. Archives of six CSV files are maintained, two for each table: contracts, grants, and leases. The first table copy is the most recent table displayed on the DOGE website. The second table copy contains all unique entries that have ever been present in the DOGE website tables since the scraper started tracking them. If a row was entered and changed in one of the tables, the second CSV file will have rows for the original entry and updated value for that given contract, grant, or lease.


Copies of the data tables are currently stored in a repository on Big Local News and can be accessed with a free MuckRock account.

Articles reported using this data:

updated as of May 2025


Questions about how to create something like this yourself? Contact Michael Nolan at michael@sunlightresearch.net.

Questions or comments about Sunlight's workshops and resources? Contact Elizabeth at elizabeth@sunlightsearch.net

 
 
bottom of page