Continuous web security research
Top 1 Million Sites
Security Analysis
- 1Msites analysed
- Dailycrawl cadence
- 2015tracking since
- Freeopen data for all
Access data
Explore the dataset
Everything the crawler collects is available in several formats โ pick whichever suits your work.
Support the project
Help keep the crawl running
The crawler needs code, servers and bandwidth โ all of which cost money. The project is funded purely through donations, so your support makes a real difference.
Donate via PayPal to donate@crawler.ninja or use PayPal.Me with the button below. Get in touch for more ways to contribute.
More info
Reports & related materials
The Top 1 Million crawl has been running for over a decade, with a report published roughly every six months detailing key security metrics and the progress made since the last crawl. Browse every report below.
- June2022
- November2021
- March2020
- September2019
- February2019
- August2018
- February2018
- August2017
- February2017
- August2016
- February2016
- August2015
Regular articles on every security feature the crawler tracks are published on the blog. To see how your own site measures up across all of the security headers, scan it for free at securityheaders.com.