📊 Statistics about HTTP response security headers usage mentioned by the OWASP Secure Headers Project (OSHP).

💾 This project gather data, about the usage of HTTP response security headers, into a SQLITE database to allow the generation of statistics in a second time.

💡 See this issue for details.

• MAJESTIC Top 1 million sites list.
• CISCO Top 1 million sites CSV file.

# Download the MAJESTIC Top 1 million sites CSV file
$ wget https://downloads.majestic.com/majestic_million.csv
# Transform the downloaded file to an input source that use the same format 
# than the CISCO Top 1 million sites CSV file
$ cat majestic_million.csv | awk -F  "," 'NR>1 {print $1 "," $3}' > data/input.csv
$ rm majestic_million.csv

💻 Visual Studio Code is used for the scripts development. A Visual Studio Code workspace file is provided for the project with recommended extensions.

📑 Files:

• gather_data: Script gathering the information about HTTP security headers usage in a SQLITE database based on the "MAJESTIC Top 1 million sites CSV file" data source.
• generate_stats_md_file: Script using the gathered data to generate/update the markdown file stats, with mermaid pie charts with differents statistics about HTTP security headers usage (⚠️not used anymore).

📑 Files:

• input.csv: MAJESTIC Top 1 million sites list formated as one entry ranking,domain by line.
• data.db: SQLITE database with information about HTTP security headers usage.

💻 The update is scheduled in the following way:

• The first day of every month the data database is updated via this workflow.
• The fifth day of every month the statistic data is updated via this workflow.

• DB Browser for SQLite can be used to access to the raw data of the SQLITE DB.