HTTP Headers

Back to Reports

This is a continuation of work started by Brough Davis as part of his software security project for his Masters in Information Security Engineering. The main goal of this project is to find how many sites use security relevant headers, like for example the X-XSS-Protection or X-Frame-Options headers.

Below you will find a table/histogram showing how many times we found each header (security relevant or not). We access the index page of each site using a "head" request. The list of sites is derived from Alexa's Top 1 Million sites. We try to poll as many sites as possible each day.

As we collect more data, we will plot changes over time.

Statistic summary for Wednesday February 22nd 2012. 20724 distinct hosts.
Header# of Hosts
Content-Type20724
Date20652
Server20522
Connection18483
Set-Cookie16637
X-Powered-By11495
Cache-Control10592
Expires7715
Content-Length7479
Last-Modified7168
Vary6735
Pragma5952
ETag4503
Accept-Ranges4490
X-Pingback2939
P3P1555
X-AspNet-Version1121
X-XSS-Protection852
X-Content-Type-Options842
Link495
Age432
X-Cache430
Via393
Content-Language371
X-UA-Compatible329
Content-Location292
X-Varnish266
Keep-Alive181
WP-Super-Cache161
X-Hacker146
Status146
X-Runtime130
X-Pad113
MicrosoftOfficeWebServer89
X-Nananana78
MS-Author-Via69
X-XRDS-Location66
X-AspNetMvc-Version59
X-Firenze-Processing-Times55
X-Host54
X-Drupal-Cache51
X-Powered-CMS47
X-Cacheable45
Composed-By44
X-Generator44
X-INKT-URI42
X-INKT-SITE42
Content-Encoding39
X-Cache-Lookup38
X-Webserver36
X-PhApp36
X-Powered-By-Plesk32
X-Frame-Options32
X-Cnection28
MicrosoftSharePointTeamServices27
X-Mod-Pagespeed27
X-Server26
Served-By24
X-Umbraco-Version24
X-XN-Trace-Token22
X-Mobilized-By21
X-XN-XNHTML21
X-Rack-Cache17
Access-Control-Allow-Origin17
Content-Script-Type17
X-CF-Powered-By14
Refresh14
Content-Style-Type13
X-Cache-Hits13
X-Robots-Tag13
X-Cache-Info12
X-Outils-CS12
X-Tumblr-User12
X-Tumblr-Usec12
X-Backend11
SPRequestGuid11
X-SharePointHealthScore11
X-ServedBy11
X-Served-By11
IISExport11
Accept-Encoding11
Powered-By-ChinaCache11
X-Firenze-Processing-Time10
Liferay-Portal10
X-PosterousHostName9
X-GitSHA9
X-RateLimit-Remaining9
X-RateLimit-Limit9
R-Host9
X-Vary-Options8
X-Language8
X-Check8
X-Template8
WP-Cache7
X-B2f-Cache-Load7
TCN7
X-Drectory-Script7
X-Request-Id7
X-Content-Encoded-By7
Imagetoolbar7
X-Age6
X-Type6
X-Secret6
X-Content-Digest6
X-Amz-Id-26
Cache6
X-Highwire-SessionId6
X-Trace-App6
X-PHP-Engine6
Real-Hostname6
X-TN-ServedBy6
X-Loop6
Xonnection6
X-Cache-Group6
X-Varnish-Cache6
X-Highwire-RequestId5
Host5
X-Restarts5
X-Amz-Request-Id5
Generator5
MIME-Version5
X-Hits5
X-Hostname5
X-TNCMS-Venue5
X-TNCMS-Version5
X-TNCMS-Served-By5
X-TNCMS-Memory-Usage5
X-TNCMS-Render-Time5
NS-RTIMER-COMPOSITE5
PICS-Label5
COMMERCE-SERVER-SOFTWARE5
CT4
X-UD-Host4
Railo-Version4
Accept-Language4
Accept4
WP-AdvCache-MemCached4
ServerName4
X-DmUser4
MW-Webserver4
X-Request-Start4
X-UD-Method4
X-AH-Environment4
X-Responding-Server4
X-Request-Path4
X-I4
X-Hosted-By4
X-Src-Webcache4
X-Request-Finish4
X-StoreSense4
X-ClientIP4
X-ProStores-StoreApiEntryPoint4
Node4
X-UD-Target4
User-Agent4
X-S3
X-PF-Uncompressing3
X-Cocoon-Version3
From3
X-Matrix-Server3
A-Powered-By3
X-Generated-By3
Charset3
Iinfo3
Cartoon3
Cookie3
X-EdgeRouter3
Page-Completion-Status3
X-SmugMug-Hiring3
X-SmugMug-Values3
X-Yadis-Location3
X-CDN3
X-FB-Debug3
X-Enhanced-By3
Lsrequestid3
X-Cache-Server3
SynthaSite-ID3
X-Node3
Cm-Server3
X-Ignore3
X-Quazar2
X-Webstats-RespID2
X-Page-Generation-Time2
X-Page-Generated-At2
MASTERWEBLET2
X-Vivastreet2
X-JSON-API-TTL2
X-DDC-Arch-Trace2
X-JSON-API-AGE2
Referer2
X-JSON-API-LATENCY2
D2
X-Wix-Renderer-Server2
NnCoection2
X-RE-Ref2
X-LiteSpeed-Cache2
X-Forwarded-For2
X-PvInfo2
Web-Server2
X-Catalyst2
CommunityServer2
X-Country2
ANDO2
X-Cluster-Node2
Proxy-Connection2
Robots2
X-Via-Node2
X-Protocol2
X-TwBackServer2
EMP2
X-Micro-Cache2
X-Duration2
Proxy-Agent2
X-Varnish-Action2
X-ATG-Version2
X-Matrix-Proxy2
X-TTL-Age2
X-Invocation-Time2
Content-Disposition2
X-Country-Code2
X-Frames-Options2
X-Would-Your-GrandPa-Wait2
IBM-Web2-Location2
X-CMS-Version2
X-Your-GrandPa-Would-Wait2
X-Papaya-Cache2
X-Garden-Version2
X-Papaya-Gzip2
X-Header2
X-Cache-Status2
X-ServerID2
X-ELC-Checkpoint42
Server-Name2
Filter-Revision2
X-Amz-Cf-Id2
P3P:CP2
X-Wily-Servlet2
X-MidCOM-Meta-Cache2
X-ApacheServer2
Header2
Publisher2
X-Wily-Info2
ServerID2
Originate-Date2
X-Cache-Hit2
X-Cache-Expires2
X-Source-Host2
X-QuazarCache2
X-Server-ID2
X-Purge-URL2
X-Cache-Debug2
X-Purge-Host2
X-Server-Name2
X-Web-Hosting-Service-Provider1
X-Amz-Meta-S3cmd-Attrs1
Nr-Static-Host1
X-Varnish-Machine1
AmProxy1
X-API-Limit-Remaining1
X-Powered-Developer1
X-Accelerated-By1
X-JOBOFFER1
X-Amz-Id-11
Retry-After1
X-Is-Mobile-Browser1
X-Varnish-Age1
HSID1
X-DeliveryServer1
HostName1
X-HP-CAM-COLOR1
Content-Base1
X-MidCOM-Data-Cache1
Response-Type1
X-Vkk-Server1
Aka-DNS-Name1
MST-Version1
XSecure1
Magicmarker1
X-REDIRECTSERVER1
X-Context-Uid1
X-SATserver1
Window-Target1
X-DEBUG21
Rating1
X-TicketABC-Theme1
X-Application-Version1
X-RSS-CACHE-STATUS1
Upstream-Response-Time1
Application/Zip1
Mega-Cache1
Upstream-Status1
X-HG0051
X-Hrouter1
X-Cache-Action1
Progma1
ISrvName1
X-Real-Server1
Jobb.Assistentpoolen.Se1
Jobb.Gil.Se1
Jobb.Passal.Se1
Open.Jobgate.Se1
Test.Executivepeople.Se1
Www.Mabracertifiering.Se1
Origin1
Www.Mirrorgate.Se1
X-PageCache1
Time1
WEBO1
Compression-Control1
X-IPC-BALANCEID1
X-Jobs1
Is-Cached1
X-FarmId1
X-NoLimit1
X-Confirmit-ID1
No-Cache1
X-SiteFramework1
X-Timer1
Ajax-Info1
Orignator1
X-HomeAway-ServerPageType1
X-Request-Time1
X-Proxy1
X-SOURCE1
X-Cachestatus1
X-Core-Mission1
X-Head-Commit-Id1
X-From1
X-FrameworkVersion1
X-Flex-Evend1
ANUIESF5HOST1
X-UD-REMOTE-ADDR1
X-CMS-CRMSet1
X-Age-Hash1
X-Px1
Docx1
X-CMS-Info1
X-Flex-Lang1
X-SixCMS-CacheInfo1
X-VIP-Info1
ReqId1
ANUIESF5URL1
X-AWC-Cache1
Expire1
RareMVC1
X-Pool-Info1
Mirror1
Content-Control1
X-UD-Loopcounter1
X-CMS-Collection1
X-Lift-Version1
Last-Modified:1
X-Benchmark-Total1
X-Server-By1
X-MTX-DBCache[C-Pri]1
X-Debug-01
X-Flex-Evstart1
Tempo1
Author1
X-CMS-Live1
Http1
X-RemoteIp1
Cubix-Server1
X-Panel-Id1
X-Flex-Tag1
Accept-Charset1
ErrorCodeCount1
X-Internal-Server1
X-Cookie1
X-Artvisual-Server1
Request-Finish1
TCP-Client-Port1
X-Head1
X-CPU-Time1
Resp1
X-SmartBan-Host1
X-CMS-Nid1
Set-Cookie21
X-Content-Age1
X-Onexcale-Version1
X-Smart-Cache1
Xlsx1
X-ACMCache1
X-Cache-Svr1
X-Flex-Lastmod1
KrkosskaHeaders1
QYSID1
X-CMS-Track1
IP-Client-Addr1
Svr1
X-CMS-Server1
X-Cache-01
X-Confluence-Request-Time1
X-Benchmark-Cache1
Machine1
Metrix-Cachesite1
X-Cache-Operation1
X-Zocalo-Cache1
X-MID1
Greenty-LTD1
X-Backend-Ip1
X-Aaid1
X-T3CacheInfo1
X-Bak1
X-Header-Set-Id1
X-Brought-To-You-By1
X-Baked-By1
X-Generated1
X-Instance-Name1
X-Coremedia-Cacheable1
X-Gyrobase-Publication1
X-Continum-Cache1
X-Rewritten-By1
X-ServerNickName1
X-Totalblogs1
Db1
X-Hit-Cache1
X-Tile1
X-T3Cache1
X-Beatles1
X-Caching-Rule-Id1
Noahs-Classifieds1
01
B2f-Router-WisipageRouteRegex1
X-RAMCache1
X-Ba-01
X-Transaction1
X-App-Server1
X-Generated-Time1
X-Esi-Processing1
X-Asid1
X-PWb-Node1
X-LOADED-FROM-CACHE1
X-AspNetWebPages-Version1
X-Benchmark-Sphinx-Count1
X-Processing-Time1
X-MTX-DBCache[C-247]1
X-MTX-DBCache[C-217]1
X-Benchmark-Sphinx1
Route1
X-Benchmark-Db1
X-MTX-DBCache[C-216]1
X-Cache-Rule1
X-Revision1
X-LB-Host1
X-Filmed-By1
X-Cache-TTL1
X-Afp1
X-AppExplorer1
X-Nginx-Cache1
X-Debug-SIP1
X-Dynamic1
Page.Ly1
X-AMXFCGI1
X-SmartBan-URL1
X-ServerName1
SrvName1
Location1
Access-Control-Allow-Credentials1
X-Serendipity-ML-SL-RESET1
RTSS1
X-MadeOn1
X-Worker1
X-ManagedFusion-Rewriter-Version1
X-Serendipity-InterfaceLangSource1
X-CMS1
X-Rootblog1
X-ServerCache-Info1
X-Answer1
Spot1
X-Ravn-Src1
X-ServerCache-Fresh1
X-Cache-Headers-Set-By1
Content-MD51
Origin-Server1
X-Url1
Head1
X-Pixelsilk-Version1
JP1
X-Serendipity-ContentLang1
-Onnection1
X-Software-Info1
X-Serendipity-InterfaceLang1
X-Created-On1
XX-Secured-By1
X-Cached1
X-Id1
X-TISSERVER1
ServedBy1
DCGI-Server1
Thanks1
Source1
X-GLaDOS1
SN1
Edge-Control1
X-Blog1
X-Haiku1
Req-Id1
X-Page-Speed1
X-Src-Loadbalancer1
NLCacheNote1
X-Nitra-Side1
X-Processing-Finished1
X-Session-Reinit1
S1
Exprires1
X-User-Agent1
X-Ttl1
X-Bettercache-Proxy1
Pool1
Access-Control-Allow-Methods1
X-Object-Id1
X-Object-Type1
Beyond-Iis1
X-Processing-Begin1
X-Snapsis-PageBlaster1
X-Handled-By1
X-Hesa-Caching-Strategy1
X-XTM-Node1
X-Nocache1
X-NGINX-CACHED1
X-Phpwcms-Release1
X-VBackend1
SHOULD-BE-HTTPS1
Content1
Www.Jxyxyz.Net1
X-ERM-RunTime1
CachedXSLT1
X-Cache-Control-Orig1
Max-Age1
Request-Time1
X-CDIVarnish-HomePage1
X-Processed-By1
Wrapper1
Srv1
X-Apublish-Id1
X-Hosting1
X-Phpwcms-Page-Processed-In1
X-Changefreq1
X-Flex-Tags1
If-Modified-Since1
X-Via1
Backend1
Request-Start1
X-Generate1
X-Origin1
X-CMS-Sid1
X-Varnish-Hostname1
X-BinarySEC-NoCache1
X-CMS-Stage1
X-Whom1
X-CMS-State1
Language1
A1
SrvID1
X-Oneclick-Backend1
ExecutionTime1
X-Capcom-Uid1
S-Maxage1
X-Pixelsilk-Server1
Load-Balanced1
X-Varnish-TTL1
CacheControl1
CACHED-RESPONSE1
Cahe-Control1
X-Varnish-Cacheable1
X-Varnish-Host1
X-ORACLE-DMS-ECID1
X-LinkFreeze-Control1
X-DIP1
X-NGINX-CACHED-AT1
X-Capcom-Srvr1
Cneonction1
X-Logged-In1
X-Application1
X-ERM-ServerName-AppPage1
RayEngine1
X-Expires-Orig1
Nocache1
X-CMS-Tid1