HTTPS surface reachable (robots ✓, sitemap ✗, title ✓)
Why it matters: Public files — robots.txt, sitemap.xml, head meta — are what attackers see first during reconnaissance. Misadvertised paths, stale sitemaps, and verbose generators leak more than intended (ISO 27001 A.8.9).
robots.txt
present
User-agent: GPTBot
Disallow: /*~*/results.html
User-agent: Sogou web spider
Disallow: */results.html
User-agent: Amazonbot
Disallow: /*~*/results.html
User-agent: meta-externalagent
Disallow: /*~*/results.html
User-agent: Mediapartners-Google
Disallow: /
User-Agent: Pinterestbot
Crawl-delay: 0.2
User-Agent: GoogleOther
Disallow: /c/*
Disallow: */results.html
User-Agent: PetalBot
Disallow: */results.html
User-Agent: *
Disallow: /api/
Disallow: /cart
Disallow: /checkout
Disallow: /order-confirmation
Disallow: /paypal-checkout
Disallow: /paypal-processing
Disallow: *~*/*.html
Disallow: /*/*/*/*,*,*,*,*/*/*.html
Disallow: /*/*/*,*,*,*,/*,*,*,*,/*/*.html
Disallow: /*,*,/*,/results.html
Disallow: *shipping,*
Disallow: /*,/k,*
Disallow: /c/*?*&*&*&*&*&*
Disallow: /c/*?*a*=*-*-*
Disallow: /*?*brand=*~*
Disallow: /*?*senttime=*
Disallow: /*?*send_id=*
Disallow: /*?*dispatch_id=*
Disallow: /*?*token=*
Disallow: /*?*price=*
Disallow: /*?*products=*
Disallow: /*~*~*
Disallow: /octs/track/onecall/*
Disallow: /onecalltracking/*
Disallow: /*?*featuredproduct=
Sitemap: https://api.overstock.com/sitemaps/overstock-v3/us/sitemap.xml
head
- title
- Shop Overstock for Furniture, Rugs & Stylish Outdoor Living.
- description
- Let Overstock.com help you discover designer brands and home goods at the lowest prices online. See for yourself why shoppers love our selection and award-winning customer service.
social
- og:title
- Shop Overstock for Furniture, Rugs & Stylish Outdoor Living.
- og:description
- Let Overstock.com help you discover designer brands and home goods at the lowest prices online. See for yourself why shoppers love our selection and award-winning customer service.
- og:site_name
- overstock.com
- twitter:card
- summary
- twitter:title
- Shop Overstock for Furniture, Rugs & Stylish Outdoor Living.
- twitter:description
- Let Overstock.com help you discover designer brands and home goods at the lowest prices online. See for yourself why shoppers love our selection and award-winning customer service.