Robot | Path | Permission |
GoogleBot | / | ✔ |
BingBot | / | ✔ |
BaiduSpider | / | ✔ |
YandexBot | / | ✔ |
User-agent: * |
Title | Herr Bischoff’s Bot |
Description | Manually curated list of legitimate and questionable user agents. Includes researched information and useful notes about good and bad bots and |
Keywords | N/A |
WebSite | badbot.org |
Host IP | 88.99.124.138 |
Location | United Kingdom |
Site | Rank |
US$325,727
Last updated: 2023-05-14 01:23:57
badbot.org has Semrush global rank of 32,494,469. badbot.org has an estimated worth of US$ 325,727, based on its estimated Ads revenue. badbot.org receives approximately 37,584 unique visitors each day. Its web server is located in United Kingdom, with IP address 88.99.124.138. According to SiteAdvisor, badbot.org is safe to visit. |
Purchase/Sale Value | US$325,727 |
Daily Ads Revenue | US$301 |
Monthly Ads Revenue | US$9,021 |
Yearly Ads Revenue | US$108,242 |
Daily Unique Visitors | 2,506 |
Note: All traffic and earnings values are estimates. |
Host | Type | TTL | Data |
badbot.org. | A | 86400 | IP: 88.99.124.138 |
badbot.org. | AAAA | 86400 | IPV6: 2a01:4f8:c17:c1ab::1 |
badbot.org. | NS | 86400 | NS Record: c.ns14.net. |
badbot.org. | NS | 86400 | NS Record: a.ns14.net. |
badbot.org. | NS | 86400 | NS Record: b.ns14.net. |
badbot.org. | NS | 86400 | NS Record: d.ns14.net. |
badbot.org. | MX | 86400 | MX Record: 10 mailpod.herrbischoff.com. |
badbot.org. | TXT | 86400 | TXT Record: google-site-verification=uRgP7Yf2S3fXTFH0dxK078otvHwn9A2_E07LEevKFvk |
badbot.org. | TXT | 86400 | TXT Record: v=spf1 -all |
Herr Bischoff’s Bot Database Please find below a manually curated and researched list of users agents I came across. It’s impressive to see how many of the bots active today flat out do not respect robots.txt settings — or claim to do it but ignore them. This list is updated regularly, whenever I spot new user agents and look into their behavior. There is no JavaScript, here no fancy search. Cmd-F and Ctrl-F work beautifully. The information on this site is free as in beer. I take no responsibility for anything related to it and commercial use is explicitly forbidden. Meaning: you are not allowed to sell it, either separate or as part of a product. Otherwise it’s public information. Please don’t do anything stupid. I’m always happy to hear from people this helped in some small way. If you feel like it, drop me a line: marcel@herrbischoff.com AccompanyBot # Notes AI-driven relationship intelligence platform. Basically a sales tool. Website https://www.accompany.com Data Mining Unknown |
HTTP/1.1 301 Moved Permanently Server: nginx Date: Wed, 22 Dec 2021 12:19:32 GMT Content-Type: text/html Content-Length: 162 Connection: keep-alive Location: https://badbot.org/ HTTP/2 200 server: nginx date: Wed, 22 Dec 2021 12:19:32 GMT content-type: text/html; charset=utf-8 content-length: 131784 last-modified: Sat, 08 Aug 2020 19:30:23 GMT vary: Accept-Encoding etag: "5f2efd4f-202c8" expires: Thu, 31 Dec 2037 23:55:55 GMT cache-control: max-age=315360000 content-security-policy: style-src 'self' 'nonce-b3iG8VCURAXgPYrtVvjn' strict-transport-security: max-age=16070400 x-frame-options: SAMEORIGIN x-xss-protection: 1; mode=block x-content-type-options: nosniff referrer-policy: no-referrer-when-downgrade feature-policy: accelerometer 'none'; ambient-light-sensor 'none'; autoplay 'none'; battery 'none'; camera 'none'; display-capture 'none'; document-domain 'none'; encrypted-media 'none'; execution-while-not-rendered 'none'; execution-while-out-of-viewport 'none'; fullscreen 'none'; geolocation 'none'; gyroscope 'none'; layout-animations 'none'; legacy-image-formats 'none'; magnetometer 'none'; microphone 'none'; midi 'none'; navigation-override 'none'; oversized-images 'self'; payment 'none'; picture-in-picture 'none'; publickey-credentials-get 'self'; sync-xhr 'self'; usb 'none'; vr 'none'; wake-lock 'none'; xr-spatial-tracking 'none' accept-ranges: bytes |
WHOIS LIMIT EXCEEDED - SEE WWW.PIR.ORG/WHOIS FOR DETAILS |