- Location
- Salish Sea
Not a welcome visitor here. Can it be blocked?
-
Cameraderie, a friendly photography forum, join now for free!
What's the background story? 🤔
- Location
- Switzerland
- Name
- Matt
What is the "Bytespider" user agent?
Sample user agent String: Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/56.0.1511.1269 Mobile Safari/537.36; Bytespider Mozilla/5.0 (
Only a first lead ...
M.
头条搜索站长平台
头条搜索站长平台是头条搜索与站长沟通交流的平台。站长可以通过sitemap提交、流量索引量监控、抓取频次上限调整等工具进行数据提交、数据监控以及压力控制。
You can look at Members and see Bytespider crawling us.
Clicking it brings you to a Chinese website, Bytedance.
And at this point, I'd like to add that prices on Sonnar Formula Lenses will likely exceed Bitcoin within one year based on insider knowledge. The smart investor will dump worthless Bitcoin and buy SONNAR.
- Location
- Switzerland
- Name
- Matt
For full disclosure's sake, Bitedance is the company behind TikTok (among other things).头条搜索站长平台
头条搜索站长平台是头条搜索与站长沟通交流的平台。站长可以通过sitemap提交、流量索引量监控、抓取频次上限调整等工具进行数据提交、数据监控以及压力控制。zhanzhang.toutiao.com
You can look at Members and see Bytespider crawling us.
Clicking it brings you to a Chinese website, Bytedance.
Prime Chinese internet denizen.
M.
- Location
- Switzerland
- Name
- Matt
Well ... not my business, but maybe an opportunity? (Sorry, not a good joke, really.)
M.
There are Many copies of Bytespider crawling over us- there were 800 Crawlers a few minutes ago, more than 700 now. The majority- Bytespider.
Interesting that the better known web crawlers give a descriptive overview when clicking on them. The Bytecrawler does not- just the Bytedance web development tools when translating to English.
I expect the deficit with China to be made up shortly. Buy Sonnar, not Crypto. The latter- banned in China. They have to buy something with all that profit. And Leica mount manual focus lenses are IN.
Interesting that the better known web crawlers give a descriptive overview when clicking on them. The Bytecrawler does not- just the Bytedance web development tools when translating to English.
I expect the deficit with China to be made up shortly. Buy Sonnar, not Crypto. The latter- banned in China. They have to buy something with all that profit. And Leica mount manual focus lenses are IN.
Last edited:
- Location
- Salish Sea
Said to be cataloguing images for AI. But I have no idea if that's true. At the current level of activity I wonder if there is a hit to traffic on the site. All this stuff is way above and beyond my expertize.
Blocking aggressive Chinese crawlers/scrapers/bots
I urge Kevin to add a firewall to block them
Blocking aggressive Chinese crawlers/scrapers/bots
I urge Kevin to add a firewall to block them
A google Search on Bytedance Bytespider indicates that it is an aggressive bot, that ignores common mutual-agreement methods for limiting Bot activity on a website. Multiple hits on web admins asking how to block it, as it is designed to avoid common methods. These are all in the last few months, so this Bot is causing performance issues on some sites and it is aggressive in the information it collects. There are methods described on how to implement custom Firewall rules to block it on various services, also revealed by the google search.
I am reminded of the Monsters vs Aliens animated series where Susan succeeds in getting an embarrassing Video deleted by screaming "Hey Internet, Internet" into her smart phone after finding out the Internet is run by one Alien that has a crush on her.
HEY BYTEDANCE, Bytedance!
Yet another reason why TikTok and other applications from Bytedance should be banned. This Bot has a reputation of not playing by the rules and aggressively collecting information.
I am reminded of the Monsters vs Aliens animated series where Susan succeeds in getting an embarrassing Video deleted by screaming "Hey Internet, Internet" into her smart phone after finding out the Internet is run by one Alien that has a crush on her.
HEY BYTEDANCE, Bytedance!
Yet another reason why TikTok and other applications from Bytedance should be banned. This Bot has a reputation of not playing by the rules and aggressively collecting information.
Last edited:
ByteDance sued for allegedly collecting biometric data without consent | Engadget
ByteDance is facing a class-action lawsuit over claims that its CapCut video-editing app is vacuuming up data from its more than 200 million active users without consent.
www.engadget.com
Bytedance is being sued over collecting user data without consent. The Bytespider Bot seems to be another tool that they are using to collect as much data as possible.
Ask and you shall receive. 😃
The "Bytespider" bot is getting blocked. There isn't much I can do to prevent them from knocking on our front door [server] but when they do knock they'll be told they're not welcome [403 error].
