Thanks for letting me know. I'll dig into it.
The site was getting hammered by bots and scrapers and I needed to make a lot of adjustments to the site to detect/defend against the swarms of requests that sometimes reached 1600 pages per second.
| Author | Post |
|---|---|
| rearadmiral All-Star Member 6516 Posts 12/11 | Drew, I assume you'll see this. I noticed this yesterday too but thought I just clicked the wrong link. It's still happening today and I've confirmed the issue and that it just isn't an error on my part. With several threads, when I click on the latest page to start reading at the last post, it opens the first page instead. For example, the Blacked thread is 497 pages long. When I click on the link for page 497 (either directly or opening it in a separate page or tab) it defaults back to page one of the thread. I checked a few threads and this is happening in "Girlfriends Films - Fan Thread (Official)," "Mason (aka. Sam No) Appreciation Thread," for example. Oddly, it isn't doing this in other threads. Clicking on the last page link in "Who is the Hottest girl you've seen rim a guy?," "Things You Wouldn't mind seeing LESS of!," and "Favorite porn pics/stills and why you like them," takes me to the last page. Another oddity is that if I select something other than the last page in those that default to the first page, those links sometimes work. It's no big deal, but until I figured out what was going on it was confusing. [Link] |
| Drew Black broken crankshaft 8011 Posts 9/99 | Thanks for letting me know. I'll dig into it. The site was getting hammered by bots and scrapers and I needed to make a lot of adjustments to the site to detect/defend against the swarms of requests that sometimes reached 1600 pages per second. |
| Hardware All-Star Member Your other left 14595 Posts 3/02 | |
| Drew Black broken crankshaft 8011 Posts 9/99 | The scrapers being used are quite intelligent. They can solve the Cloudflare managed challenges, they support cookies, etc. They mimic a browser and are spread out around the world. The ones coming from data centers are easy to spot. The ones coming from Cox and other residential service providers are significantly more challenging. Spent about a week playing whack-a-mole with firewall rules. Eventually integrated a IPInfo's API and used it in combination with detecting abnormal page request patterns. I have app-level blocking and API-rules-based blocking at Cloudflare now too. Pushover alerts to my watch when something starts evading the protections for me to sit down an investigate. If I'm near a computer the detect/shutdown cycle is about 5 to 15 mins now. If I'm not near a computer the automation takes a little longer. May need to implement a honeypot as the next step to slow down the swarms. |
| rearadmiral All-Star Member 6516 Posts 12/11 | |
| Hardware All-Star Member Your other left 14595 Posts 3/02 | |
| rearadmiral All-Star Member 6516 Posts 12/11 |
| Use the code below to link to this topic or a specific post. |
| URL of this thread |
| Link to this post with HTML |
| Link to this post with Forum Code |