Register free!

The Green Industry's Resource Center



Reply
 
Thread Tools   Display Modes
  #1  
Old 04-18-2013, 05:18 PM
GreenUtah's Avatar
GreenUtah GreenUtah is offline
LawnSite Senior Member
 
Join Date: May 2005
Location: SLC, UT
Posts: 866
WordPress scraping

I was looking at my error file, which is not big since the site is technically not finished and we're not actively promoting it yet. Low and behold, it looks like the bots are looking for variations on an admin page for WordPress. No WP content or index pages.. specifically admin. Since I don't use WP and have no plans to, they are just sucking wind, but with all the news lately, this is interesting with a brand new site that isn't listed anywhere. That's fun.

__________________
http://www.mygreenutah.com
Reply With Quote
  #2  
Old 04-18-2013, 08:06 PM
greg8872 greg8872 is offline
LawnSite Senior Member
 
Join Date: Jan 2012
Location: Upper Arlington, Ohio
Posts: 276
Your site is listed here, which has high visibility, get used to it, you will have tons of bots trying to visit ya, nothing to worry about usually.
Reply With Quote
  #3  
Old 04-18-2013, 10:09 PM
GreenUtah's Avatar
GreenUtah GreenUtah is offline
LawnSite Senior Member
 
Join Date: May 2005
Location: SLC, UT
Posts: 866
yeah, I know it's listed here..once..lol..and it's showing on first page of google for a search specific to my domain name. I just found it interesting that those 3 specific terms were the keywords being entered/searched for and not content related WP pages (which there were zero entries for) I'll even write one of them as you while you were eyeballing the page perhaps, since I know WP is in your wheelhouse, but that certainly looks like a pattern to me when only variations of the robot.txt (which I also haven't put up) and a couple of mis-pointed internal links were the only other things in this log. (it is from the error log)
__________________
http://www.mygreenutah.com
Reply With Quote
  #4  
Old 04-18-2013, 10:54 PM
greg8872 greg8872 is offline
LawnSite Senior Member
 
Join Date: Jan 2012
Location: Upper Arlington, Ohio
Posts: 276
Nope, it wouldn't be me or anyone else familiar with how sites are built. Simply looking at the source code for the page will tell you if you are using WP.

You have to remember, there are numerous sources out there that give lists of recently registered domain names, and there are tons of systems out there designed to scan those new domains. So it most likely a bot trying to find new WP installs, that are most likely not yet secured, or just to index later for once a vulnerability is published for the current version it finds...

It is quite easy to write a system like that, I know. (Actually, for me, it was a fun puzzle to figure out how to write. I'm just that much of a geek)

-Greg
Reply With Quote
  #5  
Old 05-07-2013, 01:59 PM
Joe Shooner Joe Shooner is offline
LawnSite Member
 
Join Date: Jan 2003
Location: Cincinnati, OH
Posts: 128
That's almost certainly due to the massive wordpress botnet attack:

http://www.webmonkey.com/2013/04/mas...min-passwords/
Reply With Quote
  #6  
Old 05-10-2013, 03:32 PM
Turf Helpers's Avatar
Turf Helpers Turf Helpers is offline
LawnSite Member
 
Join Date: Apr 2013
Location: Fort Wayne, IN
Posts: 25
I agree with Joe. There's absolutley no legitimate reason for a search spider to be crawling for an admin panel unless it was trying to hack it. Legitimate engines will only seek pages through links (through your website or others). A spider just randomly trying to access pages that don't exist sends up all kinds of red flags!
Reply With Quote
  #7  
Old 05-10-2013, 05:42 PM
tonygreek's Avatar
tonygreek tonygreek is offline
LawnSite Silver Member
 
Join Date: Aug 2004
Location: Lancaster, PA
Posts: 2,836
Quote:
Originally Posted by Turf Helpers View Post
A spider just randomly trying to access pages that don't exist sends up all kinds of red flags!
Happens every day. It's only alarming if you're not following best practices.
__________________
a guy who knows the lawn industry, branding, and web strategy

Last edited by tonygreek; 05-10-2013 at 05:50 PM.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump





Powered by vBulletin® Version 3.8.6
Copyright ©2000 - 2014, Jelsoft Enterprises Ltd.
Copyright ©1998 - 2012, LawnSite.comô - Moose River Media
All times are GMT -4. The time now is 08:34 PM.

Page generated in 0.07772 seconds with 9 queries