MDDHosting Forums: Mike W - Viewing Profile - MDDHosting Forums

Jump to content

User Rating: -----

Mike W's Photo
Reputation: 0 Neutral
Group:
Members
Active Posts:
8 (0.07 per day)
Most Active In:
Web Hosting (8 posts)
Joined:
23-January 12
Profile Views:
147
Last Active:
User is offline Jan 31 2012 10:05 PM
Currently:
Offline

My Information

Member Title:
Newbie
Age:
Age Unknown
Birthday:
Birthday Unknown
Gender:
Not Telling Not Telling

Contact Information

E-mail:
Private
  1. Recent Status Updates
  2. About Me
  3. Topics
  4. Posts

Posts I've Made

  1. In Topic: How to track down bot ip's

    31 January 2012 - 10:08 PM

    View Postfshagan, on 30 January 2012 - 09:19 AM, said:

    You can ban bots that don't adhere to the robots.txt file by having a "secret" folder and file that is disallowed in robots.txt and not visible to normal web surfers (no links to it, etc.) Typically people put a no-index, no-follow header in it so it doesn't show up in search engines.

    You then scan your logs for visits to that page, and ban the IPs that find it. Some programs have been written that provide the list of IPs ... see http://www.kloth.net...net/bottrap.php and http://danielwebb.us...tware/bot-trap/

    You could hire someone to implement that kind of thing for you.


    Thanks for the tip. Much appreciated. I'm waiting for a reply from a few people right now. Wish me luck. B)

  2. In Topic: How to track down bot ip's

    27 January 2012 - 11:12 PM

    Hello Mike, thanks for the response. Let me first say that I'm glad I switched to MDD hosting from iPage. My pages now load a lot faster.

    Why would you not recommend blocking more than 50 - 100 ip's? I've read that when people ban bots, they sometimes have to ban a whole range of ip's.

    Banning this bot would justify spending good money at odesk or something. It literally cut my Adsense earnings in half. And I'm willing to spend some money to get it to disappear for a period of time.

    I'm willing to spend a $1,000 or more to get rid of this bot. Do you think this would be enough $$$ to hire an American from odesk to ban the bot by name? I have 4 websites.

    Wow, what a nightmare...But I try to take it in stride :)

  3. In Topic: How to track down bot ip's

    26 January 2012 - 11:31 PM

    Can I ban a bot by it's name, or just ip?

    It looks like in the example I mentioned earlier, the person banned the bot by it's name.

  4. In Topic: How to track down bot ip's

    26 January 2012 - 10:39 PM

    View PostBig Dan, on 26 January 2012 - 12:00 AM, said:

    Don't forget Amazon has a huge cloud hosting service so it's not actually Amazon generating that clicks it's something someone is running on one of their servers.

    --
    If I were you I wouldn't worry much about it. Adsense will automatically filter out 'bad' clicks so long as they aren't coming from you IP address Google isn't likely to penalize you.

    Block the IP range via htaccess (or cPanel's deny access feature) to prevent that bot from sucking down your bandwidth.


    It's not just about not getting banned, my $1 to $4 clicks have vanished since this started. I've been smartpriced and it's affecting my whole account.

    How can I ban these bots that show up in Awestats? Here's an example of one: Unknown robot (identified by 'spider') Hits 641+58

    I don't know how to find the ip range for this bot. Can I ban it by what it identifies itself as ('spider')? And what does the "+" mean under 'hits'? Either way, it appears as if it has visited my site more than 600 times this month. The bot that is causing the invalid clicks is surely visiting my sites quite a bit. Maybe that would be a good place for me to start.

  5. In Topic: How to track down bot ip's

    25 January 2012 - 09:21 PM

    It seems I'm not the only one having this problem. In this thread, an Amazon bot was clicking ads. One guy used the .htaccess file to redirect the bot back to Amazon. B)

    In this thread, a bot was clicking flash ads only. Here's another one involving the Amazon bot. But I haven't seen any Amazon bots.

    Hmmm...just had a thought. @fshagan I mentioned in the OP that I banned a Sitelock bot, but I just banned the ip I found for it. You said these bots used rotating ips. So it could be coming back.

    Sitelock is an upsell that my old host (iPage) uses. Apparently, it's still crawling around my sites looking for 'vulnerabilities.' Why does it not appear in Awestats under spiders, but it shows up in my raw log files? It clearly said 'Sitelock Bot'

    I've read you can ban a bot by it's name or where it originates from. Can I do this with info from my raw access logs?

    I know I'm kinds clueless and am asking a lot of vague questions. I will study up on this immediately. But wow! Where to start...

    What would you do first if you were me?

Friends

Mike W hasn't added any friends yet.

Comments

Mike W has no profile comments yet. Why not say hello?