|
How can one detect the search engine bots using php??
Started by Terrific on
, 5 posts
by 5 people.
Answer Snippets (Read the full thread at stackoverflow):
Here's a Search) { $lastupdated = date("Ymd", filemtime(FILE_BOTS)); if ($lastupdated != date("Ymd")) { $lists = array("/(^[\r\n]*|[\r\n]+)[\s\t]*[\r\n]+/"....
( $_SERVER['REMOTE_ADDR'] ) with a list of IP addresses of search engine bots .
|
|
I have some code and i wonder how it would stand up against bots. Is there a way i can either run a bot to check the strength of my site or to set real live spam bots on it in a prerelease test? (i can use something.noip.com as a dummy domain)
Started by acidzombie24 on
, 4 posts
by 4 people.
Answer Snippets (Read the full thread at stackoverflow):
You will need to keep the race going on as bots get better....
Over the time, as the popularity of your site rises, bots will spam you.
Set up bots and run them against your site to see if it works well.
You answered your own question.
|
|
I see there are many php (and other) frameworks for writing wikipedia bots, but isn't captcha a problem? Or bots don't have to solve it (but that sounds like there's no point to having captcha in the first place...)? Or maybe i can make my prog stop and...
Started by Phil on
, 3 posts
by 3 people.
Answer Snippets (Read the full thread at stackoverflow):
The user group rights page says that bots can, among other....
Pretty sure they encourage maintenance bots:
http://en.wikipedia.org/wiki/Wikipedia%3ABots
Properly-registered bots do not have to complete the captcha forms on Wikipedia.
|
Ask your Facebook Friends
|
When a user clicks a link to download a file on my website, they go to this PHP file which increments a download counter for that file and then header()-redirects them to the actual file. I suspect that bots are following the download link, however, so...
Started by jeremy Ruten on
, 5 posts
by 5 people.
Answer Snippets (Read the full thread at stackoverflow):
Bots the bots up your counter, then I would....
If you really want to prevent access via bots, make the link to it a POST instead of a GET.
Robots.txt: http://www.robotstxt.org/robotstxt.html
Not all bots respect it, but most do.
|
|
I am building stats for my users and dont wish the visits from bots to be counted.
Now I have a basic php with mysql increasing 1 each time the page is called.
But bots are also added to the count.
Does anyone can think of a way?
Mainly is just the major...
Started by Hugo Gameiro on
, 7 posts
by 6 people.
Answer Snippets (Read the full thread at stackoverflow):
EDIT: Assuming you do not want to restrict the bots find a list of about 300 common user-agents given by bots here: http://www.robotstxt.org/db.html Running through that list and ignoring....
By major companies supply a distinct user-agent.
|
|
Google's Webmaster guidelines state
Allow search bots to crawl your sites without session IDs or arguments that track their path through the site. These techniques are useful for tracking individual user behavior, but the access pattern of bots is entirely...
Started by qntmfred on
, 3 posts
by 3 people.
Answer Snippets (Read the full thread at stackoverflow):
So pretends to be a bot that should....
This might be solved by reducing session timeout (for bot sessions only - if possible).
Some lame robots require you/frameworks).
The correct way to detect bots is by host entry ( Dns.GetHostEntry ).
|
|
I have been noticing on my trackers that bots are visiting my site ALOT. Should I change or edit my robots.txt or change something? Not sure if thats good, because they are indexing or what?
Started by Coughlin on
, 6 posts
by 6 people.
Answer Snippets (Read the full thread at stackoverflow):
We....
Some bots : http://spamhuntress.com/2006/02/13/another-hungry-java-bot/
I had lots of Java bots crawling my will dutifully ignore robots.txt.
Should i change or edit my robots.txt or change something?
Depends on the bot.
|
|
Hello,
I'm making a hit counter. I have a database and I store the IP and $_SERVER['HTTP_USER_AGENT']; of the visitors. Now I need to add a filter, so I can put away the hits, that are made by bots. I found out, that many bots usually keep some common...
Started by Mike on
, 3 posts
by 3 people.
Answer Snippets (Read the full thread at stackoverflow):
After discovering a bot, they disable ....
There are certain systems that try and support semi-current DB of known bot strings from bot in real time through string comparison of the user agent string against a file called spiders.txt.
|
|
I am displaying the email addresses stored in the database on a page using PHP. The email address on a page is displayed as below:
Email: test@example.com
Now the email address shown on a page should use JS spam protection to hide it from spam bots.
Started by snew on
, 8 posts
by 8 people.
Answer Snippets (Read the full thread at stackoverflow):
Making Email Addresses Safe from Bots
You could probably find more using a Google Search of StackOverflow.com
Oh from Spam Bots on Websites
you can try....
At:
Hiding Email from Spam Bots
Displaying Emails for Users, But not Spambots.
|
|
Reserving for future use. If any....
Started by trilljester on
, 14 posts
by 10 people.
Answer Snippets (Read the full thread at vbulletin):
I take it the bots are....
I take it the bots are now registeed users and not showing as guest anymore? hmm i read some one doing this was agaisnt the bots agreements etc? Originally Posted by bashy Hi
Me installed...
Hi
Me installed...
|
