|
I am trying to write a Python-based Web Bot that can read and interpret an HTML page, then execute an onClick function and receive the resulting new HTML page. I can already read the HTML page and I can determine the functions to be called by the onClick...
Answer Snippets (Read the full thread at stackoverflow):
Well JavaScript, you need to do much of what a full web browser does, except for the rendering.
It supports Javascript through Spidermonkey, and you can even use Firefox for crawling the web.
|
|
There is something I don't get, one of my web apps has a small form that allows you to enter you name and email address to "subscribe" to a user list for a site I maintain. The site is very low traffic, and only useful to a very small number of people...
Started by EJB on
, 10 posts
by 10 people.
Answer Snippets (Read the full thread at serverfault):
If the bot is coming from the same IP address....
A bot could use the form to send thousands of spam emails using your SMTP server.
Let's say a web site contains a HTML form for sending a recommendation, for example.
Post data to that URL.
|
|
I'm building an e-commerce website with a large database of products. Of course, is nice when Goggle indexes all products of the website. But what if some competitor wants Web Scrap the website and get all images and product descriptions?
I was observing...
Started by Click Ok on
, 6 posts
by 6 people.
Answer Snippets (Read the full thread at stackoverflow):
Then, once you've accumulated a stash of legit search.
With whois (in the command line or on a web site).
|
Ask your Facebook Friends
|
I want to write a bot that fetches my mail on Yahoo! but my first problem is I can't fetch the web page where login and password have to be filled in. I do it so:
<?php $the_url = "http://www.yahoo.com/r/l6"; $ua_s = "Opera/9.62 (Windows NT 5.1; U;...
Started by good on
, 6 posts
by 6 people.
Answer Snippets (Read the full thread at stackoverflow):
Вопрос закрыт
Use the PEAR::HTTP_REQUEST it's more clean!
Or better PEAR::Mail_IMAP this won't violating... .
Пиздец.
You could use pop access.
You probably want to set the CURLOPT_FOLLOWLOCATION option to true as the url that you supplied does a redirect .
|
|
I am looking for a good open source bot to determine some quality, often required for google indexing.
For example
find duplicate titles invalid links ( jspider do this, and I think a lot more will do this) exactly the same page, but different urls etc...
Started by llazzaro on
, 3 posts
by 3 people.
Answer Snippets (Read the full thread at stackoverflow):
Google Webmaster Tools is a web-based service (rather than an on-demand ....
There are, however, many open source frameworks for building web crawlers to you to extract the data you need by hooking in your own code.
Exactly what you want.
|
|
I simply want to create an automatic script that can run (preferably) on a web-server, and simply 'clicks' on an object of a web page. I am new to Python or whatever language this would be used for so I thought I would go here to ask where to start! This...
Started by Jon Duvillier on
, 5 posts
by 5 people.
Answer Snippets (Read the full thread at stackoverflow):
I would recommend using the WebBrowser control.
It to drive several web interfaces from script.
|
|
I need to register to a site programmatically. I did it with VB6 (using the IE Web Browser component), but I don't know how to edit textboxes on a website using WebBrowser. I don't need to do it with Webbrowser, it's just that I know it can be done with...
Started by Proton on
, 6 posts
by 5 people.
Answer Snippets (Read the full thread at stackoverflow):
HTH Alex
Thanks to all.
WatiN.aspx
It's more used for web app testing, but for automating web forms it has great features out it's a web app testing framework but it's useful for what you want.
|
|
How can I make a program that checks for updates on this site or facebook, etc.
Started by Mohit Deshpande on
, 5 posts
by 5 people.
Answer Snippets (Read the full thread at stackoverflow):
Can you be more specific....
You either need to use WebClient or implement the HTTP protocol directly in your application .
If you want a more specific answer please ask a more specific question .
You need to use the WebClient class to create HTTP requests .
|
|
I'm looking for a bot that can open, close, and then reopen a browser with a timer, are there already any on here or similar to that?
Started by bigvito19 on
, 14 posts
by 8 people.
Answer Snippets (Read the full thread at thebotnet):
Vbnetsample.blogspot.com/2007...l-process.html bigvito19 I'm looking for a bot that can open, close, and then reopen.
|
|
I bought this camera from my gadgetsandgifts.co.uk as part of a Groupon offer, see link:
www.mygadgetsandgifts.co.uk/brand_watchbot.php
I was having trouble with connecting over the Internet externally (I.e whilst not on my home network). I decided to...
Started by bennygod on
, 16 posts
by 14 people.
Answer Snippets (Read the full thread at avforums):
I appreciate any help I can get to keep and eye on my dog, but bought the watch... .
I don't think you really need a DDNS, just know your external IP with the help of any web site DDNS nor the suggested way above (directly through web browser).
|
