|
I am trying to write a Python-based Web Bot that can read and interpret an HTML page, then execute an onClick function and receive the resulting new HTML page. I can already read the HTML page and I can determine the functions to be called by the onClick...
Answer Snippets (Read the full thread at stackoverflow):
Well JavaScript, you need to do much of what a full web browser does, except for the rendering.
It supports Javascript through Spidermonkey, and you can even use Firefox for crawling the web.
|
|
There is something I don't get, one of my web apps has a small form that allows you to enter you name and email address to "subscribe" to a user list for a site I maintain. The site is very low traffic, and only useful to a very small number of people...
Started by EJB on
, 10 posts
by 10 people.
Answer Snippets (Read the full thread at serverfault):
If the bot is coming from the same IP address....
A bot could use the form to send thousands of spam emails using your SMTP server.
Let's say a web site contains a HTML form for sending a recommendation, for example.
Post data to that URL.
|
|
I'm building an e-commerce website with a large database of products. Of course, is nice when Goggle indexes all products of the website. But what if some competitor wants Web Scrap the website and get all images and product descriptions?
I was observing...
Started by Click Ok on
, 6 posts
by 6 people.
Answer Snippets (Read the full thread at stackoverflow):
Then, once you've accumulated a stash of legit search.
With whois (in the command line or on a web site).
|
Ask your Facebook Friends
|
I want to write a bot that fetches my mail on Yahoo! but my first problem is I can't fetch the web page where login and password have to be filled in. I do it so:
<?php $the_url = "http://www.yahoo.com/r/l6"; $ua_s = "Opera/9.62 (Windows NT 5.1; U;...
Started by good on
, 6 posts
by 6 people.
Answer Snippets (Read the full thread at stackoverflow):
Вопрос закрыт
Use the PEAR::HTTP_REQUEST it's more clean!
Or better PEAR::Mail_IMAP this won't violating... .
Пиздец.
You could use pop access.
You probably want to set the CURLOPT_FOLLOWLOCATION option to true as the url that you supplied does a redirect .
|
|
I am looking for a good open source bot to determine some quality, often required for google indexing.
For example
find duplicate titles invalid links ( jspider do this, and I think a lot more will do this) exactly the same page, but different urls etc...
Started by llazzaro on
, 3 posts
by 3 people.
Answer Snippets (Read the full thread at stackoverflow):
Google Webmaster Tools is a web-based service (rather than an on-demand ....
There are, however, many open source frameworks for building web crawlers to you to extract the data you need by hooking in your own code.
Exactly what you want.
|
|
I simply want to create an automatic script that can run (preferably) on a web-server, and simply 'clicks' on an object of a web page. I am new to Python or whatever language this would be used for so I thought I would go here to ask where to start! This...
Started by Jon Duvillier on
, 5 posts
by 5 people.
Answer Snippets (Read the full thread at stackoverflow):
I would recommend using the WebBrowser control.
It to drive several web interfaces from script.
|
|
I need to register to a site programmatically. I did it with VB6 (using the IE Web Browser component), but I don't know how to edit textboxes on a website using WebBrowser. I don't need to do it with Webbrowser, it's just that I know it can be done with...
Started by Proton on
, 6 posts
by 5 people.
Answer Snippets (Read the full thread at stackoverflow):
HTH Alex
Thanks to all.
WatiN.aspx
It's more used for web app testing, but for automating web forms it has great features out it's a web app testing framework but it's useful for what you want.
|
|
How can I make a program that checks for updates on this site or facebook, etc.
Started by Mohit Deshpande on
, 5 posts
by 5 people.
Answer Snippets (Read the full thread at stackoverflow):
Can you be more specific....
You either need to use WebClient or implement the HTTP protocol directly in your application .
If you want a more specific answer please ask a more specific question .
You need to use the WebClient class to create HTTP requests .
|
|
SuperPoints Lucky Button Bot and Video Bot I have a mac, and the current SuperPoints Bot is not compatible so I made a web version that is more universal allowing everyone an opportunity to use it. All you need is a browser.
Each page load is the equivalent...
Started by rastof on
, 16 posts
by 9 people.
Answer Snippets (Read the full thread at cheatingnetwork):
How does the video bot work? Do I just navigate away from the button page to the video page in the embedded frame? The button part worked....
bot is currently not working for me, i dont want to troll or anything but you didn't leave any today..
|
|
Does anyone out there had a good tutorial or introduction to the various forms of botting? This includes botting for video games and web pages (like spiders, botting, and web scraping). I am not looking for how to do anything malicious, this is purely...
Started by Maximus Pryme on
, 4 posts
by 4 people.
Answer Snippets (Read the full thread at stackoverflow):
Between running a macro recording using something like autoit and having a bot scrape webpages and follow.
|
