 |
 |
Need Web Data Mining App
|
|
|
|
|
Senior User
Join Date: Mar 2001
Location: Toronto, Ontario, Canada
Status:
Offline
|
|
Hi everyone,
What I would love is a program where I could just enter in a stock symbol, and based on that, go to a few sites to grab some data (ie. to finance.yahoo.com to grab the stock price, cboe to grab the option chain) and then output the data all formatted to my liking on the screen. This would save me a lot of time, instead of having a ton of Explorer windows digging for the data and typing it manually.
I've been told this could be done by HTML, others have suggested Applescript, some say I can even do it in Excel. I was curious to know if someone could provide some advice on how I could build such an application. Heck, I'd even consider paying someone to do it. I've got everything mapped out (from sequence of events and sites to go to and what to grab to a template on how I want the output).
If anyone could offer any suggestions or their services, please let me know!
Kestral
|
|
|
| |
|
|
|
|
|
|
|
Moderator  Join Date: Sep 2000
Location: Irvine, CA
Status:
Offline
|
|
|
|
|
{{{ mindwaves }}}
|
| |
|
|
|
|
|
|
|
Senior User
Join Date: Mar 2001
Location: Toronto, Ontario, Canada
Status:
Offline
|
|
Thanks for the reply mindwaves!
I did some more research and found out that yes indeed this can be done using AppleScript and a shareware AppleScript-able Application called WebMiner. Only thing is, I've still never written an AppleScript before (not in the sense of one that actually did something useful). So I'm mucking about at the moment trying to figure it out. If anyone here is good with AppleScript and would be interested in writing this in exchange for some form of goods or services, would greatly appreciate it, just let me know.
Kestral
|
|
|
| |
|
|
|
|
|
|
|
Mac Elite
Join Date: Mar 2001
Status:
Offline
|
|
Well if AppleScript can do it then you can probably use PHP to do it, too. I mean what you sound like you want to do is take submit info to multiple pages and parse the results of the returned HTML pages and put together a page with just the info that you want. You'd basically tell the script to do what your brain does - look at the HTML code and when it finds the section that you're interested in, copy the code, write it to a text (ahem.. HTML) file and display it in the browser of your choice...
|
|
|
| |
|
|
|
|
|
|
|
Senior User
Join Date: Mar 2001
Location: Toronto, Ontario, Canada
Status:
Offline
|
|
Originally posted by Raman:
Well if AppleScript can do it then you can probably use PHP to do it, too. I mean what you sound like you want to do is take submit info to multiple pages and parse the results of the returned HTML pages and put together a page with just the info that you want. You'd basically tell the script to do what your brain does - look at the HTML code and when it finds the section that you're interested in, copy the code, write it to a text (ahem.. HTML) file and display it in the browser of your choice...
Hi Raman,
Yup! You got it! That's exactly what I'm looking for! Could you tell me what PHP is? (Sounds like a programming language) and where I could find out more info on how to get such a program or find someone to write something like this?
Kestral
|
|
|
| |
|
|
|
|
|
|
|
Grizzled Veteran
Join Date: Jan 2000
Location: California
Status:
Offline
|
|
You can learn all about php here: http://www.php.net and http://www.phpbuilder.com
You also might want to take a look to see if there are scripts already built that would accomplish what you are trying to do, take a look at http://www.hotscripts.com
hope this helps!
------------------
<A HREF="http://www.randomchicken.com/" TARGET=_blank> 
Promote Chicken Randomness</A>
|
|
|
| |
|
|
|
|
|
|
|
Mac Elite
Join Date: Mar 2001
Status:
Offline
|
|
Yes, there are a bazillion and 1 pre-made php scripts. PHP is a scripting language that looks like c, java, perl, etc.. many people use PHP for building dynamic web pages (like jsp and asp and the like).
If you're using OSX then you can install the PHP modules for the Apache webserver and cook up your own website on your own computer.
|
|
|
| |
|
|
|
|
|
|
|
sanguerent
|
|
Originally posted by Kestral:
If anyone could offer any suggestions or their services, please let me know!
Kestral,
If you're still working on this/interested in this (and notice this post), email me at colter-at-mac-dot-com. It sounds like I've already got something similar to what you want to do working on my web site, and adding anything specific you're interested in (like the options chains from cboe) should be easy to add.
Let me know.
Colter
|
|
|
| |
|
|
|
|
|
|
|
|
|
|
|
|
 
|
|
|
Forum Rules
|
|
|
|
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
|
HTML code is Off
|
|
|
|
|
|
|
|
|
|
|
|
|
Top
