|
**DONOTDELETE**
|
|
(Unregistered)
|
|
11/06/04 07:08 PM
|
|
|
|
|
|
|
|
adding mysql support or other database?
|
|
Im trying to learn java so this article is beyond my ability as I do not consider myself a programmer but I have been reading information about webspiders and seems like a neat idea for collecting information from the web for research how hard would it be to implement a database connection to mysql from this program or other java based webspiders and what about storage options because the information has to be stored somewhere and I would think as much information that is on the web that you could fill your hard drive rather quickly.
|
|
**DONOTDELETE**
|
|
(Unregistered)
|
|
11/30/04 02:21 PM
|
|
|
|
|
|
|
|
|
Re: adding mysql support or other database?
|
|
Java has a database access to MySQL and other databases
via JDBC Connections (see http://java.sun.com/products/jdbc/index.jsp) for more information. What you would do would be to create a database table containing key terms, another table to hold urls, and a third to link the two together. As the spider runs it would add table entries. Database programming in Java is no harder than doing regular file i/o (assuming you know how to code in Java and know some basic SQL commands).
|