TclScripts/UrlGrab

How to grab URLs from IRC channels ,save them to mysql, and display them on a webpage:

urlgrab.tcl v0.7 by RufusDE <Thomas.Koester@rz.Uni-Osnabrueck.DE> already handles all the [RegularExpressions regex]'ing nicely, and because [HackerAttitude no problem should ever be solved twice], we just take this one to start with.

It only logs to a text file though, but we have libmysqltcl installed (on s23.org) so we can add MySql commands like this:

# added sql insert by mutante 
set db [mysqlconnect -host localhost -user <user> -password <password> -db ircurls]
mysqlexec $db "INSERT INTO urlgrab SET url="$url",chan="$lchan",nick="$nick",date=now()"
puthelp "privmsg mutante :Added to sql-db : url: $url chan: $lchan nick: $nick date: $ctime"
mysqlclose $db  

i inserted this between row 51 - 57 in the original script.

replace <user> and <password> with your mysql user / pass.

You need to create a database "ircurls" with a table "urlgrab" or whatever you like,

and the table structure is :

Table structure for table `urlgrab`


CREATE TABLE urlgrab (
  id int(5) unsigned NOT NULL auto_increment,
  url varchar(255) default NULL,
  nick varchar(32) default NULL,
  chan varchar(64) default NULL,
  date datetime NOT NULL default '0000-00-00 00:00:00',
  PRIMARY KEY  (id)
) TYPE=MyISAM;

• Now to the output part / webinterface:

You can use f.e. php (or perl) to read from mysql:

Example:

<?php

 $db = mysql_connect("localhost", "<user>", "<pass>");

 mysql_select_db("ircurls",$db);

 $result = mysql_query("SELECT * FROM urlgrab",$db);
 $urlnum=0;

 while ($myrow = mysql_fetch_row($result)) {
  
  printf("%s <a target="new" href="%s">%s</a> %s %s %s 
", 
  $myrow[0], $myrow[1], $myrow[1], $myrow[2], $myrow[3], $myrow[4],$myrow[5]);

$urlnum++;
}

echo "<tr><td colspan="5">Total URLs found: $urlnum</td></tr>";
echo "</table></body></html>";

which,if you play more with it, looks something like:

http://mutante.s23.org/urllog.php , broken link

While creating all this i found out Rufus already offers mysql_urlgrab.tcl , DOH!!!

So you could as well just use that ,but i didnt check it out yet ;)

Rufus is also the maintainer of libmysqltcl himself it seems, so he should know pretty good.

mutante

Related: Eggdrop,MySQL