John Calder
07-28-2004, 08:39 PM
Problems with building my site using cgi scripts.
The programmer for the links program i'm using for spiderhub tried all my data on his own host and everything worked perfectly.
less than a second for the index build
4 minutes for the categorybuild and half an hour to build all the links
i can't even get past the index build just now.
i thought it was the size of the database but its definitely not
check this one where it is the exact same data and setup:
http://www.myhotlinks.net/cgi-bin/testdata/build/indexbuild.cgi
now try this one:
http://www.spiderhub.com/cgi-bin/build/indexbuild.cgi
There is a big difference.
Timing out being the main problem.
When I was building the site from scratch today it was ok up to about 4000 entries in the database.
Problems started after that.
Go back a little.
The other link I gave takes less than a second to build the index. That is with over 8000 entries in the database.
There is something wrong somewhere between the scripts and the mysql databases, or so it seems to me.
the script works, the databases work
in between there is definitely something gone haywire
an error message from trying a build thru shell:
[spider@server755 build]$ perl indexbuild.cgi
Can't locate /home/spider/wwwroot/spiderhub.com/cgi-bin/lang/english.pl in @INC (@INC contains: /usr/lib/perl5/5.8.0/i386-linux-thread-multi /usr/lib/perl5/5.8.0 /usr/lib/perl5/site_perl/5.8.0/i386-linux-thread-multi /usr/lib/perl5/site_perl/5.8.0 /usr/lib/perl5/site_perl /usr/lib/perl5/vendor_perl/5.8.0/i386-linux-thread-multi /usr/lib/perl5/vendor_perl/5.8.0 /usr/lib/perl5/vendor_perl /usr/lib/perl5/5.8.0/i386-linux-thread-multi /usr/lib/perl5/5.8.0 .) at ../lang/langset.pl line 5.
Compilation failed in require at indexbuild.cgi line 15.
i've tried editing the files mentioned and adding the lang files and config in the same directory with no luck
Here is another after I did some editing:
[spider@server755 test]$ perl indexbuild.cgi
Content-Type: text/html; charset=ISO-8859-1
<h1>Hot Links SQL Index Build Report</h1>Build: <a href='indexbuild.cgi'>Index Page</a> | Categories: <a href='catbuild.cgi'>Full</a> or <a href='catstepbuild.cgi'>Split</a> | <a href='detailbuild.cgi'>Details Pages</a> | <a href='miscbuild.cgi'>Misc Pages</a><br><br><br>Index Page Built => <a href='http://www.spiderhub.com/index.shtml' target='_blank'>index.shtml</a><p>Index Build took <b>6</b> Seconds
No page built though.
The programmer for the links program i'm using for spiderhub tried all my data on his own host and everything worked perfectly.
less than a second for the index build
4 minutes for the categorybuild and half an hour to build all the links
i can't even get past the index build just now.
i thought it was the size of the database but its definitely not
check this one where it is the exact same data and setup:
http://www.myhotlinks.net/cgi-bin/testdata/build/indexbuild.cgi
now try this one:
http://www.spiderhub.com/cgi-bin/build/indexbuild.cgi
There is a big difference.
Timing out being the main problem.
When I was building the site from scratch today it was ok up to about 4000 entries in the database.
Problems started after that.
Go back a little.
The other link I gave takes less than a second to build the index. That is with over 8000 entries in the database.
There is something wrong somewhere between the scripts and the mysql databases, or so it seems to me.
the script works, the databases work
in between there is definitely something gone haywire
an error message from trying a build thru shell:
[spider@server755 build]$ perl indexbuild.cgi
Can't locate /home/spider/wwwroot/spiderhub.com/cgi-bin/lang/english.pl in @INC (@INC contains: /usr/lib/perl5/5.8.0/i386-linux-thread-multi /usr/lib/perl5/5.8.0 /usr/lib/perl5/site_perl/5.8.0/i386-linux-thread-multi /usr/lib/perl5/site_perl/5.8.0 /usr/lib/perl5/site_perl /usr/lib/perl5/vendor_perl/5.8.0/i386-linux-thread-multi /usr/lib/perl5/vendor_perl/5.8.0 /usr/lib/perl5/vendor_perl /usr/lib/perl5/5.8.0/i386-linux-thread-multi /usr/lib/perl5/5.8.0 .) at ../lang/langset.pl line 5.
Compilation failed in require at indexbuild.cgi line 15.
i've tried editing the files mentioned and adding the lang files and config in the same directory with no luck
Here is another after I did some editing:
[spider@server755 test]$ perl indexbuild.cgi
Content-Type: text/html; charset=ISO-8859-1
<h1>Hot Links SQL Index Build Report</h1>Build: <a href='indexbuild.cgi'>Index Page</a> | Categories: <a href='catbuild.cgi'>Full</a> or <a href='catstepbuild.cgi'>Split</a> | <a href='detailbuild.cgi'>Details Pages</a> | <a href='miscbuild.cgi'>Misc Pages</a><br><br><br>Index Page Built => <a href='http://www.spiderhub.com/index.shtml' target='_blank'>index.shtml</a><p>Index Build took <b>6</b> Seconds
No page built though.