Ä FIDO-HISTORY PROJECT 3rd Generation (2:244/1120) ÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ NETMAIL2A5 Ä
 Msg  : #142 [143]                          Uns Imm Dir Pvt Cra Loc K/s
 By : Ulrich Schroeter                    2:244/1120      Mit 18 Apr 07 04:50
 To : Alex Woick                          2:244/1353
 Subj : [FWD] [FWD] /TMP/NLARCHIVE.ZIP
ÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄÄ
CC: Alex Woick, Steven Leeman

*** Answering a msg posted in area NETMAIL2 (Netmail2).

moin Alex,

Tuesday April 17 2007 21:51, you wrote to me:

 AW> * Kopie an Ulrich Schroeter, Steven Leeman
 US>> I 17.04.2007 10:20:07.154 update_stat: start; get all new
 US>>                           nodelists
 US>> I 17.04.2007 11:46:59.553 update_stat: end
 US>> I 17.04.2007 11:46:59.558 update_history start DBD::mysql::db do
 US>>                           failed: MySQL server has gone away at
 US>>                           nlimport.pl line 69.

 AW> "MySQL server has gone away" means that the connection to the server
 AW> is broken. Look into the <hostname>.err

no infos

 AW>  or mysqld.log file on the

file doesn't exist

 AW> server machine (the logfile where the server is logging to). There
 AW> you may see a server crash. If not, then the client may have done
 AW> something the server didn't like.


 US>> It stops on:
 US>>    $cf::dbh->do($sql);
 US>> D 17.04.2007 11:46:57.470 count nodes for id_nodelist=867
 US>> I 17.04.2007 11:46:59.553 update_stat: end
 US>> I 17.04.2007 11:46:59.558 update_history start
 US>> D 17.04.2007 11:46:59.612 get all id_nl_node: execute sql='SELECT
 US>> DISTINCT id_nl_node FROM nl_line JOIN nl_entry USING (id_nl_line)
 US>> WHERE id_nodelist IN
 US>> (1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,2
 US>> 5,26, 27,28,29, 30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,4
 US>> 6,47,48,49,50,51,52,5 3,54,55,5 6,57,58,59,60,61,62,63,64,65,66,6
 US>> 7,68,69,70,71,72,73,74,75,76,77,78,79 ,80,81,82 ,83,84,85,86,87,8
 US>> 8,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,10 4,105,106 ,
 US>> 107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,1
 US>> 23,1 24,125,12 6,127,128,129,130,131,132,133,134,135,136,137,138,
 US>> 139,140,141,142,143, 144,145,1 46,147,148,149,150,151,152,153,154
 US>> ,155,156,157,158,159,160,161,162,163 ,164,165, 166,167,168,169,17
 US>> 0,171,172,173,174,175,176,177,178,179,180,181,182,18 3,184,185 ,1
 US>> 86,187,188,189,190,191,192,193,194,195,196,197,198,199,200,201,20
 US>> 2,2 03,204,20 5,206,207,208,209,210,211,212,213,214,215,216,217,2
 US>> 18,219,220,221,222, 223,224,2 25,226,227,228,229,230,231,232,233,
 US>> 234,235,236,237,238,239,240,241,242 ,243,244,
 US>> 245,246,247,248,249,250,....,230311,230312)'
 US>>                           ^---  undefined count of wrapped
 US>>                                 lines of continous numbering

 AW>
 AW> You have not identified the entries correctly. The numbers must end at
 AW> 867, because the above statement lists all id's of the imported
 AW> nodelists, and they are 867. The line ending in ",230311,230312)'" is
 AW> from another sql statement, probably from the one in script line 107.

may be ...

 AW> That statement seems to be too long and exceed the packet buffer of
 AW> the server. I create very large sql statements for performance reasons
 AW> and because I never designed the script to run everywhere. Either
 AW> change the 5000 from script line 106 to 2000 for creating smaller (but
 AW> more) insert statements: from
 AW>     my @slice = splice(@history, 0, 5000);
 AW> to
 AW>     my @slice = splice(@history, 0, 2000);
 AW>
 AW> or add
 AW>
 AW> max_allowed_packet = 2097152


changed / added ... and followed all subsequent instructions ...

I:\Apache\Apache2\nlarchive>perl nlimport.pl
I 17.04.2007 23:37:57.348 update_stat: start; get all new nodelists
I 18.04.2007 01:08:15.231 update_stat: end
I 18.04.2007 01:08:15.269 update_history start
I 18.04.2007 02:47:22.648 update_history end


success ... ;)


 AW> to your server's my.ini file. Not on the client - on the server, and
 AW> restart the mysql server, if you changed max_allowed_packet.
 AW>
 AW> It is also neccessary to empty the nl_stat table, otherwise the
 AW> history table will not be updated properly. I apologize for not
 AW> putting the history/statistics operations into a transaction. That is
 AW> for the next version. Now execute the following SQL
 AW> statement: TRUNCATE TABLE nl_stat;
 AW>
 AW> But be happy: The time-consuming import of the nodelist data has
 AW> finished at this point, and the script only builds the statistics and
 AW> history.

i'll know ... but if the initial run doesn't complete and ends in
an undefined state ....   ?-O



 AW> If the script has finished successfully, you don't have to clear
 AW> anything when you import a new nodelist. Just put it into the
 AW> directories and run the importer. It only imports that nodelist and
 AW> updates the statistics and history, not rebuilding it from scratch.



 AW> Tschau
 AW> Alex

thnx.


regards, uli   ;-)