I feel a bit stupid now. Indexing the table works super fast by comparison. No idea what made me think the overhead on updating the index was going to outweigh the benefits. Anyway, thanks for the advice. ----- Original Message ----- From: "graeme" <graeme_foster@xxxxxxxxxxxxxxxx> To: "Evan Morris" <evan@xxxxxxxxxxxxxxxxxxxx>; <php-db@xxxxxxxxxxxxx> Sent: Thursday, October 07, 2004 9:33 AM Subject: Re: Loading large volumes of data > I'd think you want to index the table. Since you are doing a search on > an un-index table for each word, that overhead will be more than > creating an entry in an index table. Entering an index entry will > require the routine to determine where the entry should be but it will > be looking for that in a sorted list and so it will be able to determine > if the entry exist or not fairly quickly, whereas the search on the > unsorted list requires a search of all entries 340,000 and counting (a > binary search would only require 19 comparisons ln N, sure there will > still be some overhead on insert and the occasional re indexing) > > graeme. > -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
