Hey there, I just want to thank everyone for their time and help, you've all been so valuable and solved my problems :-) I needed the hidden max_file_size bit in the form. But i'm also going to look at all your other suggestions you've all made, as what you say makes perfect sense from a coding point of view :-) Again thank you everyone, I don't know what i'd do without you all. Regards Chris - Crazy, but slightly less so than this morning :-) > You may have hit the browser time-out limit, which you can not control (at > least for IE; don't know about others). > > To prevent this, arrange for the script send regularly some invisible > content to the browser > (eg send a HTML comment line every 100 lines of your CSV file) > > HTH > Ignatius > _________________________ > ----- Original Message ----- > From: "Chris Payne" <chris@xxxxxxxxxxxxxxxxx> > To: <php-db@xxxxxxxxxxxxx> > Sent: Tuesday, November 25, 2003 18:54 > Subject: Re: Splitting a CSV file > > > > Hi there, > > > > I did a test on my local machine, set the upload limit for PHP to 50Megs > for > > forms (WAAAYYYY more than I need, but then atleast I know that isn't the > > problem). > > > > Then, I select the file through my web form, put in the delimiter which > > works great on small files. Then, I try the larger file - exactly the > same > > format (As I just cut a portion of the file and pasted into another file > > about with just about 50 entries to test which worked) and then click > send, > > but when I try to echo the result to debug, the array is totally empty, > and > > even tells me it is empty, but only when the file is above a certain size > > (Not worked out what size that is yet though). > > > > The file itself is around 5.4 megs, and I know it's not a server timeout > > issue as i've increased everything I could find in my local Apache config, > > from a timeout of 300 to 3000 (Again, just to eliminate all possible > courses > > that I can think of). The only thing I can think of is that there is some > > illegal char somewhere in the file, but I have no idea what that could be. > > I'm using the straight line up as the delimiter to avoid any , issues etc > > ..... as I know that | isn't used in the file at all. > > > > It's just getting to me, there has to be a reason why :-( I'm using the > > following code (Minus the bit that enters the DB into the database, as > that > > works fine with small files so would with large too): > > > > if ($option == "importcsv") { > > > > if ($userfile == ""){ > > $failed = 'yes'; > > } else { > > > > $row = 1; > > $handle = fopen ("$userfile","r"); > > while ($data = fgetcsv ($handle, 100000, "|")) { > > $num = count ($data); > > $row++; > > > > echo "$data[0];"; > > > > }; > > fclose ($handle); > > > > }}; > > > > Chris > > > > > I've never seen where the file size causes a problem that wasn't one of > > > the file size settings either in the upload form or php.ini. I'd focus > > > on figuring out why it's failing on the large files before trying to > > > split it. No errors at all? Just a blank screen? Are you uploading the > > > file through a browser? > > > > > > <>< Ryan > > > > > > -----Original Message----- > > > From: Matt Babineau [mailto:list_mysql@xxxxxxxxxxxxxxxx] > > > Sent: Monday, November 24, 2003 2:37 PM > > > To: php-db@xxxxxxxxxxxxx > > > Subject: Re: Splitting a CSV file > > > > > > Chris, > > > > > > If you are on a Redhat machine, you could try running a CLI command on > > > this. > > > > > > Try looking up the 'split' command, it may solve your problem if you > > > combine it with some PHP. > > > > > > -Matt > > > > > > On Mon, 2003-11-24 at 19:14, Chris Payne wrote: > > > > Hi there everyone, > > > > > > > > I'm writing an automation system to automatically insert data into a > > > mysql database from a CSV file, and it works great - until I try to > > > insert a large file, then it just doesn't do anything. > > > > > > > > I've set my PHP filesize to 10 Megs so that's not the issue, and a > > > server timeout isn't the issue either. So, is that a way that I can > > > split a CSV file into 2 files if it's larger than a certain size so that > > > I can still use the automation I am working on? > > > > > > > > Actually, I won't see the files as it's for a company who just wants > > > > to be able to select their CSV file (No matter what size) and it will > > > > insert it automatically, and as I said it does work on small files but > > > > > > > not large :-( > > > > > > > > Any help would really be appreciated. > > > > > > > > Chris > > > > > > -- > > > PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: > > > http://www.php.net/unsub.php > > > > > > -- > > > PHP Database Mailing List (http://www.php.net/) > > > To unsubscribe, visit: http://www.php.net/unsub.php > > > > > > > > > > -- > > PHP Database Mailing List (http://www.php.net/) > > To unsubscribe, visit: http://www.php.net/unsub.php > > > > > > -- > PHP Database Mailing List (http://www.php.net/) > To unsubscribe, visit: http://www.php.net/unsub.php > -- PHP Database Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php