[ka-Map-users] Error with precache

[Stephen Woodbridge]

Bistrais, Bob wrote:
> Hi again,
> 
> Well, I was able to create and save a file with Notepad, but I do think
> probably right, with respect to it being out of file handles.  Do you
> have any code or advice on how you modified the precache.php file?

The code was done on a clients system and I'm not seeing an archived 
copy here. But if you look at the code for precache is is just a series 
of loop something like:

for each mapfile
   for each group
     for each row of metatiles
       for each metatile in the row
         make metatile image
         chop image into tiles

I added arguments for -rs <num> -re <num> to enter row start and row end 
numbers. And then modified the parameters driving the "for each row of 
metatiles" to take the defaults computed or to use my args if present.

I think I also added a -dryrun option to compute all the stats about the 
run without actually generating any tiles.

Then I could run the dryrun, look at the number of rows. Create a batch 
file like:

precache -rs  0 -re  9 ...
precache -rs 10 -re 19 ...
precache -rs 20 -re 29 ...
...

I think I probably added controls to select a single zoom level to 
process also. It was pretty flexible with lots of options. The idea was 
to break the precache effort into a bunch of smaller manageable jobs any 
of which could be repeated without rerunning the WHOLE job from the start.

-Steve

> -----Original Message-----
> From: Stephen Woodbridge [mailto:woodbri at swoodbridge.com] 
> Sent: Monday, December 07, 2009 3:52 PM
> To: Bistrais, Bob
> Cc: ka-map-users at lists.maptools.org
> Subject: Re: [ka-Map-users] Error with precache
> 
> Bistrais, Bob wrote:
>> Thanks Steve.  I should've mentioned, though, I'm on a Windows server 
>> and don't have the touch command available.
> 
> Just try to create a simple file with notepad and save it there will do
> the same thing. All the test does is validate that you can actually
> create additional files there or not.
> 
> I'm guessing that you are probably running into the later problem that I
> mentioned if you are trying to tile a large areas or lots of tiles in a
> single command.
> 
> -Steve
> 
>> -----Original Message-----
>> From: Stephen Woodbridge [mailto:woodbri at swoodbridge.com]
>> Sent: Monday, December 07, 2009 11:39 AM
>> To: Bistrais, Bob
>> Cc: ka-map-users at lists.maptools.org
>> Subject: Re: [ka-Map-users] Error with precache
>>
>> Bistrais, Bob wrote:
>>> I am trying to build precached tiles for several ka-map applications.
>>> For the most part it has gone well, but for some scales I am getting 
>>> error messages.  The precache.php program appears to run well, then I
> 
>>> get the following:
>>>
>>> Trouble:
>>>   199080 errors encountered
>>>   Report [a]ll, [l]ast, [n]one?
>>>
>>> So if I report the last error, the message is:
>>>
>>> Failed to open stream http://localhost/.../tile.php 
>>> <http://localhost/.../tile.php> 
>>> s=3000&t=-488192&l=632832&map=gmap&g=my+group
>>>
>>> There is plenty of disk storage space available and I don't think I'm
> 
>>> overstressing the server.  What does this error mean, and how do I 
>>> get
>>> around it?
>> 1) Check that you have not run out of inodes on the disk.
>>
>> cd /path/to/cache
>> touch junk         # if this fails you have run out of inodes
>> rm junk
>>
>> while df might report that there is still space on the disk, if you do
> 
>> not have anymore inodes then you can not allocate that space for files
> 
>> and your disk is full regardless of space.
>>
>> 2) A few years ago when I was using precache.php, there were problems 
>> with it leaking file some kind of resource that was file related, may 
>> be file handles. Anyway I could not figure it out and change my 
>> strategy to tile a few rows, then exit and then ran it for each set of
> 
>> rows needed until it was done. This allow the precache.php to run then
> 
>> exit before it had problems and allow me to continue processing 
>> without having to restart from the beginning. I think I probably had 
>> to change the script to make it do that.
>>
>> Hope this helps,
>>    -Steve W
>