Merge part of CSV files

[sparrie2k]

Hi,
I'm trying to merge some CSV files into one. They all have a header
line, a single data line and footer line, but it is only the data line
(minus the first field) that I want to merge. The bit I'm missing-out
from the data line is a line number (always 001 in the single files) so
I'll be doing an incremental count in the combined file. The header and
footer lines are not required at all.
Has anyone got any ideas on a quick and easy way to do this?
TIA,
Dunc

 

[Ben Morrow]

Hi,
I'm trying to merge some CSV files into one. They all have a header
line, a single data line and footer line, but it is only the data line
(minus the first field) that I want to merge. The bit I'm missing-out
from the data line is a line number (always 001 in the single files) so
I'll be doing an incremental count in the combined file. The header and
footer lines are not required at all.
Has anyone got any ideas on a quick and easy way to do this?

It should be pretty trivial if you use the Text::CSV_XS module.

Ben

 

[Tad McClellan]

Hi,
I'm trying to merge some CSV files into one. They all have a header
line, a single data line and footer line, but it is only the data line
(minus the first field) that I want to merge. The bit I'm missing-out
from the data line is a line number (always 001 in the single files) so
I'll be doing an incremental count in the combined file. The header and
footer lines are not required at all.
Has anyone got any ideas on a quick and easy way to do this?

What part of that are you stuck on?

If you show us the code you have so far, we can probably help
you fix it...

 

[cartercc]

Hi,
I'm trying to merge some CSV files into one. They all have a header
line, a single data line and footer line, but it is only the data line
(minus the first field) that I want to merge. The bit I'm missing-out
from the data line is a line number (always 001 in the single files) so
I'll be doing an incremental count in the combined file. The header and
footer lines are not required at all.
Has anyone got any ideas on a quick and easy way to do this?

One way to do this is to write a script that will open each file in
turn, delete all the lines that match your header and footer, and
append whatever is left to the master file. If you want line numbers,
just add a counter that increments once per loop, and concatinate the
counter to your line of text just before you append it.

You can either pass the script a list containing all the file names, or
place all the files into a deparate directory and iterate through all
the files in that directory.

Your algorithm would look something like this:

open OUTFILE for appending
while infiles
open INFILE for reading
remove header line
remove footer line
print OUTFILE counter, line
close OUTFILE
increment counter
close OUTFILE
exit

CC