dealing with modified csv data format

[nun]

I wrote a script which parses csv data files which were provided to me
in the following format.

WL,WA6B,SCRAPE,N,5.99,6.85,8.56,4.98
WL,W30,RULE6"",N,7.90,47.90,6.05,3.15

Note the comma field separator and that some fields have double quotes
in the data.

My script read this data in as follows and all was well:

###############################
# reading data in from file
my (@AoA);
while ( <> ) {
chomp;
push @AoA, [ split /,/ ];
}
################################

Now suddenly I'm being given the data in a slightly different format,
still comma separated but now all fields are enclosed by double quotes,
even those which have double quotes in the data, such as:

"WL","WA6B","SCRAPE","N","5.99","6.85","8.56","4.98"
"WL","W30","RULE6""","N","7.90","47.90","6.05","3.15"


Is there an easy way I can modify my code to deal with this new format,
or must I start over with something like TEXT::CSV instead of split? I'm
no perl guru and am hoping for an easy cure

DB

 

[Paul Lalli]

I wrote a script which parses csv data files which were provided to me
in the following format.

WL,WA6B,SCRAPE,N,5.99,6.85,8.56,4.98
WL,W30,RULE6"",N,7.90,47.90,6.05,3.15

Note the comma field separator and that some fields have double quotes
in the data.

My script read this data in as follows and all was well:

###############################
# reading data in from file
my (@AoA);
while ( <> ) {
chomp;
push @AoA, [ split /,/ ];
}
################################

Now suddenly I'm being given the data in a slightly different format,
still comma separated but now all fields are enclosed by double quotes,
even those which have double quotes in the data, such as:

"WL","WA6B","SCRAPE","N","5.99","6.85","8.56","4.98"
"WL","W30","RULE6""","N","7.90","47.90","6.05","3.15"

Is there an easy way I can modify my code to deal with this new format,
or must I start over with something like TEXT::CSV instead of split? I'm
no perl guru and am hoping for an easy cure

Why not just keep it the way it is, but then remove all the beginning/
ending quotes from each field after you've split?

push @AoA, [ split /,/ ];
s/^"// and s/"$// for @{$AoA[-1]};

Paul Lalli

 

[nun]

I wrote a script which parses csv data files which were provided to me
in the following format.

WL,WA6B,SCRAPE,N,5.99,6.85,8.56,4.98
WL,W30,RULE6"",N,7.90,47.90,6.05,3.15

Note the comma field separator and that some fields have double quotes
in the data.

My script read this data in as follows and all was well:

###############################
# reading data in from file
my (@AoA);
while ( <> ) {
chomp;
push @AoA, [ split /,/ ];
}
################################

Now suddenly I'm being given the data in a slightly different format,
still comma separated but now all fields are enclosed by double quotes,
even those which have double quotes in the data, such as:

"WL","WA6B","SCRAPE","N","5.99","6.85","8.56","4.98"
"WL","W30","RULE6""","N","7.90","47.90","6.05","3.15"

Is there an easy way I can modify my code to deal with this new format,
or must I start over with something like TEXT::CSV instead of split? I'm
no perl guru and am hoping for an easy cure

Why not just keep it the way it is, but then remove all the beginning/
ending quotes from each field after you've split?

push @AoA, [ split /,/ ];
s/^"// and s/"$// for @{$AoA[-1]};

Paul Lalli

That works, and fits the bill as easy - thanks!

DB

 

[John W. Krahn]

I wrote a script which parses csv data files which were provided to me
in the following format.

WL,WA6B,SCRAPE,N,5.99,6.85,8.56,4.98
WL,W30,RULE6"",N,7.90,47.90,6.05,3.15

Note the comma field separator and that some fields have double quotes
in the data.

My script read this data in as follows and all was well:

###############################
# reading data in from file
my (@AoA);
while ( <> ) {
chomp;
push @AoA, [ split /,/ ];
}
################################

Now suddenly I'm being given the data in a slightly different format,
still comma separated but now all fields are enclosed by double quotes,
even those which have double quotes in the data, such as:

"WL","WA6B","SCRAPE","N","5.99","6.85","8.56","4.98"
"WL","W30","RULE6""","N","7.90","47.90","6.05","3.15"


Is there an easy way I can modify my code to deal with this new format,
or must I start over with something like TEXT::CSV instead of split? I'm
no perl guru and am hoping for an easy cure

$ perl -le'
$_ = q[WL,WA6B,SCRAPE,N,5.99,6.85,8.56,4.98];
my @x = split /,/;
print "@x";
$_ = q["WL","WA6B","SCRAPE","N","5.99","6.85","8.56","4.98"];
my @y = map /\A"(.+)"\z/ ? $1 : $_, split /,/;
print "@y";
'
WL WA6B SCRAPE N 5.99 6.85 8.56 4.98
WL WA6B SCRAPE N 5.99 6.85 8.56 4.98




John