FasterCSV question

[Reid Thompson]

Given a pipe '|' delimited file ala:
rthompso@jhereg:~$ cat pipedata
A|This is text|Is this supposed to error|
A|This is text|Is this supposed to error|
A|This is text|Is this supposed to error|
A|This is text|Is this supposed to "error"|
A|This is text|Is this supposed to "error"|
A|This is text|Is this supposed to "error"|
A|This is text|Is this supposed to "error"|
A|This is text|Is this supposed to "error"|
A|This is text|Is this supposed to "error"|
A|This is text|Is this supposed to "error"|
A|This is text|Is this supposed to "error"|
A|This is text|Is this supposed to "error"|

and scripting ala:

rthompso@jhereg:~$ cat pipedata.rb
require 'rubygems'
require 'faster_csv'

FasterCSV.foreach("/home/rthompso/pipedata", :col_sep => '|') do |row|
# use row here...
next if row.empty?
puts row
end

Why are rows that contain quoted data deemed MalFormed?

 

[James Edward Gray II]

A|This is text|Is this supposed to "error"|

This line is not a legal CSV format. To be correct it would need to be:

A|This is text|"Is this supposed to ""error"""|

Luckily, it's a trivial format you shouldn't need FasterCSV to
parse. You can break it down with:

fields = line.split("|")

Hope that helps.

James Edward Gray II