Neuron ESB User Network

The Service Bus for the Connected Business

Hello All,

Is it possible to instruct the Flat File Wizard to respect qualifiers around CSV fields?

As an example, I have a sample CSV file, with the following structure:

id,count,name
1,7,"Dieckmann, Garrett"

In the CSV above, double-quotes are used as qualifiers around the field that has a comma within the data. When I use the CSV data above as the sample test file in the Flat File Wizard, an "Index was out of range" error is presented.

Is it possible to use the Flat File Wizard with CSV files that have delimiters within the field data, as long as those fields are wrapped in qualifiers?

Or, do we need to parse the CSV within a Code Step?

Thanks,

Garrett D.

Views: 190

Reply to This

Replies to This Discussion

Garrett,

The Flat File Parser has a feature called "User Defined" which allows you to manually define the structure of the flat file and you can designate fields with a quote character.  To do this:

1.  On the Flat File Type wizard page, select your type (comma delimited), click next

2.  On the Comma-Delimited Flat File wizard page, select User Defined (and if your flat file will have column names in the first row, check that box too), click next

3.  On the Set Column Details wizard page, in the Columns box, right click and select Add.  Set the column name, and if that column will have quotes, set the quote character.

4.  In the Columns box, select the row just created, right-click and select Add After Selected Row.  Set the column name, and if that column will have quotes, set the quote character.

5.  Repeat step 4 for each column in your flat file

The reason you have to do it this way is because when you provide the wizard with a sample flat file it attempts to load it into the flat file engine based on the settings already provided (assuming no quoted fields).  We added the "User Defined" option for this very use case.

Let me know if you need any more help!

Joe

Ah!

Thank you for pointing that out Joe.

Garrett D.

RSS

Neuron ESB Product Support Forums and Communities

Latest Activity

Anupama Nair posted a discussion

Marketo Adapter Invalid Token

Hi,We are using the Marketo adapter to push account updates to Marketo. It works well for some time then starts failing with Invalid Token unless restarted. Is there a configuration that can be done so it can auto refresh the token when required?Thanks!See More
Nov 6, 2023
Sayantini Basak posted a discussion

Maximum payload size(REST API) for requests interfacing to NeuronESB

I am new to Neuron ESB and in our current scenario,We need to process batch transactions comprising of ~1000 records and send them to Neuron ESB for further processing. I would like to understand what is the maximum size of payload that can be transferred using REST interface to Neuron ESB.See More
Jul 22, 2022
Profile IconRobert E Dunie and Sayantini Basak joined Neuron ESB User Network
Apr 28, 2022
Profile IconDayanand, Frederic C, Steffen Greve-Oksfeldt and 1 more joined Neuron ESB User Network
Mar 16, 2022
Profile IconCam Vong and Mitja Luznar joined Neuron ESB User Network
Jan 27, 2022
Profile IconWill Hitzges, Chad Parsons, michael larsen and 4 more joined Neuron ESB User Network
Jun 11, 2021
Anupama Nair posted a discussion

ODBC stored proc polling with temporary tables

We have set up an ODBC adapter to poll a stored proc.We found that if the stored proc has a temporary table defined the rows returned are always 0.Any idea why this would be and what we can do to get around it?See More
Dec 14, 2020
Prasanth Kharade is now a member of Neuron ESB User Network
Dec 30, 2019

Badge

Loading…

© 2024   Created by Neuron Admin.   Powered by

Badges  |  Report an Issue  |  Terms of Service