0

Duplicate header names with unique values in fields outputting duplicate values?

Jon Laiben

July 22, 2019 17:41

None

Follow

Using 6.4.0.45 and Delimited File Source objects.  The data set in question contains duplicate header names, but the fields contain distinct values.  For example, given two column header names of "INSERT_DATE", first instance for a record will have a date value of 09/29/2014, while the second has a value of 08/26/2018. 

Even though Centerprise correctly applies a numeric marker to the second instance, the output for both is identical.  In this case, both INSERT_DATE & INSERT_DATE_2 will output 09/29/2014.

I can work around this by manually modifying the source data, but it seems I shouldn't have to do this, as the dataflow editor differentiates the two duplicate header names.

• Facebook
• Twitter
• LinkedIn

5 comments

• 
  Astera Support 3 July 22, 2019 21:11 Official comment

  Hi,

  We have tried to reproduce the same error in the same build. However, it applies a numeric marker to the second instance and produces the distinct values for each record. Even if we put the same header names in the layout, it still provides with the desired result. 
  
  Please confirm if we have interpreted your query correctly. Thanks
  
   

• 0
  
  Jon Laiben July 22, 2019 21:26

  

  You've got it!  I've attached a screenshot illustrating what I'm seeing.  In the preview, field dtInsertDate_5 (which is the second of three fields in the source data named such) should be returning values of 06/14/2019.

  These examples were chosen because of the discrepancy between the two values.  The unhighlighted records are valid examples as well; even though the date portion of the timestamp is correct, the times are wrong.  dtInsertDate_5 should, for most records, be 1-2 minutes later than the first.

  If I modify this second instance of dtInsertDate (which is the LEADDATE field seen, unmapped for this screesnhot) before loading it into the Delim File Source object, it will output correctly.

• 0
  
  Jon Laiben July 23, 2019 13:24

  Here's another screenshot I took this morning that I hope illustrates my issue a little better, including the source data.

  There's too many headers in the DelimSource to capture mapping for both of the date fields.  The preview is the input of the Passthru object.  In the preview, field dtInsertDate is mapped to Col Z in Excel, while LEADDATE is mapped from Col CI.  I would expect to see the Col CI value in LEADDATE, but instead, it's duplicating the value from Col Z.

  

• 0
  
  Astera Support 3 July 23, 2019 18:05

  Hi Jon, 
  
  Go to properties for Source Object and in Advanced file options, make sure that you do not select the second radio button which says 'column order in file may be different from the layout'. You could select any of the first and third button as highlighted.

  After selecting, you will see this following window.

  Please select 'NO' so that your previous changes in the layout are preserved. 

  
  Now if you preview the output for passthru or source object, it should give unique values for both fields as given in the source file.
  
  Please let us know if it works for you. Thank you  

• 0
  
  Jon Laiben July 23, 2019 20:20

  It did indeed resolve the issue.  Thank you for the replies.

  Unfortunately, datasets from this particular vendor tend to have some variance in column order that I can't get rectified from my end consistently.