Today, to get the number of records a jobflow reads, writes or end in error, one has to look at the monitor and double click on it to get jobflow-level stats. Many reporting systems include audit tables, where general statistics about a table load are stored. For instance, I could look at a workflow / jobflow for any given day and see the starting and end time, the number of records read / written, the status, etc.
I can get most of these things from the JobInfo table, but there is valuable information such as the input / output / error records that are embedded in an XML column in the table, that needs to be parsed in order to get that information out.
Would it be possible to write these stats into separate columns so that parsing of the XML file is not needed? This is pretty basic functionality that an ETL tool should provide without much effort. Thanks.