MySQLBulkWriter empty rows

Answered

Comments (2)

  • Avatar
    admin
    Hi,

    From my perspective, I can't see any reason for the behavior you have described. In my testing graph (attached), I am generating 713 records, loading them to my local database using MySQLBulkWriter and I can see in the database that there is the same number of records then. Therefore I believe that it might be related to some data issue.

    To be able to see the script and data being processed by the component, I would suggest you enter "Path to control script" and "Loader input file" attributes in the MySQLBulkWriter component. As long as you enter a filename that does not exist yet at the selected location, it will create the file and leave it at the location after the graph run (both attributes work the same). It means that you can run the graph and then review the data that has been used by the component. (Also, don't forget to delete the files or change the attributes before you run the graph again, otherwise, these files are taken instead of creating and using the new ones).

    Also, the MySQLBulkWriter is using LOAD DATA Statement. You can review all the default values and also in the "Path to control script" file you can see what statement parameters are sent to the database. The script can be adjusted using the "Control script parameters" attribute to make sure the mysql utility is getting the correct setups and interpreting your data correctly.

    In case you are still getting the extra rows and none of the above helped to resolve the situation, please, provide us with a sample of your input data and the script that the component is using (files from "Path to control script" and "Loader input file" attributes) as we can take a further look.

    Thank you. Best Regards,
    Eva
    0
    Comment actions Permalink
  • Avatar
    nismon8er
    So I figured it out..

    There were some line breaks "\n" in one of my fields and for some reason that threw EVERYTHING off when the bulkwriter started working. I removed any "\n" using a Reformat and that fixed my issue.

    Thank you!
    0
    Comment actions Permalink

Please sign in to leave a comment.