Customer Portal

Can defaultProperties file into high, medium and low three m

Comments 18

  • Avatar
    jurban
    0
    Comment actions Permalink
    Hello, I'm not sure if I understand your question. Could you please show me an example of what you want to accomplish?

    Thanks!
    Jaro
  • Avatar
    hwhwhw
    0
    Comment actions Permalink
    Need to read/write arbitrary size blob types,Depending on the memory demand, optimizing different configuration file.
    eg.

    jvm configure -Xmx100M
    The contents of the defaultProperties-low is

    Record.MAX_RECORD_SIZE = 8192
    Record.DEFAULT_COMPRESSION_LEVEL=5
    DataParser.FIELD_BUFFER_LENGTH = 512
    DataFormatter.FIELD_BUFFER_LENGTH = 512
    DEFAULT_INTERNAL_IO_BUFFER_SIZE = 32768
    DEFAULT_IOSTREAM_CHANNEL_BUFFER_SIZE = 2048
    ...


    jvm configure -Xmx512M
    The contents of the defaultProperties-medium is

    Record.MAX_RECORD_SIZE =
    Record.DEFAULT_COMPRESSION_LEVEL=
    DataParser.FIELD_BUFFER_LENGTH =
    DataFormatter.FIELD_BUFFER_LENGTH =
    DEFAULT_INTERNAL_IO_BUFFER_SIZE =
    DEFAULT_IOSTREAM_CHANNEL_BUFFER_SIZE =
    ...


    jvm configure -Xmx1024M
    The contents of the defaultProperties-high is

    Record.MAX_RECORD_SIZE =
    Record.DEFAULT_COMPRESSION_LEVEL=
    DataParser.FIELD_BUFFER_LENGTH =
    DataFormatter.FIELD_BUFFER_LENGTH =
    DEFAULT_INTERNAL_IO_BUFFER_SIZE =
    DEFAULT_IOSTREAM_CHANNEL_BUFFER_SIZE =
    ...
  • Avatar
    jurban
    0
    Comment actions Permalink
    So you want to edit the configuration file depending on the value of the -Xmx parameter of JVM? Or do you want to do the opposite, depending on the configuration file you want to set the -Xmx parameter?
  • Avatar
    hwhwhw
    0
    Comment actions Permalink
    depending on the configuration file , to set the -Xmx parameter,edit configuration file to achieve the demand.
  • Avatar
    jurban
    0
    Comment actions Permalink
    what do you run with the jvm command? If Clover then it's not possible to automatically set the -Xmx parameter before clover even starts.
  • Avatar
    hwhwhw
    0
    Comment actions Permalink
    jvm command Parameters from the application I installed,Runtime can specify the use of defaultProperties configuration files which. :)
  • Avatar
    jurban
    0
    Comment actions Permalink
    Sorry, I don't understand. Who runs the jvm command? Do you run it from the SYSTEM_EXECUTE component of clover?

    Jaro
  • Avatar
    hwhwhw
    0
    Comment actions Permalink
    Jdk1.5.0_04\jre\bin\java -Xmx1024m -Xms512m org.jetel.main.runGraph.java graphFileName defaultPropertiesFileName
  • Avatar
    jurban
    0
    Comment actions Permalink
    if you want to change the -Xmx parameter in the command you specified depending on the content of the defaultPropertiesFile, then it's not possible.
  • Avatar
    hwhwhw
    0
    Comment actions Permalink
    Operational procedures, I can according to the different demands and will defaultproperties document, the document put cloveretl.engine.jar org.jetel.data directory.
  • Avatar
    jurban
    0
    Comment actions Permalink
    The values of the defaultProperties don't have a significant impact on the memory requirements of Clover. So you don't need to set the -Xmx parameter based on the values of the properties.

    Of course more memory available to Clover is better, because the garbage collector can run less often.
  • Avatar
    hwhwhw
    0
    Comment actions Permalink
    I need from the file / database input/output to a binary field,eg. blob type field.
    The actual contents of this field is the size of 2 M or greater M, I need to edit defaultProperties content of the document, but the contents of this document directly affects the engine running effect. So the best is to provide an optimal configuration.
  • Avatar
    jurban
    0
    Comment actions Permalink
    I'm sorry, but I'm unable to understand your question.

    Jaro
  • Avatar
    hwhwhw
    0
    Comment actions Permalink
    I want to bring the 10 M from the database BLOB field guide to the delimited text, then the delimited text Introduction to database failure. Can you relate to the configuration file of all parameters and values to me
  • Avatar
    dpavlis
    0
    Comment actions Permalink
    Hi !

    For working with BLOBs (assuming field lengths of 8KB an more), you may use following configuration:

    Record.MAX_RECORD_SIZE = 65536
    DataParser.FIELD_BUFFER_LENGTH = 32768
    DataFormatter.FIELD_BUFFER_LENGTH = 32768
    DEFAULT_INTERNAL_IO_BUFFER_SIZE = 131072


    This should be ok for record sizes up to 65KBs. You may consider using CBYTE field (compressed byte field) for carrying large fields.

    David.
  • Avatar
    hwhwhw
    0
    Comment actions Permalink
    I derived the content of a blob field types into a separation text,the content of this blog field was stored by jpg document or pdf document.
    then take the contents of the documents into the target data table, we found a problem when reading documents, the problem is primarily reflected in DATA_READER read string,encountered ??) Exif or %PDF -1.3% Had problems.

    step 1: DB_INPUT_TABLE -> DATA_WRITER
    step 2: DATA_READER -> DB_OUTPUT_TABLE
  • Avatar
    dpavlis
    0
    Comment actions Permalink
    If you just need to move data from one DB to other, try to use CLOVER_DATA_WRITER & CLOVER_DATA_READER (with the adjusted Defaults). These two work with data in binary(Clover native) form.
  • Avatar
    hwhwhw
    0
    Comment actions Permalink
    Thank you very much help, the problem has been resolved.

Please sign in to leave a comment.