Customer Portal

How to show top number of unique values in ProfilerProbe Frequency Histogram

Comments 1

  • Avatar
    Lukas Cholasta
    • Official comment
    Comment actions Permalink

    Hi Shevon,

    Unfortunately, the component cannot be configured this way. It is actually quite old component and its bigger CloverDX Server counterpart - Profiler - has been discontinued completely, therefore, I'm afraid there will be no further development of this component taking place.

     

    Nevertheless, the functionality you seek can be achieved using either quite complicated code (either CTL or Java) or by using couple of existing components. I have prepared an example for you (attached) that contains a testing graph and a subgraph that does the operation itself. The subgraph consists of 4 components and nicely wraps up the operation in case you need to use it multiple times. Let me try to explain the workflow here.

    First, a Normalizer. This step takes the single incoming map record and creates as many records as there are elements in the map. These contain two separate fields for key and for value. This is necessary to be able to easily sort the map entries down the line.

    ExtSort sorts these records based on the value (second field) in order to eventually get only the values that were present the most.

    Dedup limits the number of the already sorted records so this is where we're getting the actual number of records on the output.

    Denormalizer takes the records and creates the same map that we had on the very input of the subgraph so that the output is consistent with the input.

    The CTL code (if any) of the components used is very short and should be quite understandable but if you have any questions, please feel free to ask.

     

    The testing graph is just generating a number of random records and sending it to a ProfilerProbe and then there's the subgraph inserted.

    Unfortunately the forum doesn't allow to upload files other than pictures due to safety reasons, therefore, here is a link to download the example: https://javlingroup-my.sharepoint.com/:u:/g/personal/lukas_cholasta_cloverdx_com/EScrF3bXpVxHqj87jE3oI7MBfdY66XtKHwBiqW1Rf4zE7g?e=lAKfac.

     

    Best regards,

    Lukas

Please sign in to leave a comment.