Reader and Writer component for Cassandra

ypoint solutions

• July 24, 2015 00:00

• Answered

Follow

Hi,

I have used JDBC driver to Read and write to Cassandra Database,However the performance is very bad using external JDBC Driver.
I found PenthoETL(open source) has separate big data components for reading and writing to Cassandra database and its performance is pretty faster than using JDBC driver in CloverETL.

Is there any other way to read and write to Cassandra through CloverETL.
I have gone through following thread, but couldn't help me much.

viewtopic.php?f=4&t=7159

Is Clover team working on building Cassandra reader and writer component?




Thanks.
Bhavin
Data Integration Architect
Ypoint Solutions

• 

  dpavlis

  • July 24, 2015 14:24

  0

  Comment actions Permalink

  If you are skilled in Java, you might try to wrap a piece of Java code from following Datastax/Cassandra blog.
  http://www.datastax.com/dev/blog/bulk-loading
  
  A Reformat component or the new 4.1 version CustomJavaWriter component
  might be used to create the solution.
• 

  kame10

  • February 12, 2019 08:27

  0

  Comment actions Permalink

  Hi,
  
  I have used JDBC driver to Read and write to Cassandra Database,However the performance is very bad using external JDBC Driver.
  I found PenthoETL(open source) has separate big data components for reading and writing to Cassandra database and its performance is pretty faster than using JDBC driver in CloverETL.
  
  Is there any other way to read and write to Cassandra through CloverETL.
  I have gone through following thread, but couldn't help me much.
  
  http://forum.cloveretl.com/viewtopic.php?f=4&t=7159
  
  Is Clover team working on building Cassandra reader and writer component?
  
  
  
  
  Thanks.
  Bhavin
  Data Integration Architect
  Ypoint Solutions

  
  
  Hi,
  Can you please tell me which JDBC driver did you use? There are many drivers available. Few drivers like Thrift are bad in performance and should be avoided.
• 

  Vladimir Barton

  • February 22, 2019 15:14

  0

  Comment actions Permalink

  Hello,
  there are 3 options of how to connect to Cassandra from CloverDX:
  
  

  
  
  • Using a dedicated JDBC driver
  
  
  • Using the Datastax Java library
  
  
  • By calling a script

  
  
  The first option is not recommended as it appears that no one is actively maintaining or supporting JDBC connectors for Cassandra. The Google archive version we found is a couple of years old and is not being actively developed.
  The second option is viable, yet significantly more complex. More information can be found in this Forum article.
  In CloverDX Designer, the third option gets as simple as using an ExecuteScript component and feeding it with the proper script.
  
  I have attached 2 projects to this ticket one of which shows the ExecuteScript approach (option #3) and one of which demonstrates the Datastax driver and custom Java code approach (#2).
  
  Kind regards,

  • Cassandra.zip
  • Cassandra-datastax.zip

Please sign in to leave a comment.