Several integrations for accessing HBase from Spark have occurred in the past.
- The first experimental connector was developed by Cloudera Professional Services, which was called Spark on HBase.
- Cloudera included a derivative of this community version (called hbase-spark) in both CDH 5 and CDH 6
- Hortonworks also came up with an implementation, it was called SHC (Spark HBase connector).
Refer below for compatibility-
Implementation | Spark | Distribution |
hbase-spark | 1.6 | CDH 5 |
hbase-spark | 2.4 | CDH 6 |
hbase-spark | 2.3 | HDP 2.6, HDP 3.1 |
SHC | 2.3 | HDP 2.6, HDP 3.1 |
hbase-connectors | 2.4 | CDP |
Reference - https://community.cloudera.com/t5/Community-Articles/HBase-Spark-in-CDP/ta-p/294868
Comments
Post a Comment