pyspark read hbase Convert to dataframe

Environment configuration

  1. edit spark-defaults.conf file. add the following configuration

2. save the following code as hbase_df.py

3. run hbase_df.py

We can use this method to read hbase and convert to spark dataframe, do not need use other project or develop

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store