How to set hive configuration in spark code

If you want to use hive for data loading or quering in spark and want to optiize your queries to fetch partitioned data then set below mentioned configurations in our spark code hiveTest.scala object hiveTest  { def main(args: Array[String]) { //Creation of spark context System.setProperty(“spark.serializer”, “org.apache.spark.serializer.KryoSerializer”) val conf = new SparkConf().setAppName(“Load_Hive_Data”) conf.set(“spark.serializer”, “org.apache.spark.serializer.KryoSerializer”) val sc […]

Continue reading