scala

Unable to write multiple queries in foreachbatch

by

import org.apache.spark.sql.SparkSession import org.apache.spark.sql._ import org.apache.spark.SparkConf import org.apache.spark.sql.functions.{col, from_json} import org.apache.spark.sql.types.{IntegerType, StringType, StructType} import java.time.{ZonedDateTime, ZoneId} import java.time.format.DateTimeFormatter object SparkStreamingKafka1 { def main(args:Array[String]):Unit={ System.setProperty("hadoop.home.dir", "C:\hadoop\") val spark = SparkSession.builder().appName("test").master("local[*]").getOrCreate() spark.sparkContext.setLogLevel("OFF") import spark.implicits._ val df = spark.readStream .format("kafka") .option("kafka.bootstrap.servers", "localhost:9092") .option("subscribe", "demo2") .option("startingOffsets", "earliest") // From starting .load() val personStringDF = df.selectExpr("CAST(value AS STRING)") val schema=new … Read more

How to connect to a remote MySQL database via SSL using Play Framework?

by

I deploy Play applications in distributed environments, backed by a remote MySQL database. Specifically, the applications are hosted on heroku, and the database is on Amazon RDS (though this really applies to any remote database connection). Since the database isn’t just on localhost, I’d prefer that the remote MySQL connection is made through SSL for security.