I’m using spark 2.4 . I’m new to scala programming . I want to use structure streaming and subscribe to a kafka topic . Please let me know the steps associated with it. I tried with the following but getting an error. Please help in resolving the error.
val df = spark.readStream.format(“kafka”).option(“kafka.bootstrap.servers”, “***:”).option(“subscribe”, “RP_LOGS”).load()
org.apache.spark.sql.AnalysisException: Failed to find data source: kafka. Please deploy the application as per the deployment section of “Structured Streaming + Kafka Integration Guide”.;
… 49 elided