playerpana.blogg.se

Sometimes the dependencies in pom.xml are not automatically loaded hence, re-import the dependencies or restart the IntelliJ.

Val sparkSession2 = SparkSession.builder() Our hello world example doesn’t display “Hello World” text instead it creates a SparkSession and displays the Spark app name, master, and deployment mode to the console. Now create the Scala class SparkSessionTest program, I will treat this as a Hello World Program for Spark. Create Spark Hello world Application on IntelliJġ. Add Spark Dependencies to Maven pom.xml Fileĩ. Now delete the following from the project workspace.Ĩ. First, change the Scala version to the latest version, I am using 2.13.0 Now, we need to make some changes to the pom.xml file, you can either follow the below instructions or download the pom.xml file GitHub project and replace it with your pom.xml file.ġ. Choose Scala version 2.13.0 (latest at the time of writing this article) 6. From the next window select the Download option andĥ. Select Setup Scala SDK, it prompts you to the below window,Ĥ. If this doesn’t show up then You can add Scala SDK as a global library for your project in ` Project Settings -> Platform Settings / Global Libraries -> Add -> Scala SDK -> Download`Ģ. After restart, IntelliJ will prompt you as shown below to Setup Scala SDK. After plugin installation, restart the IntelliJ IDE. Click on Install to install the Scala plugin.Ĥ.Select the Plugins option from the left panel.Open File > Settings (or using shot keys Ctrl + Alt + s ).(you need to expand the project until you see App.scala file. This creates a project on IntelliJ and shows the following project structure on the left Project panel. On the next screen, review the options for artifact-id and group-id I am naming my project spark-hello-world-example.Ħ. In the next window, enter the project name. Since we have selected Scala archetypes, it downloads all Scala dependencies and enables IntelliJ to write Scala code.ĥ.