Amazon EMR is an Amazon data science analysis box.
You can ssh to its linux interface using putty. And you will see this:
And itself has spark. You type "spark-shell" , and go to spark interface.
It itself does not have sbt. Its system is Redhat. So you use yum to install sbt.
First type "sudo yum update"
Here is how on a webpage.
http://www.scala-sbt.org/0.13/docs/Installing-sbt-on-Linux.html
Then type
curl https://bintray.com/sbt/rpm/rpm | sudo tee /etc/yum.repos.d/bintray-sbt-rpm.repo
Then type:
sudo yum install sbt
And you will install sbt on your EMR. You do not need to install spark additionally, it already has spark on EMR.
And you can use "sbt package" to package your scala code to jar files.
I wrote about the solutions to some problems I found from programming and data analytics. They may help you on your work. Thank you.
ezoic
Subscribe to:
Post Comments (Atom)
looking for a man
I am a mid aged woman. I was born in 1980. I do not have any kid. no complicated dating before . I am looking for a man here for marriage...
-
I tried to commit script to bitbucket using sourcetree. I first cloned from bitbucket using SSH, and I got an error, "authentication ...
-
https://github.com/boto/boto3/issues/134 import boto3 import botocore client = boto3.client('s3') result = client.list_obje...
-
Previously, I wanted to install "script" on Atom to run PHP. And there was some problem, like the firewall. So I tried atom-runner...
No comments:
Post a Comment