val text=sc.textFile("README.md")
text is an RDD. README.md is a Spark system file.
change rdd to dataframe:
val text1=text.toDF
convert list to RDD:
val textfile1=List(("Ale",1259,278,6782))
textfile1 is a list.
change list to RDD.
val textfile2=sc.parallelize(textfile1)
convert list to dataframe:
val aa=List(("a","k","u","t"))
val ak=aa.map{case (a, b, c, d) => (a, b, c, d)}
val au=ak.toDF
println(au.show)
val aa=List(List("a","k","u","t"))
val ak=aa.map{case List(a, b, c, d) => (a, b, c, d)}
val au=ak.toDF
println(au.show)
change RDD to list:
val text1=sc.textFile("README.md")
text1 is an RDD
change RDD to array:
val text2=text1.collect()
I wrote about the solutions to some problems I found from programming and data analytics. They may help you on your work. Thank you.
ezoic
Subscribe to:
Post Comments (Atom)
looking for a man
I am a mid aged woman. I live in southern california. I was born in 1980. I do not have any kid. no compliacted dating. I am looking for ...
-
I tried to commit script to bitbucket using sourcetree. I first cloned from bitbucket using SSH, and I got an error, "authentication ...
-
https://github.com/boto/boto3/issues/134 import boto3 import botocore client = boto3.client('s3') result = client.list_obje...
-
There are some fun tools on Mac/PC which can help you on your studies, life and research. 1. Evernote: https://evernote.com/ To downl...
No comments:
Post a Comment