Recent questions tagged apache-spark

0 votes

so I am constructing a recommedation model using ALS package And make all user-product list by cartesian ... Questions for Interview, JavaScript MCQ (Multiple Choice Questions)...

asked Jul 8, 2022 in Education by JackTerrance

0 votes

Q: trigger.Once() metadata needed

Hi guys simple question for experienced guys. I have a spark job reading files under a path. I wanted ... Questions for Interview, JavaScript MCQ (Multiple Choice Questions)...

asked May 6, 2022 in Education by JackTerrance

0 votes

Q: Generate histogram from JavaRDD

I am trying to write code for converting data in Java RDD to a histogram so that I can bin the data in a certain ... (EntryWithSize entry) { long size = entry.getSize(); if (size...

asked Apr 9, 2022 in Education by JackTerrance

0 votes

Q: What is RDD in spark

Definition says: RDD is immutable distributed collection of objects I don't quite understand what does it mean. Is ... one please help. Select the correct answer from above options...

asked Jan 30, 2022 in Education by JackTerrance

0 votes

Q: Spark-submit not working when application jar is in hdfs

I'm trying to run a spark application using bin/spark-submit. When I reference my application jar inside my local ... version 1.2.1 Select the correct answer from above options...

asked Jan 29, 2022 in Education by JackTerrance

0 votes

Q: What is the difference between rdd and dataframes in Apache Spark ?

I want to know in simple language what are all the differences between rdd and dataframes? Select the correct answer from above options...

asked Jan 21, 2022 in Education by JackTerrance

0 votes

Q: Can apache spark run without hadoop?

Is spark dependent on Hadoop? If not, then I can run Spark without Hadoop right? Will I miss any features if I do Select the correct answer from above options...

asked Jan 21, 2022 in Education by JackTerrance

0 votes

Q: How to convert rdd object to dataframe in spark

How can I convert an RDD to a dataframe? I converted a data frame to rdd using .rdd. After processing it I ... convert it back to rdd Select the correct answer from above options...

asked Jan 21, 2022 in Education by JackTerrance