in Education by
Is spark dependent on Hadoop? If not, then I can run Spark without Hadoop right? Will I miss any features if I do Select the correct answer from above options

1 Answer

0 votes
by
 
Best answer
There are no dependencies of Spark on Hadoop. So, you can use Spark without Hadoop but you'll not be able to use some functionalities that are dependent on Hadoop. Spark can basically run over any distributed file system,it doesn't necessarily have to be Hadoop. Spark doesn’t have it’s own storage system.So, it is dependent on other Storage facilities like cassandra, hdfs, s3 etc. Although it is better to run Spark with Hadoop, you can run Spark without Hadoop in stand-alone mode.You can refer to Spark Documentation for more details.

Related questions

0 votes
    So, I've been looking at Hadoop with keen interest, and to be honest I'm fascinated, things don't get much ... anyone know of one? Select the correct answer from above options...
asked Feb 2, 2022 in Education by JackTerrance
0 votes
    I would like to know the relation between the mapreduce.map.memory.mb and mapred.map.child.java.opts parameters. ... .child.java.opts? Select the correct answer from above options...
asked Jan 28, 2022 in Education by JackTerrance
0 votes
    Definition says: RDD is immutable distributed collection of objects I don't quite understand what does it mean. Is ... one please help. Select the correct answer from above options...
asked Jan 30, 2022 in Education by JackTerrance
0 votes
    Why are there two separate packages map-reduce package in Apache's hadoop package tree: org.apache.hadoop.mapred ... separated out? Select the correct answer from above options...
asked Jan 26, 2022 in Education by JackTerrance
0 votes
    I am having some trouble writing the code for wordcount program using MapReduce, I could use some help. Select the correct answer from above options...
asked Jan 21, 2022 in Education by JackTerrance
0 votes
    Hi, I am using MapReduce and there are so many steps in it. I want the value of the last reduced step as ... . Thank you in advance. Select the correct answer from above options...
asked Jan 21, 2022 in Education by JackTerrance
0 votes
    I do not understand the differences between using S3 and S3n with my Hadoop cluster, can someone explain? Select the correct answer from above options...
asked Jan 26, 2022 in Education by JackTerrance
0 votes
    I want to know in simple language what are all the differences between rdd and dataframes? Select the correct answer from above options...
asked Jan 21, 2022 in Education by JackTerrance
0 votes
    Can someone explain the basic difference that distinguishes s3n, s3a and s3 in Hadoop? Technically how are they different? Select the correct answer from above options...
asked Jan 21, 2022 in Education by JackTerrance
0 votes
    so I am constructing a recommedation model using ALS package And make all user-product list by cartesian ... Questions for Interview, JavaScript MCQ (Multiple Choice Questions)...
asked Jul 8, 2022 in Education by JackTerrance
0 votes
    I'm trying to run a spark application using bin/spark-submit. When I reference my application jar inside my local ... version 1.2.1 Select the correct answer from above options...
asked Jan 29, 2022 in Education by JackTerrance
0 votes
    How can I convert an RDD to a dataframe? I converted a data frame to rdd using .rdd. After processing it I ... convert it back to rdd Select the correct answer from above options...
asked Jan 21, 2022 in Education by JackTerrance
0 votes
    The Hadoop list includes the HBase database, the Apache Mahout ________ system, and matrix operations. ... recognition 3. Statistical classification 4. Artificial intelligence...
asked Dec 7, 2022 in Education by JackTerrance
0 votes
    I am trying to understand how spark runs on YARN cluster/client. I have the following question in my mind. Is ... the job to cluster? Select the correct answer from above options...
asked Jan 28, 2022 in Education by JackTerrance
0 votes
    Sun also has the Hadoop Live CD ________ project, which allows running a fully functional Hadoop cluster using a live CD. 1. OpenOffice.org 2. OpenSolaris 3. GNU 4. Linux...
asked Dec 6, 2022 in Education by JackTerrance
...