A comprehensive performance analysis of Apache Hadoop and Apache Spark for large scale data sets using HiBench

About this item

Title

A comprehensive performance analysis of Apache Hadoop and Apache Spark for large scale data sets using HiBench

Content partner

Massey University

Collection

Massey Research Online

Description

Big Data analytics for storing, processing, and analyzing large-scale datasets has become an essential tool for the industry. The advent of distributed computing frameworks such as Hadoop and Spark offers efficient solutions to analyze vast amounts of data. Due to the application programming interface (API) availability and its performance, Spark becomes very popular, even more popular than the MapReduce framework. Both these frameworks have more than 150 parameters, and the combination of th...

Read more

Format

Research paper

Research format

Journal article

Date created

14 December 2020

Creator

Ahmed N / Barczak ALC / Susnjak T / Rashid MA

URL

https://hdl.handle.net/10179/16008

Related subjects

HiBench / BigData / Hadoop / MapReduce / Benchmark / Spark / 08 Information and Computing Sciences

What is the copyright status of this item?

All Rights Reserved

This item is all rights reserved, which means you'll have to get permission from Massey University before using it.

What can I do with this item?

You must always check with Massey University to confirm the specific terms of use, but this is our understanding:

Non-infringing use

NZ Copyright law does not prevent every use of a copyright work. You should consider what you can and cannot do with a copyright work.

No sharing

You may not copy and/or share this item with others without further permission. This includes posting it on your blog, using it in a presentation, or any other public use.

No modifying

You are not allowed to adapt or remix this item into any other works.

No commercial use

You may not use this item commercially.