Optimizing Data Locality by Integrating Intermediate Data Partitioning and Reduce Task Scheduling in Spark Framework

Mengsi He(Hunan University), Zhuo Tang(Texas Tech University), Zhongming Fu(Hunan University)
IEEE Transactions on Parallel and Distributed Systems
September 18, 2025
10.1109/tpds.2025.3611388
Cited by 2

Related Papers

A Parallel Random Forest Algorithm for Big Data in a Spark Cloud Computing Environment
|IEEE Transactions on Parallel and Distributed Systems|2016|432
An Energy-Efficient Task Scheduling Algorithm in DVFS-enabled Cloud Environment
|Journal of Grid Computing|2015|283
Distributed Task Migration Optimization in MEC by Extending Multi-Agent Deep Reinforcement Learning Approach
|IEEE Transactions on Parallel and Distributed Systems|2020|144
GPU-Accelerated Parallel Hierarchical Extreme Learning Machine on Flink for Big Data
|IEEE Transactions on Systems Man and Cybernetics Systems|2017|109
SCA: Sybil-Based Collusion Attacks of IIoT Data Poisoning in Federated Learning
|IEEE Transactions on Industrial Informatics|2022|92