Exploiting Efficient and Scalable Shuffle Transfers in Future Data Center Networks


Distributed computing systems like MapReduce in knowledge centers transfer huge amount of data across successive processing stages. Such shuffle transfers contribute most of the network traffic and make the network bandwidth become a bottleneck. In many commonly used workloads, knowledge flows in such a transfer are highly correlated and aggregated at the receiver facet. To lower down the network traffic and efficiently use the on the market network bandwidth, we propose to push the aggregation computation into the network and parallelize the shuffle and reduce phases. During this paper, we initial examine the gain and feasibility of the in-network aggregation with BCube, a completely unique server-centric networking structure for future information centers. To exploit such a gain, we model the in-network aggregation drawback that's NP-onerous in BCube. We have a tendency to propose 2 approximate strategies for building the economical IRS-primarily based incast aggregation tree and SRS-based mostly shuffle aggregation subgraph, solely primarily based on the labels of their members and the data center topology. We any style scalable forwarding schemes primarily based on Bloom filters to implement in-network aggregation over large concurrent shuffle transfers. Based mostly on a prototype and large-scale simulations, we demonstrate that our approaches will considerably decrease the amount of network traffic and save the info center resources. Our approaches for BCube can be custom-made to different server-centric network structures for future knowledge centers once minimal modifications.

Did you like this research project?

To get this research project Guidelines, Training and Code... Click Here

PROJECT TITLE :Exploiting Non-Causal CPU-State Information for Energy-Efficient Mobile Cooperative Computing - 2018ABSTRACT:Scavenging the idling computation resources at the large variety of mobile devices, ranging from tiny
PROJECT TITLE :Estimation of Broadband Multiuser Millimeter Wave Massive MIMO-OFDM Channels by Exploiting Their Sparse Structure - 2018ABSTRACT:In millimeter wave (mm-wave) huge multiple-input multiple-output (MIMO) systems, acquiring
PROJECT TITLE :MPiLoc: Self-Calibrating Multi-Floor Indoor Localization Exploiting Participatory Sensing - 2018ABSTRACT:Whereas location is one of the most important context info in mobile and pervasive computing, giant-scale
PROJECT TITLE :Automatic Identification of Driver’s Smartphone Exploiting Common Vehicle-Riding Actions - 2018ABSTRACT:Texting or browsing the net on a smartphone while driving, referred to as distracted driving, considerably
PROJECT TITLE :Exploiting Transistor-Level Reconfiguration to Optimize Combinational circuits - 2017ABSTRACT:Silicon nanowire reconfigurable field impact transistors (SiNW RFETs) abolish the physical separation of n-sort and p-type

Ready to Complete Your Academic MTech Project Work In Affordable Price ?

Project Enquiry