The Layout-Aware Data Scheduling (LADS) data movement framework optimizes congestion for end-toend data transfers. During data transfer, LADS can avoid congested storage elements by exploiting the underlying storage layout at each endpoint. This improves the I/O bandwidth and hence the data transfer rate across high-speed networks. However, the absence of FT (Fault Tolerance) in LADS results in data retransmission overhead and may lead to possible data integrity issues upon faults. In this paper, we propose object-logging FT mechanisms to avoid transmitting the objects that are successfully written into the Parallel File System (PFS) at the sink end. Depending on the number of log files created for the whole dataset, we have classified our FT mechanisms into three different categories: File Logger, Transaction Logger, and Universal Logger. Also, to address the space overhead, we have proposed different methods of populating the log files with the information of the successfully transferred objects.We have evaluated the data transfer performance and recovery time overhead of the proposed object-logging based FT mechanisms on the LADS data transfer framework. Our experimental results show FT mechanisms exhibit negligible overhead(< 1%) with respect to the data transfer time. However, the fault recovery time is 10% higher than the total data transfer time at any fault point.
To View the Base Paper Abstract Contents
Now it is Your Time to Shine.
Great careers Start Here.
We Guide you to Every Step
Success! You're Awesome
Thank you for filling out your information!
We’ve sent you an email with your Final Year Project PPT file download link at the email address you provided. Please enjoy, and let us know if there’s anything else we can help you with.
To know more details Call 900 31 31 555
The WISEN Team