Fujitsu Laboratories has developed a way to address latency issues associated with the SMB and CIFS protocols.
The company last year revealed a technology for deduplicating data during remote transfers, but reported "limited effectiveness" when used with SMB and CIFS due to specific features of these protocols. In particular, header information is attached to each chunk of data, and as the headers change even when the same file is retransmitted this works against deduplication.
Furthermore, when a folder containing a large number of files is copied, all of the file-attribute information is requested for each file, causing significant latency issues.
This proxy separates the header information from the data, allowing more effective deduplication, and uses a read-ahead approach to better cope with the transfer of multiple files (see diagram above).
Internal testing is said to show tenfold improvements when transferring folders containing 100 1KB files, and twentyfold improvements when transferring a single 10MB file.
While the technology was initially developed for file-sharing systems, it is also applicable for cloud, server virtualisation, and mobile environments, the company said.
Its first commercial appearance will be as part of a WAN optimisation product.