April 2016
Beginner to intermediate
463 pages
18h 53m
English
Content preview from Big Data
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
88
Big Data: Storage, Sharing, and Security
The CRC32 frame check algorithm used in Ethernet frames is capable of detecting errors
in Jumbo frames [41], but having larger packets means more process overhead to generate
and check CRC32 in Ethernet frames [44]. By using a TCP offload engine (TOE) to offload
checksum calculation, CPU usage can be decreased when the frame sizes are larger [22]. This
reduces the CRC32 overhead created by using Jumbo frames for bulk transfers.
A TOE [16] offloads packet processing to the network hardware in NIC, to reduce CPU
overhead when it processes TCP segments. When it is used, the IP stack can forward pointers
to a