November 2018
Intermediate to advanced
460 pages
14h 1m
English
For many distributed high-performance computing scenarios, data compression might be much more cost- and time-efficient than disk/network I/O. In such scenarios, it is worth thinking about compressing the data before it is serialized into a stream. The JLD2 module provides data compression out of the box. Using the Serialization module requires a stream decorator. For the compression to operate, you need to install the CodecZlib.jl package. Just press ] to go to the Julia package manager and execute the command:
(v1.0) pkg> add CodecZlib
For a sample serialization of a Julia object, consider the following example:
using CodecZlibusing Serializationd=Dict([("txt", collect(1:1000000))]);open("big2.bin", "w") do f comp = DeflateCompressorStream ...
Read now
Unlock full access