book

Parallel and Concurrent Programming in Haskell

by Simon Marlow

July 2013

Intermediate to advanced

322 pages

8h 43m

English

O'Reilly Media, Inc.

Read now

Unlock full access

AudienceHow to Read This BookConventions Used in This BookUsing Sample CodeSafari® Books OnlineHow to Contact UsAcknowledgments
Terminology: Parallelism and ConcurrencyTools and ResourcesSample Code
Lazy Evaluation and Weak Head Normal FormThe Eval Monad, rpar, and rseqExample: Parallelizing a Sudoku SolverDeepseq
Parameterized StrategiesA Strategy for Evaluating a List in ParallelExample: The K-Means ProblemParallelizing K-MeansPerformance and AnalysisVisualizing Spark ActivityGranularityGC’d Sparks and Speculative ParallelismParallelizing Lazy Streams with parBufferChunking StrategiesThe Identity Property
Example: Shortest Paths in a GraphPipeline ParallelismRate-Limiting the ProducerLimitations of Pipeline ParallelismExample: A Conference TimetableAdding ParallelismExample: A Parallel Type InferencerUsing Different SchedulersThe Par Monad Compared to Strategies
Arrays, Shapes, and IndicesOperations on ArraysExample: Computing Shortest PathsParallelizing the ProgramFolding and Shape-PolymorphismExample: Image RotationSummary
OverviewArrays and IndicesRunning a Simple Accelerate ComputationScalar ArraysIndexing ArraysCreating Arrays Inside AccZipping Two ArraysConstantsExample: Shortest PathsRunning on the GPUDebugging the CUDA BackendExample: A Mandelbrot Set Generator

A Simple Example: RemindersCommunication: MVarsMVar as a Simple Channel: A Logging ServiceMVar as a Container for Shared StateMVar as a Building Block: Unbounded ChannelsFairness
Exceptions in HaskellError Handling with AsyncMerging
Asynchronous ExceptionsMasking Asynchronous ExceptionsThe bracket OperationAsynchronous Exception Safety for ChannelsTimeoutsCatching Asynchronous Exceptionsmask and forkIOAsynchronous Exceptions: Discussion
Running Example: Managing WindowsBlockingBlocking Until Something ChangesMerging with STMAsync RevisitedImplementing Channels with STMMore Operations Are PossibleComposition of Blocking OperationsAsynchronous Exception SafetyAn Alternative Channel ImplementationBounded ChannelsWhat Can We Not Do with STM?PerformanceSummary
Avoiding Thread LeakageSymmetric Concurrency CombinatorsTimeouts Using raceAdding a Functor InstanceSummary: The Async API
A Trivial ServerExtending the Simple Server with StateDesign One: One Giant LockDesign Two: One Chan Per Server ThreadDesign Three: Use a Broadcast ChanDesign Four: Use STMThe ImplementationA Chat ServerArchitectureClient DataServer DataThe ServerSetting Up a New ClientRunning the ClientRecap
How to Achieve Parallelism with ConcurrencyExample: Searching for FilesSequential VersionParallel VersionPerformance and ScalingLimiting the Number of Threads with a SemaphoreThe ParIO monad
The Distributed-Process Family of PackagesDistributed Concurrency or Parallelism?A First Example: PingsProcesses and the Process MonadDefining a Message TypeThe Ping Server ProcessThe Master ProcessThe main FunctionSumming Up the Ping ExampleMulti-Node PingRunning with Multiple Nodes on One MachineRunning on Multiple MachinesTyped ChannelsMerging ChannelsHandling FailureThe Philosophy of Distributed FailureA Distributed Chat ServerData TypesSending MessagesBroadcastingDistributionTesting the ServerFailure and Adding/Removing NodesExercise: A Distributed Key-Value Store
Debugging Concurrent ProgramsInspecting the Status of a ThreadEvent Logging and ThreadScopeDetecting DeadlockTuning Concurrent (and Parallel) ProgramsThread Creation and MVar OperationsShared Concurrent Data StructuresRTS Options to TweakConcurrency and the Foreign Function InterfaceThreads and Foreign Out-CallsAsynchronous Exceptions and Foreign CallsThreads and Foreign In-Calls