Parallel and High Performance Computing

2 Planning for parallelization

This chapter covers

• Planning steps for a parallel project
• Version control and team development workflows
• Understanding performance capabilities and limitations
• Developing a plan to parallelize a routine

Developing a parallel application or making an existing application run in parallel can feel challenging at first. Often, developers new to parallelism are unsure of where to begin and what pitfalls they might encounter. This chapter focuses on a workflow model for developing parallel applications as illustrated in figure 2.1. This model provides the context for where to get started and how to maintain progress in developing your parallel application. Generally, it is best to implement parallelism in small increments ...