Parallel and High Performance Computing

check headline

I have been looking for a good guide through the parts of high performance computing that I can use as not only a reference but also a educational guide. This is it. As an technologist I get many questions like explain GPU's and what do they provide, or how can applications and code make use of parallel computing. Robert and Yuliana did a great job covering this in easy to understand language. I am very impressed this is a must have reference for any technologist.

Well organized, useful, practical. Wish I could give it 6 stars.

This book is well-written and thorough, covering both practical details (e.g., compiler flags, memory optimization) as well as general programming style that improves parallelism. The authors pull a wide variety of techniques together into a consistent, comprehensive view of HPC. The examples show when it is best to use the different approaches (vectorization, MPI, OpenMP, OpenACC, etc.) to given problems. One shortcoming, however, is in running the examples. Because this is a book on HPC, many readers will want to run the examples on clusters, but most clusters do not support Docker; most clusters only allow Singularity/Apptainer, but the authors do not describe how to run their examples using Singularity. It turns out that this is not a trivial thing. If the authors had included some help with that, then I would have given this book five stars.

Detailed and insightful exploration of parallel computing architectures and associated programming techniques. Highly recommend.

The books covers parallelization using CPU (OpenMP and MPI) and GPU (OpenACC, OpenCL, and CUDA). The reading is very present, not too heavy, for a topic that requires good understanding of C/C++ and some computer architecture. Examples are well crafted to convey the topic.

Tried to read the sample... but frontpage and later pages are from different books... the later page do not match the frontpage.

This is an amazing book that covers many topics that can be used in day to day programming, by chapter 5 i had already learned ways to optimize the code I write for work, would recommend