Scaling - Yousef's Notes
Scaling

Scaling

Scalability: ability to handle more work as size of computer or app grows.

#Strong Scaling

The number of processors is increased while the problem size remains constant.

  • Mostly used for long-running CPU-bound tasks.
  • Amdahl’s law: the speedup is limited by the fraction of the serial part of the software that is not amenable to paralleization.

#Weak Scaling

Both the number of processors and the problem size are increased.

  • Mostly used for large memory-bound applications where the required memory cannot be satisfied by a single node.