Ceph: Designing and Implementing Scalable Storage Systems
by Michael Hackett, Vikhyat Umrao, Karan Singh, Nick Fisk
OSD variance and fillage
The variance in OSD utilization is crucial in determining whether one or more OSDs need to be reweighted to even out the workload. A reasonably uniform distribution of PGs, and thus of data, among OSDs is also important so that outliers allocated significantly more than their share do not become full. In this section, we'll explore this phenomenon and how to watch for it. In Chapter 19, Operations and Maintenance, we described a strategy for mitigating uneven distribution; here we explore why it happens and how to adjust thresholds to meet your local needs.
The variance for some OSDs can increase when objects are not allocated in a balanced manner across all PGs. The CRUSH algorithm is designed to treat every PG as ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access