There are quite a few settings that may be tweaked for OSDs; optimal values vary depending on the speeds of your OSD and journal drives, your workload, and the number of CPU cores available. The suggestions here must be researched and tested in the context of your unique deployment:
[osd]filestore_queue_max_bytes = 1048576000filestore_queue_max_ops = 50000
The above settings work well for the authors to enhance performance of FileStore OSDs deployed on fast SSDs. Your mileage may vary, especially on HDD OSDs:
[osd]osd_op_threads = 16osd_disk_threads = 4
These thread settings are sometimes controversial; some hold that increasing them can benefit performance, others that they increase contention and can lead to thrashing. ...