Skip to content

Commit fedc159

Browse files
committed
Add tuning for queries with fast processing splits
1 parent 6e6ec81 commit fedc159

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

presto-docs/src/main/sphinx/admin/tuning.rst

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,13 @@ As an example, on a 11-node cluster dedicated to Presto (1 Coordinator + 10 Work
2323
* `query.initial-hash-partitions = 10`
2424
* `task.concurrency = 8`
2525

26+
If your workload consists of queries that have very quick processing time of the splits you might encounter situation when whole cluster is under utilized (very small usage of CPU, network and disks).
27+
For example this can happen when your queries are highly selective and most splits can be filtered out just by looking into theirs headers (like bloom filters or min/max statistics in ORC files) without reading the actual data.
28+
In such case you might want to increase values of the following properties:
29+
30+
* :ref:`node-scheduler.max-pending-splits-per-node-per-stage <tuning-pref-node>`
31+
* :ref:`node-scheduler.max-splits-per-node <tuning-pref-node>`
32+
2633
If this guide does not suit your needs, You may look for more tuning options on
2734
:doc:`/admin/properties` page.
2835

0 commit comments

Comments
 (0)