Key Default Description
flink.shuffle-service.consumed-partition-ttl-in-seconds
3600 The time interval to delete the fully consumed shuffle data directories since they become inactive.
flink.shuffle-service.default-io-thread-number-per-disk
4 The thread number for the default HDD disk type.
flink.shuffle-service.direct-memory-limit-in-mb
300 The direct memory consumed by the yarn shuffle service.
flink.shuffle-service.disk-scan-interval-in-ms
15000
flink.shuffle-service.heap-memory-limit-in-mb
64 The heap memory consumed by the yarn shuffle service
flink.shuffle-service.internal.local-result-partition-resolver-class
(none)
flink.shuffle-service.io-thread-number-for-disk-type
(none) The list of disk types and thread numbers. Each disk type and the corresponding thread number is configured by TYPE_1: THREAD_1, TYPE_2: THREAD_2, ...
flink.shuffle-service.local-dirs
(none) The list of local directories separated by comma. Each directory can be configured with the disk type ([TYPE] directory,...) or without the disk type (directory, ...). If not configured, the NodeManager local directories will be used and each directory will be treated as on HDD.
flink.shuffle-service.memory-size-per-buffer-in-bytes
32768
flink.shuffle-service.netty-memory-in-mb
0 The preferred number of netty IO threads. If it's positive, the netty memory size will be min(configured value, 4M * flink.shuffle-service.server-thread-number), otherwise the netty memory size will be min(1/2 * flink.shuffle-service.direct-memory-limit-in-mb, 4M * flink.shuffle-service.server-thread-number).
flink.shuffle-service.partial-consumed-partition-ttl-in-seconds
43200 The time interval to delete the partially consumed shuffle data directories since they become inactive.
flink.shuffle-service.port
14572 The port of the shuffle service.
flink.shuffle-service.server-thread-number
0 The number of netty IO threads. If it's not positive, the thread number is equal to the overall IO thread number
flink.shuffle-service.subpartition-request-comparator-class
"org.apache.flink.runtime.io.network.partition.external.CreditBasedSubpartitionViewComparator" The comparator to decide the next subpartition to serve.
flink.shuffle-service.unconsumed-partition-ttl-in-seconds
43200 TThe time interval to delete the unconsumed shuffle data directories since they are ready to consume.
flink.shuffle-service.unfinished-partition-ttl-in-seconds
3600 The time interval to delete the writing shuffle data directories since the last writing.
flink.shuffle-service.wait-credit-delay-in-ms
0