flink.shuffle-service.consumed-partition-ttl-in-seconds |
3600 |
The time interval to delete the fully consumed shuffle data directories since they become inactive. |
flink.shuffle-service.default-io-thread-number-per-disk |
4 |
The thread number for the default HDD disk type. |
flink.shuffle-service.direct-memory-limit-in-mb |
300 |
The direct memory consumed by the yarn shuffle service. |
flink.shuffle-service.disk-scan-interval-in-ms |
15000 |
|
flink.shuffle-service.heap-memory-limit-in-mb |
64 |
The heap memory consumed by the yarn shuffle service |
flink.shuffle-service.internal.local-result-partition-resolver-class |
(none) |
|
flink.shuffle-service.io-thread-number-for-disk-type |
(none) |
The list of disk types and thread numbers. Each disk type and the corresponding thread number is configured by TYPE_1: THREAD_1, TYPE_2: THREAD_2, ... |
flink.shuffle-service.local-dirs |
(none) |
The list of local directories separated by comma. Each directory can be configured with the disk type ([TYPE] directory,...) or without the disk type (directory, ...). If not configured, the NodeManager local directories will be used and each directory will be treated as on HDD. |
flink.shuffle-service.memory-size-per-buffer-in-bytes |
32768 |
|
flink.shuffle-service.netty-memory-in-mb |
0 |
The preferred number of netty IO threads. If it's positive, the netty memory size will be min(configured value, 4M * flink.shuffle-service.server-thread-number), otherwise the netty memory size will be min(1/2 * flink.shuffle-service.direct-memory-limit-in-mb, 4M * flink.shuffle-service.server-thread-number). |
flink.shuffle-service.partial-consumed-partition-ttl-in-seconds |
43200 |
The time interval to delete the partially consumed shuffle data directories since they become inactive. |
flink.shuffle-service.port |
14572 |
The port of the shuffle service. |
flink.shuffle-service.server-thread-number |
0 |
The number of netty IO threads. If it's not positive, the thread number is equal to the overall IO thread number |
flink.shuffle-service.subpartition-request-comparator-class |
"org.apache.flink.runtime.io.network.partition.external.CreditBasedSubpartitionViewComparator" |
The comparator to decide the next subpartition to serve. |
flink.shuffle-service.unconsumed-partition-ttl-in-seconds |
43200 |
TThe time interval to delete the unconsumed shuffle data directories since they are ready to consume. |
flink.shuffle-service.unfinished-partition-ttl-in-seconds |
3600 |
The time interval to delete the writing shuffle data directories since the last writing. |
flink.shuffle-service.wait-credit-delay-in-ms |
0 |
|