====== Resource Optimization ======

The cluster workflow manager should employ clever handling of resource bottlenecks.

Typical resource bottlenecks and rules for clever handling of resource bottlenecks are:
=== Network transfer of data ===
  - staging of smaller datasets before larger datasets (log10-scale)
  - do not stage more than N datasets at once (for N = 2 or 3)

=== Hard disk reading/writing ===
  - do not move more than N datasets at once (for N = 2 or 3)
  - use move operations for input/output style processings (on the fly processing during copy)

=== Cluster queuing system ===
See: [[:beewm:devel:cluster_queue_optimization|Cluster Queue Optimization]]