In MockNcclGroup, this line:
|
for(int j =0;j<_EP_size;j++){ |
just repeats the group creation EP times, but keeps creating the same groups (with same ranks), as the
j index is not used.
In my understanding, only one iteration should be enough for creating all the needed groups (i.e.,
_EP_nums).
A similar problem affects the DP_EP groups creation:
|
for (int j = 0; j < _DP_EP_size; j++){ |
At last, this does not create a problem in the simulation run because there are just redundant groups (and they just keep replacing themselves in the GroupIndex structure, as the key is the same, eventually leaving only the last one there), but it creates a lot of confusion to me.
In
MockNcclGroup, this line:SimAI/astra-sim-alibabacloud/astra-sim/system/MockNcclGroup.cc
Line 109 in cee5b9f
just repeats the group creation EP times, but keeps creating the same groups (with same ranks), as the
jindex is not used.In my understanding, only one iteration should be enough for creating all the needed groups (i.e.,
_EP_nums).A similar problem affects the
DP_EPgroups creation:SimAI/astra-sim-alibabacloud/astra-sim/system/MockNcclGroup.cc
Line 137 in cee5b9f
At last, this does not create a problem in the simulation run because there are just redundant groups (and they just keep replacing themselves in the
GroupIndexstructure, as the key is the same, eventually leaving only the last one there), but it creates a lot of confusion to me.