Skip to content

fix function header GetClosestGpusToNic - #238

Merged
AtlantaPepsi merged 1 commit into
ROCm:developfrom
paklui:funcheader
Mar 6, 2026
Merged

fix function header GetClosestGpusToNic#238
AtlantaPepsi merged 1 commit into
ROCm:developfrom
paklui:funcheader

Conversation

@paklui

@paklui paklui commented Mar 2, 2026

Copy link
Copy Markdown
Contributor

Motivation

fix the function header GetClosestGpusToNic to match the function definition and function calls

Technical Details

The function header GetClosestGpusToNic looks different than in the comments for the header, it seems to be some typo with this function header, so I am trying to match the function definition and function calls elsewhere in this file.

 518   /**
 519    * Returns the indices of the GPUs closest to the given NIC
 520    *
 521    * @param[out] gpuIndices     Vector that will contain GPU indices closest to given NIC
 522    * @param[in]  nicIndex        Index of the NIC to query
 523    * @param[in]  targetRank      Rank to query (-1 for local rank)
 524    * @note This function is applicable when the IBV/RDMA executor is available
 525    * @returns GPU indices closest to NIC nicIndex, or empty if unable to detect
 526    */

Test Plan

Tried to run TransferBench to see the closest GPU to NICs.

Submission Checklist

fix the function header GetClosestGpusToNic to match the function
definition and function calls
@paklui
paklui requested a review from a team as a code owner March 2, 2026 23:57
@AtlantaPepsi
AtlantaPepsi merged commit a8cf384 into ROCm:develop Mar 6, 2026
4 checks passed
AtlantaPepsi pushed a commit that referenced this pull request Mar 19, 2026
* fix qpCount storage limit to allow 256+ (#237)

* fix function header GetClosestGpusToNic (#238)

fix the function header GetClosestGpusToNic to match the function
definition and function calls

* Fixed CQ size for high QPs cases and poll CQ in batch

CQ Size: max(100, qpCount) - dynamically sized
This avoid hangs at large QPs size, notably experienced with small message size  (ex: 256 QPs, 8M message size)
Polling: Up to 32 completions per poll call
to reduce poll calls

* improve DMABUF zcat check

improve DMABUF zcat check, similar to ROCM-2855

* add NIC_CQ_POLL_BATCH option as CQ poll batch size

Add NIC_CQ_POLL_BATCH as an option to ibv_poll_cq for CQ poll batch size
set a default value to `4` which appears to be current RCCL default
replace fixed wc_array with vector wc.data

Files changed:
- `src/header/TransferBench.hpp`
- `src/client/EnvVars.hpp`

* align with develop

* wc_array move out of the while loop from PR review

* Update CHANGELOG.md

* Revert "fix function header GetClosestGpusToNic (#238)"

This reverts commit a8cf384.

* Revert "improve DMABUF zcat check"

This reverts commit 6d88473.

---------

Co-authored-by: Pak Nin Lui <pak.lui@amd.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants