Skip to content

Coyote accelerator backend #1347

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Coyote accelerator backend #1347

Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
72aa3ea
Initialize CoyoteAccelerator Backend
bo3z Jul 25, 2025
896665b
CoyoteAccelerator backend hardware modules
bo3z Jul 25, 2025
4be45d1
Init Coyote submodule
bo3z Jul 25, 2025
ecde593
CoyoteAccelerator backend software modules
bo3z Jul 25, 2025
be28016
CoyoteAccelerator backend writer + build scripts
bo3z Jul 25, 2025
2c600a6
CoyoteAccelerator backend Python Overlay for neural network inference
bo3z Jul 25, 2025
3055a0b
Minor fixes and documentation updates
bo3z Jul 28, 2025
9554271
Remove unnecessary sleep when polling which reduces performance
bo3z Aug 1, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 1 addition & 3 deletions hls4ml/templates/coyote_accelerator/host_libs.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,9 +39,7 @@ void CoyoteInference::predict() {
}

// Poll on completion; each batch increments the counter by one
while (coyote_thread.checkCompleted(coyote::CoyoteOper::LOCAL_TRANSFER) != batch_size) {
std::this_thread::sleep_for(std::chrono::nanoseconds(50));
}
while (coyote_thread.checkCompleted(coyote::CoyoteOper::LOCAL_TRANSFER) != batch_size) {}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wouldn't this cause 100% CPU usage while the program is polling?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On one of the cores, yes.

But sleep for less than 50us is not well-defined on most Linux platforms. Hence, measured latency can go from ~4us to >50us even though the "true" execution latency is still 4us.

}

void CoyoteInference::set_data(float *x, unsigned int i) {
Expand Down
Loading