Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inquiry Regarding Throughput and Latency Calculation in FlooNoC #97

Open
tayyabshaikh opened this issue Feb 3, 2025 · 4 comments
Open

Comments

@tayyabshaikh
Copy link

I would like to confirm the strategy used by FlooNoC to calculate the throughput of the NoC. Specifically, I am interested in understanding the behavior of FlooNoC under different test scenarios and how these scenarios impact throughput and latency metrics. The goal is to verify how the NoC performs under various conditions and to understand the relationship between the system's traffic patterns and its throughput and latency calculations.

Could you please provide insights on how FlooNoC calculates throughput and how it adjusts under different load conditions, burst behaviors, and any other relevant factors and approach that may affect these performance metrics?

FlooNoC has mentioned in its research paper that they have achieved a maximum throughput of 645Gbps per link, how is it actually calculated. Can you please guide so that I can repeat these steps and calculate the throughput?

@fischeti
Copy link
Collaborator

fischeti commented Feb 7, 2025

I would like to confirm the strategy used by FlooNoC to calculate the throughput of the NoC. Specifically, I am interested in understanding the behavior of FlooNoC under different test scenarios and how these scenarios impact throughput and latency metrics. The goal is to verify how the NoC performs under various conditions and to understand the relationship between the system's traffic patterns and its throughput and latency calculations.

Could you please provide insights on how FlooNoC calculates throughput and how it adjusts under different load conditions, burst behaviors, and any other relevant factors and approach that may affect these performance metrics?

I am not sure if I understand your question correctly, but essentially we count the ratio of cycles where a handshake occurs on the link and the total number of cycles. With a smaller load, you will also have fewer handshakes and a smaller utilization in the end.

FlooNoC has mentioned in its research paper that they have achieved a maximum throughput of 645Gbps per link, how is it actually calculated. Can you please guide so that I can repeat these steps and calculate the throughput?

This maximum throughput is derived from a frequency of 1.26GHz and a link width of 512-bit. So 1.26GHz x 512-bits = 645Gbps. However, this is maximum throughput. The effective bandwidth depends a lot on the burst length of a transfer or the number of bursts/transfers you can issue in the system.

The 1.26GHz is the frequency achieved in typical conditions when we integrated FlooNoC into a compute tile (see the paper for more information). In this case study, FlooNoC was not on the critical path, so potentially the frequency could be even higher.

I hope this helps, but let me know if it is not clear

@tayyabshaikh
Copy link
Author

tayyabshaikh commented Feb 7, 2025 via email

@fischeti
Copy link
Collaborator

fischeti commented Feb 7, 2025

1.26GHz is just the maximum frequency we achieved for the compute tile. But there is not a particular reason why you couldn't go higher than this. It just depends on the design

@tayyabshaikh
Copy link
Author

tayyabshaikh commented Feb 7, 2025 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants