Skip to content

Commit

Permalink
Update Profiling Section in XNNPACK Delegate Docs (#3237) (#3261)
Browse files Browse the repository at this point in the history
Summary:
Pull Request resolved: #3237

Updating Profiling Section of the docs

Main point is pointing the the SDK Profiling Tutorial on how to get XNNPACK profiling information

Reviewed By: metascroy, cccclai

Differential Revision: D56439491

fbshipit-source-id: 1d724ffae6d89e8769ea427cb37b4ec85fe3452f
(cherry picked from commit 329184a)

Co-authored-by: Max Ren <maxren@meta.com>
  • Loading branch information
pytorchbot and mcr229 authored Apr 24, 2024
1 parent 214371d commit a0bd7fa
Showing 1 changed file with 1 addition and 9 deletions.
10 changes: 1 addition & 9 deletions docs/source/native-delegates-executorch-xnnpack-delegate.md
Original file line number Diff line number Diff line change
Expand Up @@ -74,16 +74,8 @@ Since weight packing creates an extra copy of the weights inside XNNPACK, We fre
When executing the XNNPACK subgraphs, we prepare the tensor inputs and outputs and feed them to the XNNPACK runtime graph. After executing the runtime graph, the output pointers are filled with the computed tensors.

#### **Profiling**
We have enabled basic profiling for XNNPACK delegate that can be enabled with the following compiler flag `-DENABLE_XNNPACK_PROFILING`. After running the model it will produce basic per-op and total timings. We provide an example of the profiling below. The timings listed are the average across runs, and the units are in microseconds.
We have enabled basic profiling for XNNPACK delegate that can be enabled with the following compiler flag `-DENABLE_XNNPACK_PROFILING`. With ExecuTorch's SDK integration, you can also now use the SDK tools to profile the model. You can follow the steps in [Using the ExecuTorch SDK to Profile a Model](./tutorials/sdk-integration-tutorial) on how to profile ExecuTorch models and use SDK's Inspector API to view XNNPACK's internal profiling information.

```
Fully Connected (NC, F32) GEMM: 109.510002
Total Time: 109.510002
```

::::{note}
Profiling is a work in progress, and is planned to be integrated with [SDK Tools](sdk-delegate-integration.md) and Tensorboard.
::::

[comment]: <> (TODO: Refactor quantizer to a more official quantization doc)
## Quantization
Expand Down

0 comments on commit a0bd7fa

Please sign in to comment.