Benchmarking Inception_V3

Analyzing the performance on any ML model is very crucial . while running ML model on device we need to know the performance of the ml model executed on the edge device . so that we can get  the performance metrices of the different layers of ML model and some other usefull insights of different runtimes



 Running Benchmarks for Inception_V3


Pre-requisite :
  • your_model.dlc 
  •   A text file listing all the input data. For an example, see: $SNPE_ROOT/models/alexnet/data/image_list.txt. 
  •   All the input data listed in the text file. For an example, see $SNPE_ROOT/models/alexnet/data/cropped.
$cd $SNPE_ROOT/benchmark  
$cp alexnet_sample.json inception_v3.json 
$vi inception_v3.json 
// modify the inception_v3.json parameters according to inception_v3 
{
  "Name":"inceptionV3", 
  "HostRootPath": "inception_v3",
  "HostResultsDir":"inception_v3/results",
  "DevicePath":"/data/local/tmp/snpeexample", 
  "Devices":["2d07d8f9"], 
  "HostName": "localhost", 
  "Runs":5,

"Model": { 
      "Name": "Inception_v3", 
      "Dlc": 
  "$SNPE_ROOT/models/inception_v3/dlc/inception_v3_quantized.dlc",
                 "InputList":
 "$SNPE_ROOT/models/inception_v3/data/target_raw_list.txt",
                     "Data": [
       "$SNPE_ROOT/models/inception_v3/data/cropped"
              ]
              }, 
     "Runtimes":["GPU", "CPU", "DSP"], 
     "Measurements": ["timing"] 
 }

 Run the benchmark for Inception_v3 

run the following command to run on the only device connected to your computer
  • $cd $SNPE_ROOT/benchmarks  
  • $python snpe_bench.py -c inception_v3.json  
View the results

A latest_results link that points to the most recent run is created.

 # In inception_v3.json, "HostResultDir" is set to "inception_v3/results"
  •  cd $SNPE_ROOT/benchmarks/inception_v3/results 
 # Notice the time stamped directories and the "latest_results" link. 
  •  cd $SNPE_ROOT/benchmarks/inception_v3/results/latest_results 
 # Notice the .csv file, open this file in a csv viewer (Excel, LibreOffice Calc) 













Comments

Post a Comment

Popular posts from this blog

Examples of running Machine Learning Model on Device using Qualcomm AI HUB

Getting started  Installation  We recommend using Miniconda to manage your python versions and environments. Step 1: Python environment Install  miniconda  on your machine. Windows : When the installation finishes, open Anaconda Prompt from the Start menu. macOS/Linux : When the installation finished, open a new shell window. Set up an environment for Qualcomm® AI Hub: conda create python = 3 .8 -n qai_hub conda activate qai_hub Warning If any of these steps fail with  SSL:   CERTIFICATE_VERIFY_FAILED  errors, you have an SSL interception and traffic inspection tool installed. Ask your IT department for instructions on how to set up certificates for Python  pip  and the Python  Requests  library. They should provide you with a new certificate file. You will also need to add this certificate to Miniconda prior to creating your environment. This can be done with  conda   config   --set   ssl_verify   <path ...
Read more

Medical Report Analyzer - Progess

Image
Content : You get to know the approach what we have followed for this Medical report Analyzer project. there are different steps involved in this process and get to know  which libraries are used with code snippets. Extracting the Text From the Input PDF step 1 : We have extracted text from the pdf using the Python library  Pytesseract  installing the usefull libraries using pip command :- ! sudo apt-get install tesseract-ocr ! pip install pytesseract pip install PyMuPDF step 2 : now code to extract text from pdf you will get the output text as : Now there are two ways to Extract the specific field details from the extracted field :  Using the HardCode Method where you will Write code with many if-else condition to handle' different cases for different format of Medical Report you have to parse the text using regular expressions to extract the relevant field details like Name , Age , Gender, DOB , etc.       2. You Can use LLMs to extract the req...
Read more

Running Inception_V3 using On-device AI

Image
  Introduction  The Inception v3 Imagenet classification model is trained to classify images with 1000 labels. Inception-V3 is a convolutional neural network architecture designed for image classification and recognition tasks. Tensorflow Setup : To set up TensorFlow, perform the following procedure: 1.  Download android-ndk- , and set the ANDROID_NDK_ROOT environment variable.   $export ANDROID_NDK_ROOT=<path to Android Ndk root> 2. Go to the SNPE SDK root directory, and run the following script to set up the SNPE SDK environment (the TensorFlow home directory must be provided):  $export TENSORFLOW_DIR=/usr2/ /.local/bin/ $source bin/envsetup.sh -t $TENSORFLOW_DIR   where $TENSORFLOW_DIR is the path to the TensorFlow installation. The script sets up the following environment variables:  SNPE_ROOT: root directory of the SNPE SDK installation  TENSORFLOW_HOME: root directory of the TensorFlow installation provided   Th...
Read more