Unlock this feature

This feature isn’t part of your plan yet

Contact sales to get upgraded to the full DevStudio experience.

Unlock this feature

This feature isn't part of your plan yet.

SDK Tutorial: Stretchability; Hardware Target Exploration


NOTE: The Jupyter Notebook below is included in the Chimera SDK and can be run interactively by running the following CLI command:

$ quadric sdk notebook

From the Jupyter Notebook window in your browser, select the notebook named /quadric/sdk-cli/examples/stretch/Stretchability.ipynb.


Stretchability

test & play with stretchability of product variants, ocm sizes, ext bw

import os, sys, warnings
import pathlib, logging
import pandas as pd
import matplotlib.pyplot as plt
from matplotlib import cm
from mpl_toolkits.mplot3d import Axes3D
from matplotlib import interactive

interactive(True)
%matplotlib inline
import matplotlib as mpl
import numpy as np

int8_onnx_name = "../common/quant_onnx/resnet18_opt_asym_int8_q.onnx"
module_name = pathlib.Path(int8_onnx_name).stem
print(module_name)
resnet18_opt_asym_int8_q
import pprint

pp = pprint.PrettyPrinter(indent=4, sort_dicts=False)
products = ["QB1", "QB4", "QB16"]
ocm_size = ["4MB", "8MB", "16MB"]
ext_bw = ["4GBps", "8GBps", "16GBps", "32GBps"]
experiments = []
for p in products:
    for ocm in ocm_size:
        for bw in ext_bw:
            row_dict = {
                "model": int8_onnx_name,
                "name": module_name,
                "product": p,
                "ocm_size": ocm,
                "ext_bw": bw,
            }
            experiments.append(row_dict)
##trim the experiment list
import re
import tvm.contrib.epu.chimera_job.constants as constants
from tvm.contrib.epu.chimera_job.chimera_job import ChimeraJob
from tvm.contrib.epu.chimera_job.hw_config import HWConfig
import os

prod_match = re.compile("QB1$|QB4$|QB16$")
ocm_match = re.compile("4MB|8MB")
bw_match = re.compile("16GBps|32GBps")
exp_list = [
    x
    for x in experiments
    if prod_match.match(x["product"])
    and ocm_match.match(x["ocm_size"])
    and bw_match.match(x["ext_bw"])
]


def run_experiment(e):
    try:
        hw_config = HWConfig(
            product=e["product"],
            ocm_size=e["ocm_size"],
            ext_rd_bw=e["ext_bw"],
            ext_wr_bw=e["ext_bw"],
        )
        cgc_job = ChimeraJob(
            model_p=int8_onnx_name,
            hw_config=hw_config,
        )
        cgc_job.compile()
        cgc_job.run_inference_harness()
        e.update(cgc_job.profile)
    except:
        e.update({"total": 0})
    return e


print(len(exp_list))
12
results = [run_experiment(experiment) for experiment in exp_list]
2026-10-23 00:27 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:27 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:27 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:27 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:27 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:27 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:27 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:27 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:27 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:27 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:27 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:27 - INFO - epu - mac_counter - 
2026-10-23 00:27 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:27 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:27 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:27 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:27 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:27 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:27 - INFO - epu - mac_counter - 
2026-10-23 00:27 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:27 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:27 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:27 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:27 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:27 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:27 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:27 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:27 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:27 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:27 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:27 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:27 - INFO - epu - util - START====================================build_tir
2026-10-23 00:28 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB1_1_4MB_4kB_16GBps_16GBps_8_OFF_x1_x1 successful
2026-10-23 00:28 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbbc655b70>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:46<00:00,  3.88s/it]
2026-10-23 00:29 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbad27c3a0>
2026-10-23 00:29 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:29 - INFO - epu - iss_testing - Done 0:00:00.249353
2026-10-23 00:29 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:29 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:29 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:29 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:29 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:29 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:29 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:29 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:29 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:29 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:29 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:29 - INFO - epu - mac_counter - 
2026-10-23 00:29 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:29 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:29 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:29 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:29 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:29 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:29 - INFO - epu - mac_counter - 
2026-10-23 00:29 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:29 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:29 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:29 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:29 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:29 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:29 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:29 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:29 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:29 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:29 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:29 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:29 - INFO - epu - util - START====================================build_tir
2026-10-23 00:29 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB1_1_4MB_4kB_32GBps_32GBps_8_OFF_x1_x1 successful
2026-10-23 00:29 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bcb93643d0>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:39<00:00,  3.26s/it]
2026-10-23 00:30 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbacef09a0>
2026-10-23 00:30 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:30 - INFO - epu - iss_testing - Done 0:00:00.091032
2026-10-23 00:30 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:30 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:30 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:30 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:30 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:30 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:30 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:30 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:30 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:30 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:30 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:30 - INFO - epu - mac_counter - 
2026-10-23 00:30 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:30 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:30 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:30 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:30 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:30 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:30 - INFO - epu - mac_counter - 
2026-10-23 00:30 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:30 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:30 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:30 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:30 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:30 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:30 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:30 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:30 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:30 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:30 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:30 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:30 - INFO - epu - util - START====================================build_tir
2026-10-23 00:30 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB1_1_8MB_4kB_16GBps_16GBps_8_OFF_x1_x1 successful
2026-10-23 00:30 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bcb93643d0>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:29<00:00,  2.42s/it]
2026-10-23 00:31 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbaca7da20>
2026-10-23 00:31 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:31 - INFO - epu - iss_testing - Done 0:00:00.146676
2026-10-23 00:31 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:31 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:31 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:31 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:31 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:31 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:31 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:31 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:31 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:31 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:31 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:31 - INFO - epu - mac_counter - 
2026-10-23 00:31 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:31 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:31 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:31 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:31 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:31 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:31 - INFO - epu - mac_counter - 
2026-10-23 00:31 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:31 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:31 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:31 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:31 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:31 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:31 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:31 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:31 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:31 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:31 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:31 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:31 - INFO - epu - util - START====================================build_tir
2026-10-23 00:31 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB1_1_8MB_4kB_32GBps_32GBps_8_OFF_x1_x1 successful
2026-10-23 00:31 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bcb0e8baf0>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:30<00:00,  2.55s/it]
2026-10-23 00:32 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbbb005420>
2026-10-23 00:32 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:32 - INFO - epu - iss_testing - Done 0:00:00.100732
2026-10-23 00:32 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:32 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:32 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:32 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:32 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:32 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:32 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:32 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:32 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:32 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:32 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:32 - INFO - epu - mac_counter - 
2026-10-23 00:32 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:32 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:32 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:32 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:32 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:32 - INFO - epu - mac_counter - 
2026-10-23 00:32 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:32 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:32 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:32 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:32 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:32 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:32 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:32 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:32 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:32 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:32 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:32 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:32 - INFO - epu - util - START====================================build_tir
2026-10-23 00:32 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB4_1_4MB_4kB_16GBps_16GBps_8_OFF_x1_x1 successful
2026-10-23 00:32 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbacc87b80>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:15<00:00,  1.32s/it]
2026-10-23 00:32 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbacc85d20>
2026-10-23 00:32 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:32 - INFO - epu - iss_testing - Done 0:00:00.137964
2026-10-23 00:32 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:32 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:32 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:32 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:32 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:32 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:32 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:32 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:32 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:32 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:32 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:32 - INFO - epu - mac_counter - 
2026-10-23 00:32 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:32 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:32 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:32 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:32 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:32 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:32 - INFO - epu - mac_counter - 
2026-10-23 00:32 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:32 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:32 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:32 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:32 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:32 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:32 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:32 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:32 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:32 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:32 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:32 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:32 - INFO - epu - util - START====================================build_tir
2026-10-23 00:33 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB4_1_4MB_4kB_32GBps_32GBps_8_OFF_x1_x1 successful
2026-10-23 00:33 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbbaf2f0d0>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:15<00:00,  1.33s/it]
2026-10-23 00:33 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbbaee6e30>
2026-10-23 00:33 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:33 - INFO - epu - iss_testing - Done 0:00:00.132763
2026-10-23 00:33 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:33 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:33 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:33 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:33 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:33 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:33 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:33 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:33 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:33 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:33 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:33 - INFO - epu - mac_counter - 
2026-10-23 00:33 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:33 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:33 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:33 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:33 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:33 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:33 - INFO - epu - mac_counter - 
2026-10-23 00:33 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:33 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:33 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:33 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:33 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:33 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:33 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:33 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:33 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:33 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:33 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:33 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:33 - INFO - epu - util - START====================================build_tir
2026-10-23 00:33 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB4_1_8MB_4kB_16GBps_16GBps_8_OFF_x1_x1 successful
2026-10-23 00:33 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bc3e40a3e0>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:10<00:00,  1.09it/s]
2026-10-23 00:33 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbacf59d80>
2026-10-23 00:33 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:33 - INFO - epu - iss_testing - Done 0:00:00.083026
2026-10-23 00:33 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:33 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:33 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:34 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:34 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:34 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:34 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:34 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:34 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:34 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:34 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:34 - INFO - epu - mac_counter - 
2026-10-23 00:34 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:34 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:34 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:34 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:34 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:34 - INFO - epu - mac_counter - 
2026-10-23 00:34 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:34 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:34 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:34 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:34 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:34 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:34 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:34 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:34 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:34 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:34 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:34 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:34 - INFO - epu - util - START====================================build_tir
2026-10-23 00:34 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB4_1_8MB_4kB_32GBps_32GBps_8_OFF_x1_x1 successful
2026-10-23 00:34 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbad18b640>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:12<00:00,  1.04s/it]
2026-10-23 00:34 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbad188460>
2026-10-23 00:34 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:34 - INFO - epu - iss_testing - Done 0:00:00.106038
2026-10-23 00:34 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:34 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:34 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:34 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:34 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:34 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:34 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:34 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:34 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:34 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:34 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:34 - INFO - epu - mac_counter - 
2026-10-23 00:34 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:34 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:34 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:34 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:34 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:34 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:34 - INFO - epu - mac_counter - 
2026-10-23 00:34 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:34 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:34 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:34 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:34 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:34 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:34 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:34 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:34 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:34 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:34 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:34 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:34 - INFO - epu - util - START====================================build_tir
2026-10-23 00:34 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB16_1_4MB_4kB_16GBps_16GBps_8_OFF_x1_x1 successful
2026-10-23 00:34 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bcb93643d0>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:13<00:00,  1.15s/it]
2026-10-23 00:35 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bba5180250>
2026-10-23 00:35 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:35 - INFO - epu - iss_testing - Done 0:00:00.094472
2026-10-23 00:35 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:35 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:35 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:35 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:35 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:35 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:35 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:35 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:35 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:35 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:35 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:35 - INFO - epu - mac_counter - 
2026-10-23 00:35 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:35 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:35 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:35 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:35 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:35 - INFO - epu - mac_counter - 
2026-10-23 00:35 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:35 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:35 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:35 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:35 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:35 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:35 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:35 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:35 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:35 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:35 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:35 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:35 - INFO - epu - util - START====================================build_tir
2026-10-23 00:35 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB16_1_4MB_4kB_32GBps_32GBps_8_OFF_x1_x1 successful
2026-10-23 00:35 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbbaf67ac0>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:08<00:00,  1.38it/s]
2026-10-23 00:35 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbbb1398d0>
2026-10-23 00:35 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:35 - INFO - epu - iss_testing - Done 0:00:00.127268
2026-10-23 00:35 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:35 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:35 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:35 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:35 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:35 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:35 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:35 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:35 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:35 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:35 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:35 - INFO - epu - mac_counter - 
2026-10-23 00:35 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:35 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:35 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:35 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:35 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:35 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:35 - INFO - epu - mac_counter - 
2026-10-23 00:35 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:35 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:35 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:35 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:35 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:35 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:35 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:35 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:35 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:35 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:35 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:35 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:35 - INFO - epu - util - START====================================build_tir
2026-10-23 00:36 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB16_1_8MB_4kB_16GBps_16GBps_8_OFF_x1_x1 successful
2026-10-23 00:36 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbbaf67ac0>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:10<00:00,  1.11it/s]
2026-10-23 00:36 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbad081bd0>
2026-10-23 00:36 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:36 - INFO - epu - iss_testing - Done 0:00:00.075104
2026-10-23 00:36 - WARNING - epu - hw_config - QB-series products have a max macs per_pe 8, forcing 8 macs per pe
2026-10-23 00:36 - WARNING - epu - hw_config - QB-series products have a max clock speed of 1GHz forcing 1GHz
2026-10-23 00:36 - INFO - epu - chimera_job - START==================================onnx_ingest
2026-10-23 00:36 - INFO - epu - util - START===============================optimize_relay
2026-10-23 00:36 - INFO - epu - util - START====================quantize_to_cpu_runnable_fx
2026-10-23 00:36 - INFO - epu - fx - 

Source name              Op                      Output 0 Range                             Output 0 Frac Bits
-----------------------  ----------------------  ---------------------------------------  --------------------
output_DequantizeLinear  contrib.epu.dequantize  (-9.670584946870804, 28.26786369085312)                    26

2026-10-23 00:36 - INFO - epu - util - START====================build_cpu_runnable_fx_relay
2026-10-23 00:36 - INFO - epu - util - START=======================quantize_to_chimera_fx
2026-10-23 00:36 - INFO - epu - util - START=================================relay_to_tir
2026-10-23 00:36 - INFO - epu - util - START===========================relay_to_epu_relay
2026-10-23 00:36 - INFO - epu - util - START==============================adapt_and_order
2026-10-23 00:36 - INFO - epu - mac_counter - 
2026-10-23 00:36 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:36 - INFO - epu - mac_counter - MAC Operation Count Summary
2026-10-23 00:36 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 236,027,904 ops (118,013,952 MACs) - /conv1/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv1/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.0/conv2/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv1/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer1/layer1.1/conv2/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer2/layer2.0/conv1/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.0/conv2/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer2/layer2.0/downsample/downsample.0/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv1/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer2/layer2.1/conv2/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer3/layer3.0/conv1/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.0/conv2/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer3/layer3.0/downsample/downsample.0/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv1/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer3/layer3.1/conv2/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 115,605,504 ops (57,802,752 MACs) - /layer4/layer4.0/conv1/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.0/conv2/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 12,845,056 ops (6,422,528 MACs) - /layer4/layer4.0/downsample/downsample.0/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv1/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter -   conv2d: 231,211,008 ops (115,605,504 MACs) - /layer4/layer4.1/conv2/Conv_quant
2026-10-23 00:36 - INFO - epu - mac_counter - ------------------------------------------------------------
2026-10-23 00:36 - INFO - epu - mac_counter - Total: 3,627,122,688 ops (1,813,561,344 MACs)
2026-10-23 00:36 - INFO - epu - mac_counter - ============================================================
2026-10-23 00:36 - INFO - epu - mac_counter - 
2026-10-23 00:36 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:36 - INFO - epu - util - START=============================plan_lrm_virtual
2026-10-23 00:36 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:36 - INFO - epu - util - START===============================lrm_alloc_loop
2026-10-23 00:36 - INFO - epu - util - START==============================amend_ctrl_flow
2026-10-23 00:36 - INFO - epu - util - START================================lrm_splitting
2026-10-23 00:36 - INFO - epu - util - START=====================LrmUsageChecker.__call__
2026-10-23 00:36 - INFO - epu - util - START==============================ext_split_relay
2026-10-23 00:36 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:36 - INFO - epu - util - START===============================Compiler.build
2026-10-23 00:36 - INFO - epu - util - START========================RelayToPrimFunc.build
2026-10-23 00:36 - INFO - epu - util - START=========================OcmAllocator.analyze
2026-10-23 00:36 - INFO - epu - util - START====================================build_tir
2026-10-23 00:36 - INFO - epu - chimera_job - Compilation of resnet18_opt_asym_int8_q_QB16_1_8MB_4kB_32GBps_32GBps_8_OFF_x1_x1 successful
2026-10-23 00:36 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbbaf67ac0>
FILM 12/12: 100%|███████████████████████████████████████████████████| 12/12 [00:06<00:00,  1.83it/s]
2026-10-23 00:36 - INFO - epu - iss_testing - No tranges found for input, use default float range: <tvm.contrib.epu.interval.Interval object at 0x74bbaca89d50>
2026-10-23 00:36 - INFO - epu - iss_testing - Started Executing Onnxruntime...
2026-10-23 00:36 - INFO - epu - iss_testing - Done 0:00:00.093613
## plotting a bar graph
SMALL_SIZE = 14
MEDIUM_SIZE = 18
BIGGER_SIZE = 20
plt.rc("font", size=SMALL_SIZE)  # controls default text sizes
plt.rc("axes", titlesize=SMALL_SIZE)  # fontsize of the axes title
plt.rc("axes", labelsize=MEDIUM_SIZE)  # fontsize of the x and y labels
plt.rc("xtick", labelsize=SMALL_SIZE)  # fontsize of the tick labels
plt.rc("ytick", labelsize=SMALL_SIZE)  # fontsize of the tick labels
plt.rc("legend", fontsize=SMALL_SIZE)  # legend fontsize
plt.rc("figure", titlesize=BIGGER_SIZE)  # fontsize of the figure title

df = pd.DataFrame.from_records(results)
df["product"] = pd.Categorical(df["product"], categories=df["product"].unique(), ordered=True)
df.ext_bw = pd.Categorical(df.ext_bw, categories=df.ext_bw.unique(), ordered=True)
df.ocm_size = pd.Categorical(df.ocm_size, categories=df.ocm_size.unique(), ordered=True)
def major_minor_pivot(df, major="ocm_size", minor="product", columns=["ext_bw"]):
    i = 1
    fig = plt.figure(figsize=(12, 24), dpi=150)
    fig.suptitle(f"{int8_onnx_name} Stretchability", fontsize=16)
    # tell the dataframe not to sort these

    this_df = df[["product", "ocm_size", "ext_bw", "TotalCycles"]]
    this_df.TotalCycles = this_df.TotalCycles / 1e6
    this_df_iter = this_df[[major]].drop_duplicates()
    plt.style.use("seaborn-darkgrid")
    num_plots = df[major].nunique()

    for index, row in this_df_iter.iterrows():
        major_idx = row[major]
        ax = fig.add_subplot(num_plots, 1, i)
        pivot_df = this_df[(this_df[major] == major_idx)].pivot_table(
            index=[minor], columns=columns, values="TotalCycles"
        )
        print(f"Major axis: {major_idx}")
        print(pivot_df)
        pivot_df.plot.barh(
            ax=ax,
            sharex=True,
            grid=True,
            colormap="cool",
            xticks=np.arange(int(min(this_df["TotalCycles"])), max(this_df["TotalCycles"]) + 4, 1),
        )
        plt.xlabel("Million GPNPU Cycles")
        plt.ylabel(f"{major} @{major_idx}")
        i += 1
        for container in ax.containers:
            ax.bar_label(container, fmt="%.2f", padding=8, fontsize=11)
    # # grab the legend handles and lables
    # h, l = fig.axes[0].get_legend_handles_labels()

    # # remove all the subplot legends
    # for ax in fig.axes: ax.get_legend().remove()

    # # add one legend on `plt`
    # plt.legend(h,l, loc=(1.05, 1.85), title='External BW')

    plt.show()


pp.pprint(df.to_json("outputdf.json", orient="records"))
major_minor_pivot(df, major="ocm_size", minor="product", columns=["ext_bw"])
major_minor_pivot(df, major="product", minor="ocm_size", columns=["ext_bw"])
major_minor_pivot(df, major="product", minor="ext_bw", columns=["ocm_size"])
None
Major axis: 4MB
ext_bw     16GBps    32GBps
product                    
QB1      5.480922  5.320779
QB4      1.852866  1.617994
QB16     0.909908  0.656393
Major axis: 8MB
ext_bw     16GBps    32GBps
product                    
QB1      5.214919  5.196718
QB4      1.539074  1.482770
QB16     0.880448  0.549682

Major axis: QB1
ext_bw      16GBps    32GBps
ocm_size                    
4MB       5.480922  5.320779
8MB       5.214919  5.196718
Major axis: QB4
ext_bw      16GBps    32GBps
ocm_size                    
4MB       1.852866  1.617994
8MB       1.539074  1.482770
Major axis: QB16
ext_bw      16GBps    32GBps
ocm_size                    
4MB       0.909908  0.656393
8MB       0.880448  0.549682

Major axis: QB1
ocm_size       4MB       8MB
ext_bw                      
16GBps    5.480922  5.214919
32GBps    5.320779  5.196718
Major axis: QB4
ocm_size       4MB       8MB
ext_bw                      
16GBps    1.852866  1.539074
32GBps    1.617994  1.482770
Major axis: QB16
ocm_size       4MB       8MB
ext_bw                      
16GBps    0.909908  0.880448
32GBps    0.656393  0.549682

Sign in to your account

Don't have an account? 
By signing in, you are agreeing to our Terms of Use and Privacy Policy.
Quadric // One architecture. Every algorithm.

Develop.

Simulate.

Profile.

Collaborate.