recipe(google/owlv2-base-patch16-ensemble): add zero-shot-object-detection fp16, w8a8 and w8a16 recipes#1088
Open
codykk wants to merge 1 commit into
Open
recipe(google/owlv2-base-patch16-ensemble): add zero-shot-object-detection fp16, w8a8 and w8a16 recipes#1088codykk wants to merge 1 commit into
codykk wants to merge 1 commit into
Conversation
aed2103 to
fef0bc5
Compare
…ction) Add fp16, w8a8, and w8a16 quantized recipes for OWLv2 base model, enabling zero-shot object detection on WinML. Build verified: - fp16: PASS (585.6 MB, 59.3s) - w8a8: PASS (148.4 MB, 125.4s) - w8a16: PASS (175.2 MB, 119.7s) Perf verified (w8a16, CPU): mean 3865.88ms, 0.26 samples/s
fef0bc5 to
2bf8276
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add fp16, w8a8, and w8a16 quantized recipes for google/owlv2-base-patch16-ensemble (zero-shot object detection, 155M params). Effort L0★ — first
zero-shot-object-detectionrecipe in the repo, no source edits. Goal ceiling L1 reached: all three recipes build and the w8a16 variant perfs on CPU. Quantization delivers up to 3.9x model size reduction (585.6 MB fp32 → 148.4 MB w8a8).12-Item Verification
1. Recipe path(s)
examples/recipes/google_owlv2-base-patch16-ensemble/zero-shot-object-detection_fp16_config.jsonexamples/recipes/google_owlv2-base-patch16-ensemble/zero-shot-object-detection_w8a16_config.jsonexamples/recipes/google_owlv2-base-patch16-ensemble/zero-shot-object-detection_w8a8_config.json2. README row
Added to
examples/recipes/README.md:3. Build output dir
4. Build log
All artifacts: 1423 ONNX nodes, opset 17, IR version 8.
5. Appended findings
N/A — no
model_knowledge/owlv2.jsonexisted prior; no methodology friction observed that warrants a new finding. The model exported cleanly via the existing vendorOwlV2OnnxConfigregistered by winml.6. Optimum-coverage probe
{'vendor': [], 'after_winml': ['feature-extraction', 'zero-shot-object-detection'], 'added_by_winml': ['feature-extraction', 'zero-shot-object-detection']}OwlV2OnnxConfigfor both tasks.model_type = "owlv2",architectures = ["Owlv2ForObjectDetection"],is_encoder_decoder = False.7. Claimed (Effort, Goal, Outcome)
mainso L0 is inherited8. Goal-ladder verdict table
Baseline build on
main(defa3f63): PASS — L0 is inherited from baseline; the contribution's delta is quantization.9. Methodology-evolution declaration
No methodology friction observed. No new
_meta-NNNfinding needed.10. Perf & eval data
Available providers on test host:
['DmlExecutionProvider', 'CPUExecutionProvider']DmlExecutionProvider was not in
charter.target_eps(CPU-only target), so no HOST-BLOCKED row.11. Component / op-level data
N/A —
winml analyzeruntime check rules not populated on this host (source-tree build, no parquet rules downloaded). The build-embeddedanalyze_result.jsononly covers CPU (no rules → all opsunknown). See_meta-013.Note from build:
Einsumop in/class_head/Einsumflagged as unsupported during optimize (3 occurrences), but optimization and quantization completed successfully around it.12. Reproducible commands