Title:
MODEL COMPRESSION METHOD AND APPARATUS, COMPUTER DEVICE, AND STORAGE MEDIUM
Document Type and Number:
WIPO Patent Application WO/2021/159748
Kind Code:
A1
Abstract:
Disclosed are a model compression method and apparatus, a device, and a storage medium, which relate to the technical field of artificial intelligence. The model compression method comprises: acquiring an image identification model trained in advance and a second backbone network to be trained (S201); inputting multiple images to be tested into the image identification model for testing to obtain a model test result (S202); calculating a channel weight vector according to the model test result (S203); respectively inputting a training image into a first backbone network and the second backbone network for feature extraction to obtain a first feature map output by the first backbone network and a second feature map output by the second backbone network (S204); on the basis of the first feature map, the second feature map and the channel weight vector, calculate a model loss (S205); and updating and optimizing the second backbone network according to the model loss to obtain a compressed image identification model (S206). By means of the model compression method, the problems of low efficiency and low universality caused by the whole artificial intelligence model needing to be subjected to distillation compression in current model compression can be solved.
Inventors:
ZHENG QIANG (CN)
WANG XIAORUI (CN)
GAO PENG (CN)
WANG JUN (CN)
LI GE (CN)
XIE GUOTONG (CN)
WANG XIAORUI (CN)
GAO PENG (CN)
WANG JUN (CN)
LI GE (CN)
XIE GUOTONG (CN)
Application Number:
PCT/CN2020/124813
Publication Date:
August 19, 2021
Filing Date:
October 29, 2020
Export Citation:
Assignee:
PING AN TECH SHENZHEN CO LTD (CN)
International Classes:
G06N3/04; G06N3/08
Foreign References:
| CN111461212A | 2020-07-28 | |||
| CN110880036A | 2020-03-13 | |||
| CN111695375A | 2020-09-22 | |||
| CN111488985A | 2020-08-04 | |||
| US20160217369A1 | 2016-07-28 |
Attorney, Agent or Firm:
SHENZHEN CHINA INNOVATION SOUTH INTELLECTUAL PROPERTY AGENCY CO., LTD. (CN)
Download PDF: