tools/python: add script to convert TensorFlow model (.pb) to native model (.model)
For example, given TensorFlow model file espcn.pb,
to generate native model file espcn.model, just run:
python convert.py espcn.pb
In current implementation, the native model file is generated for
specific dnn network with hard-code python scripts maintained out of ffmpeg.
For example, srcnn network used by vf_sr is generated with
https://github.com/HighVoltageRocknRoll/sr/blob/master/generate_header_and_model.py#L85
In this patch, the script is designed as a general solution which
converts general TensorFlow model .pb file into .model file. The script
now has some tricky to be compatible with current implemention, will
be refined step by step.
The script is also added into ffmpeg source tree. It is expected there
will be many more patches and community needs the ownership of it.
Another technical direction is to do the conversion in c/c++ code within
ffmpeg source tree. While .pb file is organized with protocol buffers,
it is not easy to do such work with tiny c/c++ code, see more discussion
at http://ffmpeg.org/pipermail/ffmpeg-devel/2019-May/244496.html. So,
choose the python script.
Signed-off-by: Guo, Yejun <yejun.guo@intel.com>
2019-06-13 07:30:38 +02:00
|
|
|
# Copyright (c) 2019 Guo Yejun
|
|
|
|
#
|
|
|
|
# This file is part of FFmpeg.
|
|
|
|
#
|
|
|
|
# FFmpeg is free software; you can redistribute it and/or
|
|
|
|
# modify it under the terms of the GNU Lesser General Public
|
|
|
|
# License as published by the Free Software Foundation; either
|
|
|
|
# version 2.1 of the License, or (at your option) any later version.
|
|
|
|
#
|
|
|
|
# FFmpeg is distributed in the hope that it will be useful,
|
|
|
|
# but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
|
|
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
|
|
|
|
# Lesser General Public License for more details.
|
|
|
|
#
|
|
|
|
# You should have received a copy of the GNU Lesser General Public
|
|
|
|
# License along with FFmpeg; if not, write to the Free Software
|
|
|
|
# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
|
|
|
|
# ==============================================================================
|
|
|
|
|
|
|
|
# verified with Python 3.5.2 on Ubuntu 16.04
|
|
|
|
import argparse
|
|
|
|
import os
|
|
|
|
from convert_from_tensorflow import *
|
|
|
|
|
|
|
|
def get_arguments():
|
|
|
|
parser = argparse.ArgumentParser(description='generate native mode model with weights from deep learning model')
|
|
|
|
parser.add_argument('--outdir', type=str, default='./', help='where to put generated files')
|
|
|
|
parser.add_argument('--infmt', type=str, default='tensorflow', help='format of the deep learning model')
|
|
|
|
parser.add_argument('infile', help='path to the deep learning model with weights')
|
2019-07-30 03:25:56 +02:00
|
|
|
parser.add_argument('--dump4tb', type=str, default='no', help='dump file for visualization in tensorboard')
|
tools/python: add script to convert TensorFlow model (.pb) to native model (.model)
For example, given TensorFlow model file espcn.pb,
to generate native model file espcn.model, just run:
python convert.py espcn.pb
In current implementation, the native model file is generated for
specific dnn network with hard-code python scripts maintained out of ffmpeg.
For example, srcnn network used by vf_sr is generated with
https://github.com/HighVoltageRocknRoll/sr/blob/master/generate_header_and_model.py#L85
In this patch, the script is designed as a general solution which
converts general TensorFlow model .pb file into .model file. The script
now has some tricky to be compatible with current implemention, will
be refined step by step.
The script is also added into ffmpeg source tree. It is expected there
will be many more patches and community needs the ownership of it.
Another technical direction is to do the conversion in c/c++ code within
ffmpeg source tree. While .pb file is organized with protocol buffers,
it is not easy to do such work with tiny c/c++ code, see more discussion
at http://ffmpeg.org/pipermail/ffmpeg-devel/2019-May/244496.html. So,
choose the python script.
Signed-off-by: Guo, Yejun <yejun.guo@intel.com>
2019-06-13 07:30:38 +02:00
|
|
|
|
|
|
|
return parser.parse_args()
|
|
|
|
|
|
|
|
def main():
|
|
|
|
args = get_arguments()
|
|
|
|
|
|
|
|
if not os.path.isfile(args.infile):
|
|
|
|
print('the specified input file %s does not exist' % args.infile)
|
|
|
|
exit(1)
|
|
|
|
|
|
|
|
if not os.path.exists(args.outdir):
|
|
|
|
print('create output directory %s' % args.outdir)
|
|
|
|
os.mkdir(args.outdir)
|
|
|
|
|
|
|
|
basefile = os.path.split(args.infile)[1]
|
|
|
|
basefile = os.path.splitext(basefile)[0]
|
|
|
|
outfile = os.path.join(args.outdir, basefile) + '.model'
|
2019-07-30 03:25:56 +02:00
|
|
|
dump4tb = False
|
|
|
|
if args.dump4tb.lower() in ('yes', 'true', 't', 'y', '1'):
|
|
|
|
dump4tb = True
|
tools/python: add script to convert TensorFlow model (.pb) to native model (.model)
For example, given TensorFlow model file espcn.pb,
to generate native model file espcn.model, just run:
python convert.py espcn.pb
In current implementation, the native model file is generated for
specific dnn network with hard-code python scripts maintained out of ffmpeg.
For example, srcnn network used by vf_sr is generated with
https://github.com/HighVoltageRocknRoll/sr/blob/master/generate_header_and_model.py#L85
In this patch, the script is designed as a general solution which
converts general TensorFlow model .pb file into .model file. The script
now has some tricky to be compatible with current implemention, will
be refined step by step.
The script is also added into ffmpeg source tree. It is expected there
will be many more patches and community needs the ownership of it.
Another technical direction is to do the conversion in c/c++ code within
ffmpeg source tree. While .pb file is organized with protocol buffers,
it is not easy to do such work with tiny c/c++ code, see more discussion
at http://ffmpeg.org/pipermail/ffmpeg-devel/2019-May/244496.html. So,
choose the python script.
Signed-off-by: Guo, Yejun <yejun.guo@intel.com>
2019-06-13 07:30:38 +02:00
|
|
|
|
|
|
|
if args.infmt == 'tensorflow':
|
2019-07-30 03:25:56 +02:00
|
|
|
convert_from_tensorflow(args.infile, outfile, dump4tb)
|
tools/python: add script to convert TensorFlow model (.pb) to native model (.model)
For example, given TensorFlow model file espcn.pb,
to generate native model file espcn.model, just run:
python convert.py espcn.pb
In current implementation, the native model file is generated for
specific dnn network with hard-code python scripts maintained out of ffmpeg.
For example, srcnn network used by vf_sr is generated with
https://github.com/HighVoltageRocknRoll/sr/blob/master/generate_header_and_model.py#L85
In this patch, the script is designed as a general solution which
converts general TensorFlow model .pb file into .model file. The script
now has some tricky to be compatible with current implemention, will
be refined step by step.
The script is also added into ffmpeg source tree. It is expected there
will be many more patches and community needs the ownership of it.
Another technical direction is to do the conversion in c/c++ code within
ffmpeg source tree. While .pb file is organized with protocol buffers,
it is not easy to do such work with tiny c/c++ code, see more discussion
at http://ffmpeg.org/pipermail/ffmpeg-devel/2019-May/244496.html. So,
choose the python script.
Signed-off-by: Guo, Yejun <yejun.guo@intel.com>
2019-06-13 07:30:38 +02:00
|
|
|
|
|
|
|
if __name__ == '__main__':
|
|
|
|
main()
|