1
0
mirror of https://github.com/FFmpeg/FFmpeg.git synced 2024-11-26 19:01:44 +02:00
FFmpeg/doc
Guo, Yejun aa9ffdaa1e lavfi: add filter dnn_detect for object detection
Below are the example steps to do object detection:

1. download and install l_openvino_toolkit_p_2021.1.110.tgz from
https://software.intel.com/content/www/us/en/develop/tools/openvino-toolkit/download.html
  or, we can get source code (tag 2021.1), build and install.
2. export LD_LIBRARY_PATH with openvino settings, for example:
.../deployment_tools/inference_engine/lib/intel64/:.../deployment_tools/inference_engine/external/tbb/lib/
3. rebuild ffmpeg from source code with configure option:
--enable-libopenvino
--extra-cflags='-I.../deployment_tools/inference_engine/include/'
--extra-ldflags='-L.../deployment_tools/inference_engine/lib/intel64'
4. download model files and test image
wget https://github.com/guoyejun/ffmpeg_dnn/raw/main/models/openvino/2021.1/face-detection-adas-0001.bin
wget https://github.com/guoyejun/ffmpeg_dnn/raw/main/models/openvino/2021.1/face-detection-adas-0001.xml
wget
https://github.com/guoyejun/ffmpeg_dnn/raw/main/models/openvino/2021.1/face-detection-adas-0001.label
wget https://github.com/guoyejun/ffmpeg_dnn/raw/main/images/cici.jpg
5. run ffmpeg with:
./ffmpeg -i cici.jpg -vf dnn_detect=dnn_backend=openvino:model=face-detection-adas-0001.xml:input=data:output=detection_out:confidence=0.6:labels=face-detection-adas-0001.label,showinfo -f null -

We'll see the detect result as below:
[Parsed_showinfo_1 @ 0x560c21ecbe40]   side data - detection bounding boxes:
[Parsed_showinfo_1 @ 0x560c21ecbe40] source: face-detection-adas-0001.xml
[Parsed_showinfo_1 @ 0x560c21ecbe40] index: 0,  region: (1005, 813) -> (1086, 905), label: face, confidence: 10000/10000.
[Parsed_showinfo_1 @ 0x560c21ecbe40] index: 1,  region: (888, 839) -> (967, 926), label: face, confidence: 6917/10000.

There are two faces detected with confidence 100% and 69.17%.

Signed-off-by: Guo, Yejun <yejun.guo@intel.com>
2021-04-17 17:27:02 +08:00
..
dev_community Doc: Tech Resolution Process 2021-03-11 10:03:38 +01:00
doxy
examples doc/examples/vaapi_transcode: use av_packet_alloc() to allocate packets 2021-03-17 15:19:37 -03:00
.gitignore
APIchanges lavu: add side data AV_FRAME_DATA_DETECTION_BBOXES for object detection/classification 2021-04-17 17:27:02 +08:00
authors.texi
bitstream_filters.texi avcodec/setts_bsf: add sample rate for expressions 2021-02-15 20:52:44 +01:00
bootstrap.min.css
build_system.txt
codecs.texi doc/codecs.texi: Remove removed or ineffective options 2021-02-28 17:55:39 +01:00
decoders.texi avcodec/dvbsubdec: Support computing clut only once 2021-03-29 22:19:39 +02:00
default.css
demuxers.texi doc/demuxers: note support for flv variant KUX 2021-03-31 15:16:12 +05:30
developer.texi fftools/ffmpeg: update text requesting samples 2020-06-01 14:39:52 -04:00
devices.texi
doxy-wrapper.sh
Doxyfile
encoders.texi doc/encoders: add entry for a64 encoders 2021-04-02 15:20:14 +05:30
errno.txt
faq.texi
fate_config.sh.template
fate.texi
ffmpeg-bitstream-filters.texi
ffmpeg-codecs.texi
ffmpeg-devices.texi
ffmpeg-filters.texi
ffmpeg-formats.texi
ffmpeg-protocols.texi
ffmpeg-resampler.texi
ffmpeg-scaler.texi
ffmpeg-utils.texi
ffmpeg.texi doc/ffmpeg: clarify what -hwaccels list indicates 2021-04-03 10:58:07 +05:30
ffmpeg.txt
ffplay.texi doc: include general in *-all pages. 2020-09-08 14:29:19 +02:00
ffprobe.texi doc: include general in *-all pages. 2020-09-08 14:29:19 +02:00
ffprobe.xsd doc/ffprobe.xsd: Clean-up choice indicator definitions 2021-04-16 08:40:23 +02:00
fftools-common-opts.texi doc/fftools-common-opts: document max_alloc 2021-01-23 14:59:47 +05:30
filter_design.txt
filters.texi lavfi: add filter dnn_detect for object detection 2021-04-17 17:27:02 +08:00
formats.texi
general_contents.texi avformat/gopher: Add support for Gopher over TLS 2021-03-11 23:47:19 +01:00
general.texi doc/general: move contents into a separate file. 2020-09-08 14:29:19 +02:00
git-howto.texi
indevs.texi avdevice/xcbgrab: Add option for grabbing a window 2021-03-14 18:16:18 -04:00
issue_tracker.txt
lexicon
libav-merge.txt
libavcodec.texi
libavdevice.texi
libavfilter.texi
libavformat.texi
libavutil.texi
libswresample.texi
libswscale.texi
mailing-list-faq.texi Revert "doc/mailing-list-faq: Mention current problem with GMX" 2020-05-08 13:29:43 +02:00
Makefile
metadata.texi
mips.txt
multithreading.txt avcodec: deprecate thread_safe_callbacks 2020-11-27 15:46:50 +01:00
muxers.texi doc/muxers: add entries for raw muxers 2021-04-11 12:09:16 +05:30
nut.texi
optimization.txt
outdevs.texi lavdevice: Add AudioToolbox output device. 2020-06-15 15:09:33 +02:00
patchwork
platform.texi
print_options.c
protocols.texi doc/protocols: update rtsp options 2021-04-10 16:18:04 -04:00
rate_distortion.txt
resampler.texi
scaler.texi
snow.txt
style.min.css
swresample.txt
swscale.txt
t2h.init
t2h.pm
tablegen.txt
texi2pod.pl doc/texi2pod: support @float. 2020-09-08 14:29:19 +02:00
texidep.pl
undefined.txt
utils.texi doc/utils: document the "s", "ms" and "us" suffixes for durations 2020-06-09 17:55:52 +05:30
writing_filters.txt