virtualenv/FFmpeg
1
0
Fork 0
mirror of https://github.com/FFmpeg/FFmpeg.git synced 2024-12-02 03:06:28 +02:00
Code Issues Releases Activity
92bfc3cd03
FFmpeg/libavcodec/aacenc_tns.h

56 lines
1.8 KiB
C
Raw Normal View History

aacenc_tns: implement temporal noise shaping This commit implements temporal noise shaping support in the encoder, along with an -aac_tns option to toggle it on or off (off by default for now). TNS will increase audio quality and reduce quantization noise by applying a multitap FIR filter across allowed coefficients and transmit side information to the decoder so it could create an inverse filter. Users are encouraged to test the new functionality by enabling -aac_tns 1 during encoding. No major bugs are observable at this time so after a while if no new problems appear and if the current implementation is deemed of high enough quality and stability it will be enabled by default, possibly at the same time the encoder has its experimental flag removed and becomes the standard aac encoder in ffmpeg. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-08-21 20:27:38 +02:00
/*
* AAC encoder TNS
* Copyright (C) 2015 Rostislav Pehlivanov
*
* This file is part of FFmpeg.
*
* FFmpeg is free software; you can redistribute it and/or
* modify it under the terms of the GNU Lesser General Public
* License as published by the Free Software Foundation; either
* version 2.1 of the License, or (at your option) any later version.
*
* FFmpeg is distributed in the hope that it will be useful,
* but WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
* Lesser General Public License for more details.
*
* You should have received a copy of the GNU Lesser General Public
* License along with FFmpeg; if not, write to the Free Software
* Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA
*/
/**
* @file
* AAC encoder temporal noise shaping
* @author Rostislav Pehlivanov ( atomnuker gmail com )
*/
#ifndef AVCODEC_AACENC_TNS_H
#define AVCODEC_AACENC_TNS_H
avcodec: Fix `make checkheaders`
2015-08-22 19:14:17 +02:00
#include "aacenc.h"
aacenc_tns: implement temporal noise shaping This commit implements temporal noise shaping support in the encoder, along with an -aac_tns option to toggle it on or off (off by default for now). TNS will increase audio quality and reduce quantization noise by applying a multitap FIR filter across allowed coefficients and transmit side information to the decoder so it could create an inverse filter. Users are encouraged to test the new functionality by enabling -aac_tns 1 during encoding. No major bugs are observable at this time so after a while if no new problems appear and if the current implementation is deemed of high enough quality and stability it will be enabled by default, possibly at the same time the encoder has its experimental flag removed and becomes the standard aac encoder in ffmpeg. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-08-21 20:27:38 +02:00
aacenc_tns: rework coefficient quantization and filter application This commit reworks the TNS implementation to a hybrid between what the specifications say, what the decoder does and what's the best thing to do. The filter application function was copied from the decoder and modified such that it applies the inverse AR filter to the coefficients. The LPC coefficients themselves are fed into the same quantization expression that the specifications say should be used however further processing is not done, instead they're converted to the form that the decoder expects them to be in and are sent off to the compute_lpc_coeffs function exactly the way the decoder does. This function does all conversions and will return the exact coefficients that the decoder will generate, which are then applied to the coefficients. Having the exact same coefficients on both the encoder and decoder is a must since otherwise the entire sfb's over which the filter is applied will be attenuated. Despite this major rework, TNS might not work fine on some audio types at very low bitrates (e.g. sub 90kbps) as it can attenuate some coefficients too much. Users are advised to experiment with TNS at higher bitrates if they wish to use this tool or simply wait for the implementation to be improved. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-09-01 07:44:07 +02:00
/* Could be set to 3 to save an additional bit at the cost of little quality */
#define TNS_Q_BITS 4
aacenc_tns: redo coefficient quantization and decision making This finally (and again) gets rid of basically everything the specifications say about how TNS should be done. The main problem used to be that a single filter was used for all coefficients which despite being explicitly recommended by the specifications usually sounds wrong, therefore it's a corner case in the current TNS implementation. This commit also changes the coefficient bit size, as apparently it's better to use lower precision in case the windows are eight short. This is apparently what fdk_aac uses, looking at the bit stream and makes sense. Also the order when 8 SHORT windows happen is important as 7 was too much and according to PSNR was worse while 5 is just about correct. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-09-12 14:04:27 +02:00
/* Coefficient resolution in short windows */
#define TNS_Q_BITS_SHORT 3
aacenc_tns: rework coefficient quantization and filter application This commit reworks the TNS implementation to a hybrid between what the specifications say, what the decoder does and what's the best thing to do. The filter application function was copied from the decoder and modified such that it applies the inverse AR filter to the coefficients. The LPC coefficients themselves are fed into the same quantization expression that the specifications say should be used however further processing is not done, instead they're converted to the form that the decoder expects them to be in and are sent off to the compute_lpc_coeffs function exactly the way the decoder does. This function does all conversions and will return the exact coefficients that the decoder will generate, which are then applied to the coefficients. Having the exact same coefficients on both the encoder and decoder is a must since otherwise the entire sfb's over which the filter is applied will be attenuated. Despite this major rework, TNS might not work fine on some audio types at very low bitrates (e.g. sub 90kbps) as it can attenuate some coefficients too much. Users are advised to experiment with TNS at higher bitrates if they wish to use this tool or simply wait for the implementation to be improved. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-09-01 07:44:07 +02:00
/* TNS will only be used if the LPC gain is within these margins */
aacenc_tns: readjust values for new TNS decision making Since TNS was fixed with the recent commits retweak the values so it's more frequently used. Still not enabled by default yet, though it's possible that it will be made enabled by default in the near future. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-09-12 14:15:02 +02:00
#define TNS_GAIN_THRESHOLD_LOW 1.437f
#define TNS_GAIN_THRESHOLD_HIGH 21.19f
aacenc_tns: rework coefficient quantization and filter application This commit reworks the TNS implementation to a hybrid between what the specifications say, what the decoder does and what's the best thing to do. The filter application function was copied from the decoder and modified such that it applies the inverse AR filter to the coefficients. The LPC coefficients themselves are fed into the same quantization expression that the specifications say should be used however further processing is not done, instead they're converted to the form that the decoder expects them to be in and are sent off to the compute_lpc_coeffs function exactly the way the decoder does. This function does all conversions and will return the exact coefficients that the decoder will generate, which are then applied to the coefficients. Having the exact same coefficients on both the encoder and decoder is a must since otherwise the entire sfb's over which the filter is applied will be attenuated. Despite this major rework, TNS might not work fine on some audio types at very low bitrates (e.g. sub 90kbps) as it can attenuate some coefficients too much. Users are advised to experiment with TNS at higher bitrates if they wish to use this tool or simply wait for the implementation to be improved. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-09-01 07:44:07 +02:00
aacenc_tns: adjust coefficient calculation, add double filter support This commit improves the TNS implementation to the point where it's actually usable and very rarely results in nastyness (in all bitrates except extremely low bitrates it's increasing the quality and prevents some distortions from the coder being audiable). Also adds a double filter support which is only used if the energy difference between the top and bottom of the SFBs is above the thresholds defined in the header file. Looking at the bitstream that fdk_aac generates it sometimes used a double filter despite the specs stating that a single filter should be enough for almost all cases and purposes. Unlike FAAC or fdk_aac we sometimes use a reverse filter in case the energy difference isn't enought to use a double filter. This actually works better. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-09-05 10:08:30 +02:00
/* If the energy ratio between the low SFBs vs the high SFBs is not between
* those two values, use 2 filters instead */
#define TNS_E_RATIO_LOW 0.77
#define TNS_E_RATIO_HIGH 1.23
aacenc_tns: rework coefficient quantization and filter application This commit reworks the TNS implementation to a hybrid between what the specifications say, what the decoder does and what's the best thing to do. The filter application function was copied from the decoder and modified such that it applies the inverse AR filter to the coefficients. The LPC coefficients themselves are fed into the same quantization expression that the specifications say should be used however further processing is not done, instead they're converted to the form that the decoder expects them to be in and are sent off to the compute_lpc_coeffs function exactly the way the decoder does. This function does all conversions and will return the exact coefficients that the decoder will generate, which are then applied to the coefficients. Having the exact same coefficients on both the encoder and decoder is a must since otherwise the entire sfb's over which the filter is applied will be attenuated. Despite this major rework, TNS might not work fine on some audio types at very low bitrates (e.g. sub 90kbps) as it can attenuate some coefficients too much. Users are advised to experiment with TNS at higher bitrates if they wish to use this tool or simply wait for the implementation to be improved. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-09-01 07:44:07 +02:00
aacenc_tns: adjust coefficient calculation, add double filter support This commit improves the TNS implementation to the point where it's actually usable and very rarely results in nastyness (in all bitrates except extremely low bitrates it's increasing the quality and prevents some distortions from the coder being audiable). Also adds a double filter support which is only used if the energy difference between the top and bottom of the SFBs is above the thresholds defined in the header file. Looking at the bitstream that fdk_aac generates it sometimes used a double filter despite the specs stating that a single filter should be enough for almost all cases and purposes. Unlike FAAC or fdk_aac we sometimes use a reverse filter in case the energy difference isn't enought to use a double filter. This actually works better. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-09-05 10:08:30 +02:00
/* Do not use TNS if the psy band spread is below this value */
aacenc_tns: readjust values for new TNS decision making Since TNS was fixed with the recent commits retweak the values so it's more frequently used. Still not enabled by default yet, though it's possible that it will be made enabled by default in the near future. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-09-12 14:15:02 +02:00
#define TNS_SPREAD_THRESHOLD 0.5f
aacenc_tns: implement temporal noise shaping This commit implements temporal noise shaping support in the encoder, along with an -aac_tns option to toggle it on or off (off by default for now). TNS will increase audio quality and reduce quantization noise by applying a multitap FIR filter across allowed coefficients and transmit side information to the decoder so it could create an inverse filter. Users are encouraged to test the new functionality by enabling -aac_tns 1 during encoding. No major bugs are observable at this time so after a while if no new problems appear and if the current implementation is deemed of high enough quality and stability it will be enabled by default, possibly at the same time the encoder has its experimental flag removed and becomes the standard aac encoder in ffmpeg. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-08-21 20:27:38 +02:00
aacenc: Add missing ff_ prefixes Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com> Reviewed-by: Ganesh Ajjanagadde <gajjanag@mit.edu>
2015-08-22 07:11:23 +02:00
void ff_aac_encode_tns_info(AACEncContext *s, SingleChannelElement *sce);
aacenc_tns: rework coefficient quantization and filter application This commit reworks the TNS implementation to a hybrid between what the specifications say, what the decoder does and what's the best thing to do. The filter application function was copied from the decoder and modified such that it applies the inverse AR filter to the coefficients. The LPC coefficients themselves are fed into the same quantization expression that the specifications say should be used however further processing is not done, instead they're converted to the form that the decoder expects them to be in and are sent off to the compute_lpc_coeffs function exactly the way the decoder does. This function does all conversions and will return the exact coefficients that the decoder will generate, which are then applied to the coefficients. Having the exact same coefficients on both the encoder and decoder is a must since otherwise the entire sfb's over which the filter is applied will be attenuated. Despite this major rework, TNS might not work fine on some audio types at very low bitrates (e.g. sub 90kbps) as it can attenuate some coefficients too much. Users are advised to experiment with TNS at higher bitrates if they wish to use this tool or simply wait for the implementation to be improved. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-09-01 07:44:07 +02:00
void ff_aac_apply_tns(AACEncContext *s, SingleChannelElement *sce);
aacenc: Add missing ff_ prefixes Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com> Reviewed-by: Ganesh Ajjanagadde <gajjanag@mit.edu>
2015-08-22 07:11:23 +02:00
void ff_aac_search_for_tns(AACEncContext *s, SingleChannelElement *sce);
aacenc_tns: implement temporal noise shaping This commit implements temporal noise shaping support in the encoder, along with an -aac_tns option to toggle it on or off (off by default for now). TNS will increase audio quality and reduce quantization noise by applying a multitap FIR filter across allowed coefficients and transmit side information to the decoder so it could create an inverse filter. Users are encouraged to test the new functionality by enabling -aac_tns 1 during encoding. No major bugs are observable at this time so after a while if no new problems appear and if the current implementation is deemed of high enough quality and stability it will be enabled by default, possibly at the same time the encoder has its experimental flag removed and becomes the standard aac encoder in ffmpeg. Signed-off-by: Rostislav Pehlivanov <atomnuker@gmail.com>
2015-08-21 20:27:38 +02:00
#endif /* AVCODEC_AACENC_TNS_H */
Reference in New Issue Copy Permalink