From af34948523c88a099f06cdb8410037b107b462ce Mon Sep 17 00:00:00 2001 From: Leo Vivier Date: Tue, 1 Nov 2022 20:06:18 +0100 Subject: Push audio mastering workflow --- 2022/organizers-notebook/index.org | 113 +++++++++++++++++++++++++++++++++++++ 1 file changed, 113 insertions(+) (limited to '2022/organizers-notebook') diff --git a/2022/organizers-notebook/index.org b/2022/organizers-notebook/index.org index 48d50561..1b431945 100644 --- a/2022/organizers-notebook/index.org +++ b/2022/organizers-notebook/index.org @@ -1579,6 +1579,119 @@ EmacsConf ${year}, and thank you for submitting the prerecorded video before the conference! Sacha Chua +*** Mastering the prerec’s audio-track +Mastering is the process of preparing an audio-track for a purpose. For +us, the purpose is quite simple: maximize the intelligibility of the +speaker and minimize the noise. + +We can get great results with Audacity for the vast majority of +audio-tracks. Sometimes, however, some audio-tracks have intractable +noise-profile that require the use of model-based denoising filters that +can applied with ffmpeg. + +We’ll start with the average Audacity workflow, and we’ll move on to the +model-based filters after. + +**** Audacity workflow +When we process a prerec, we extract the audio of the original upload +and add it to the backstage. You should be able to find it under the +name --original.$audio_format. If it’s not there, it’s easy to extract +the audio from the original video, but we’d prefer if you warned +core-organizers about it because it’s not normal. + +We’ve simplified the process down to these steps: + +1. Open the audio file in Audacity. + + You might want to increase the size of the waveform by pulling on the + bottom of the bottom of the track. + +[[file:audacity-demo-resize.webm]] + +2. Find a moment of quiet in the video, and select it. + + We ask our speakers to include 5 seconds of quiet at the beginning or + end of their prerecs, but even if they don’t, it’s relatively. + +3. Effects → Noise Reduction → Get Noise Profile + +4. Select → All + +5. Effects → Noise Reduction → OK + + You can select a spoken portion of the track before applying the + effect and preview it to test your settings. The default are usually + enough (Noise reduction (dB): 12, Sensitivity: 6.00, Frequency smoothing + (bands): 3). + +6. Tools → Apply Macro → Alpha + + Before you can apply the Alpha macro, you need to save its content to + disk and import it via Tools → Macro Manager → Import. + +#+begin_src txt :eval no :tangle audacity-macro-alpha.txt +Reverb:Delay="20" DryGain="5" HfDamping="99" Reverberance="15" RoomSize="70" StereoWidth="25" ToneHigh="0" ToneLow="100" WetGain="-13" WetOnly="0" +Amplify:Ratio="1" +FilterCurve:f0="79.621641" f1="101.02321" FilterLength="8191" InterpolateLin="0" InterpolationMethod="B-spline" v0="5.9148936" v1="0.042552948" +Normalize:ApplyGain="1" PeakLevel="-3" RemoveDcOffset="1" StereoIndependent="1" +Compressor:AttackTime="0.1" NoiseFloor="-50" Normalize="1" Ratio="2" ReleaseTime="1" Threshold="-30" UsePeak="0" +#+end_src + +7. Save the file to disk with libopus (.opus format) + Use the following settings: + +#+begin_quote +Bit Rate: 64 kbps +VBR Mode: On +Compression: 10 +Application: Audio +Frame Duration: 20 ms +Cutoff: Disabled +#+end_quote + +[[file:audacity-export-settings.png]] + +**** Model-based denoising filter +If you can’t manage to get a good result with Audacity, chances are it’s +because there’s too much noise in the video, even after profile-based +denoising. This usually happens when the noise-pattern of an +audio-track evolves over the video, or if has an aperiodic quality. For +those, we’re going to need a bigger boat. + +Model-based denoising means using an AI-generated model to remove the +audio frequencies that are usually associated to noise and preserve +those that aren’t. A different context (e.g. noisy room with statics, +noisy room with people chatting, etc.) means a different model; for us, +this means a model that minimizes background noise and maximizes clear +voices (the speakers’). + +This is the model we’ve been using: +Source: [[https://github.com/GregorR/rnnoise-models][rnnoise-models]], Model: [[https://raw.githubusercontent.com/GregorR/rnnoise-models/master/marathon-prescription-2018-08-29/mp.rnnn][marathon-prescription]] + +You should always apply the filter on the original’s audio, as opposed +to an Audacity-processed audio. This is to ensure that we have the most +information about the signal, which means we can have gather the most +information about the noise-profile. + +Following is the ffmpeg incantation to use to apply the filter-model. +Make sure to modify the ~DENOISER~ variable and adapt input/output. + +#+begin_src sh :tangle audio-denoiser.sh +DENOISER="/path/to/audio-denoiser-model-mp.rnnn" +input="original.opus" +output="denoised.opus" +ffmpeg -i "$input" -af "$DENOISER" "$output" +#+end_src + +There’s no need to customize the libopus export information; the default +is more than enough for human-speech. + +When you’re done with this step, you can then process the outputted +audio-track with Audacity, skipping the denoising steps (1 to 5). + +**** Questions? +If you’ve got any question on the process, you canget in touch with me (zaeph)! + ** When a talk is captioned :PROPERTIES: :CUSTOM_ID: when-captioned -- cgit v1.2.3 From c4ab006e27a59f544d8559ac1ef5c2e612b99dea Mon Sep 17 00:00:00 2001 From: Leo Vivier Date: Tue, 1 Nov 2022 20:31:01 +0100 Subject: Fix count --- 2022/organizers-notebook/index.org | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) (limited to '2022/organizers-notebook') diff --git a/2022/organizers-notebook/index.org b/2022/organizers-notebook/index.org index 1b431945..e746dda8 100644 --- a/2022/organizers-notebook/index.org +++ b/2022/organizers-notebook/index.org @@ -1606,7 +1606,7 @@ We’ve simplified the process down to these steps: You might want to increase the size of the waveform by pulling on the bottom of the bottom of the track. -[[file:audacity-demo-resize.webm]] + [[file:audacity-demo-resize.webm]] 2. Find a moment of quiet in the video, and select it. -- cgit v1.2.3 From 334808c1d14590a527bb8d431888965f46a87975 Mon Sep 17 00:00:00 2001 From: Leo Vivier Date: Tue, 1 Nov 2022 20:31:57 +0100 Subject: Fix script --- 2022/organizers-notebook/index.org | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) (limited to '2022/organizers-notebook') diff --git a/2022/organizers-notebook/index.org b/2022/organizers-notebook/index.org index e746dda8..f3dd6aa8 100644 --- a/2022/organizers-notebook/index.org +++ b/2022/organizers-notebook/index.org @@ -1680,7 +1680,7 @@ Make sure to modify the ~DENOISER~ variable and adapt input/output. DENOISER="/path/to/audio-denoiser-model-mp.rnnn" input="original.opus" output="denoised.opus" -ffmpeg -i "$input" -af "$DENOISER" "$output" +ffmpeg -i "$input" -af "arnndn=m=$DENOISER" "$output" #+end_src There’s no need to customize the libopus export information; the default -- cgit v1.2.3 From 5cf248246dd035a97395b7fff2a53846f954b6ad Mon Sep 17 00:00:00 2001 From: Leo Vivier Date: Wed, 2 Nov 2022 06:07:31 +0100 Subject: Add links to media and slight rewords --- 2022/organizers-notebook/index.org | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) (limited to '2022/organizers-notebook') diff --git a/2022/organizers-notebook/index.org b/2022/organizers-notebook/index.org index f3dd6aa8..1927a0fc 100644 --- a/2022/organizers-notebook/index.org +++ b/2022/organizers-notebook/index.org @@ -1606,7 +1606,7 @@ We’ve simplified the process down to these steps: You might want to increase the size of the waveform by pulling on the bottom of the bottom of the track. - [[file:audacity-demo-resize.webm]] + [[https://media.emacsconf.org/misc/audacity-demo-noise-reduction.webm][audacity-demo-noise-reduction.webm]] 2. Find a moment of quiet in the video, and select it. @@ -1624,6 +1624,8 @@ We’ve simplified the process down to these steps: enough (Noise reduction (dB): 12, Sensitivity: 6.00, Frequency smoothing (bands): 3). + [[https://media.emacsconf.org/misc/audacity-demo-noise-reduction.webm][audacity-demo-noise-reduction.webm]] + 6. Tools → Apply Macro → Alpha Before you can apply the Alpha macro, you need to save its content to @@ -1637,7 +1639,7 @@ Normalize:ApplyGain="1" PeakLevel="-3" RemoveDcOffset="1" StereoIndependent="1" Compressor:AttackTime="0.1" NoiseFloor="-50" Normalize="1" Ratio="2" ReleaseTime="1" Threshold="-30" UsePeak="0" #+end_src -7. Save the file to disk with libopus (.opus format) +7. Export → Export Audio… → Opus Files (.opus format) Use the following settings: #+begin_quote @@ -1649,7 +1651,7 @@ Frame Duration: 20 ms Cutoff: Disabled #+end_quote -[[file:audacity-export-settings.png]] + [[https://media.emacsconf.org/misc/audacity-export-settings.png][audacity-export-settings.png]] **** Model-based denoising filter If you can’t manage to get a good result with Audacity, chances are it’s -- cgit v1.2.3 From 02efc6edd346ef865856f7411c56cba7c243f9f0 Mon Sep 17 00:00:00 2001 From: Leo Vivier Date: Wed, 2 Nov 2022 06:09:09 +0100 Subject: Indent better --- 2022/organizers-notebook/index.org | 20 +++++++++++--------- 1 file changed, 11 insertions(+), 9 deletions(-) (limited to '2022/organizers-notebook') diff --git a/2022/organizers-notebook/index.org b/2022/organizers-notebook/index.org index 1927a0fc..ae8743c1 100644 --- a/2022/organizers-notebook/index.org +++ b/2022/organizers-notebook/index.org @@ -1640,19 +1640,21 @@ Compressor:AttackTime="0.1" NoiseFloor="-50" Normalize="1" Ratio="2" ReleaseTime #+end_src 7. Export → Export Audio… → Opus Files (.opus format) + Use the following settings: -#+begin_quote -Bit Rate: 64 kbps -VBR Mode: On -Compression: 10 -Application: Audio -Frame Duration: 20 ms -Cutoff: Disabled -#+end_quote - [[https://media.emacsconf.org/misc/audacity-export-settings.png][audacity-export-settings.png]] + #+begin_quote + Bit Rate: 64 kbps + VBR Mode: On + Compression: 10 + Application: Audio + Frame Duration: 20 ms + Cutoff: Disabled + #+end_quote + + **** Model-based denoising filter If you can’t manage to get a good result with Audacity, chances are it’s because there’s too much noise in the video, even after profile-based -- cgit v1.2.3 From ab79bbee173f08a82a211ff8e1325af42597e8f0 Mon Sep 17 00:00:00 2001 From: Leo Vivier Date: Wed, 2 Nov 2022 06:11:01 +0100 Subject: Add link to model --- 2022/organizers-notebook/index.org | 3 +++ 1 file changed, 3 insertions(+) (limited to '2022/organizers-notebook') diff --git a/2022/organizers-notebook/index.org b/2022/organizers-notebook/index.org index ae8743c1..60303abd 100644 --- a/2022/organizers-notebook/index.org +++ b/2022/organizers-notebook/index.org @@ -1670,6 +1670,9 @@ this means a model that minimizes background noise and maximizes clear voices (the speakers’). This is the model we’ve been using: + +[[https://media.emacsconf.org/misc/audio-denoiser-model-mp.rnnn][audio-denoiser-model-mp.rnnn]] (download link) + Source: [[https://github.com/GregorR/rnnoise-models][rnnoise-models]], Model: [[https://raw.githubusercontent.com/GregorR/rnnoise-models/master/marathon-prescription-2018-08-29/mp.rnnn][marathon-prescription]] You should always apply the filter on the original’s audio, as opposed -- cgit v1.2.3