From a4af4244f03b0e7b9a70f2cae0578b04386e12d5 Mon Sep 17 00:00:00 2001 From: Sacha Chua Date: Sun, 20 Nov 2022 08:23:24 -0500 Subject: Update emergency schedule to try to alternate gen and dev talks --- 2022/organizers-notebook.md | 6411 ++++++++++---------- .../emergency-back-to-one-sat-pm.svg | 1 + .../emergency-back-to-one-sun-am.svg | 1 + .../emergency-back-to-one-sun-pm.svg | 1 + 2022/organizers-notebook/index.org | 91 +- 5 files changed, 3375 insertions(+), 3130 deletions(-) create mode 100644 2022/organizers-notebook/emergency-back-to-one-sat-pm.svg create mode 100644 2022/organizers-notebook/emergency-back-to-one-sun-am.svg create mode 100644 2022/organizers-notebook/emergency-back-to-one-sun-pm.svg (limited to '2022') diff --git a/2022/organizers-notebook.md b/2022/organizers-notebook.md index eff251c5..332d6bd3 100644 --- a/2022/organizers-notebook.md +++ b/2022/organizers-notebook.md @@ -21,37 +21,29 @@ This file is automatically exported from [/2022/organizers-notebook/index.org](/ Projects and tasks: -- [Record intro/outro for day-1 and day-2](#rec-intro):zaeph: -- [Write speaker e-mail for people who have already submitted their talks](#speaker-after-video) -- [Prepare intros for the hosts to read](#host-intros):zaeph: +- [Prepare intros for the hosts to read](#host-intros):sachac: - [Write check-in email](#check-in-email):sachac: +- [Review the submissions for encoding issues](#review-submissions):zaeph: - [Plan in-case-of-emergency schedule for dropping back to one track after Saturday morning](#one-track):sachac: -- [Satellite events](#satellite) -- [Draft e-mail to send speakers who may need to do it live](#live-speakers) -- [Prepare for prerecs](#prepare-prerec-process):zaeph: -- [Work on the OBS scenes](#obs-scenes):zaeph:corwin:sachac: -- [Make something to display between talks](#intro):akshay196: - [Create protocol for live Q&A](#live-protocol):zaeph: -- [Find volunteers for tech-checks](#tech-checks):zaeph: - [Update viewing instructions and watch pages](#write-viewing):sachac: - [Prepare to handle talk state changes](#publish-live):sachac:publish: -- [Move conf.org management to orga@res.emacsconf.org](#conforg):sachac: - [Set up stream events on Toobnix and YouTube](#other-streams):sachac:stream: - [Set up talks on Toobnix and YouTube](#video-platforms):sachac:yt:toobnix: -- [Ask speakers for bios or support nudges to include on their talk pages](#speaker-bio):wiki: -- [Do a dry run](#dry-run) -- [Smoothen captioning workflow](#caption-workflow):sachac: -- [Add category tags and possibly links between talks across 2022 and all previous years](#link-pages):quiliro:wiki: +- [Do another run](#dry-run) - [Turn off file upload service on media.emacsconf.org](#upload-off):sachac:infra: -- [JS/CSS enhancement](#watch-css):emacsconf: -- [Build up the ansible playbook](#ansible):sachac:opal: -- [Plan Etherpad use and hosting](#etherpad):sachac:ansible: -- [Set up BBB rooms and update conf.org](#create-bbb):sachac: -- [Coordinate and help volunteers](#coordinate-volunteers):sachac: -- [Investigate streaming options, maybe OBS in the cloud](#streaming):sachac: +- [Review notebook for tasks, priorities, and scheduling](#review) - [Use Mumble for backchannel coordination and also on-stage](#mumble) +- [Satellite events](#satellite) - [Volunteer update](#volunteer-2022-11-14) - [Make a linear hyperlist for managing EmacsConf](#hyperlist):sachac: +- [Record intro/outro for day-1 and day-2](#rec-intro):zaeph: +- [Add category tags and possibly links between talks across 2022 and all previous years](#link-pages):quiliro:wiki: +- [JS/CSS enhancement](#watch-css):emacsconf: +- [Build up the ansible playbook](#ansible):sachac:opal: +- [Consider breakout rooms for lunch break](#breakouts) +- [Work on the OBS scenes](#obs-scenes):zaeph:corwin:sachac: +- [Plan Etherpad use and hosting](#etherpad):sachac:ansible: Schedule by status: (gray: waiting, light yellow: processing, yellow: to assign, light green: captioning, green: captioned and ready) - Updated by conf.org and the wiki repository @@ -99,7 +91,7 @@ Schedule by status: (gray: waiting, light yellow: processing, yellow: to assign, [2022-10-09 Sun]   schedule, reply if not okay -overall priorities +overall priorities   @@ -202,14 +194,6 @@ interests you! - -intro and exit -text on screen -per-talk video, recorded voiceover -Emacs thing so we can display info, countdowns, IRC - - - conf.org management on sachac’s laptop @@ -298,6 +282,14 @@ interests you! + +BBB Q&A start +awkward silence while waiting +speaker can demo a little +host has prepared questions just in case no one shows up + + + watch page tracks @@ -376,6 +368,14 @@ interests you! DONE S: some automation comprehensive, can also work against containers + + + +intro and exit +DONE: slide on screen, host on Mumble +per-talk video, recorded voiceover +Emacs thing so we can display info, countdowns, IRC + @@ -384,518 +384,267 @@ interests you! # Projects and other long-running tasks -- [Record intro/outro for day-1 and day-2](#rec-intro):zaeph: -- [Write speaker e-mail for people who have already submitted their talks](#speaker-after-video) -- [Prepare intros for the hosts to read](#host-intros):zaeph: +- [Prepare intros for the hosts to read](#host-intros):sachac: - [Write check-in email](#check-in-email):sachac: +- [Review the submissions for encoding issues](#review-submissions):zaeph: - [Plan in-case-of-emergency schedule for dropping back to one track after Saturday morning](#one-track):sachac: -- [Satellite events](#satellite) -- [Draft e-mail to send speakers who may need to do it live](#live-speakers) -- [Prepare for prerecs](#prepare-prerec-process):zaeph: -- [Work on the OBS scenes](#obs-scenes):zaeph:corwin:sachac: -- [Make something to display between talks](#intro):akshay196: - [Create protocol for live Q&A](#live-protocol):zaeph: -- [Find volunteers for tech-checks](#tech-checks):zaeph: - [Update viewing instructions and watch pages](#write-viewing):sachac: - [Prepare to handle talk state changes](#publish-live):sachac:publish: -- [Move conf.org management to orga@res.emacsconf.org](#conforg):sachac: - [Set up stream events on Toobnix and YouTube](#other-streams):sachac:stream: - [Set up talks on Toobnix and YouTube](#video-platforms):sachac:yt:toobnix: -- [Ask speakers for bios or support nudges to include on their talk pages](#speaker-bio):wiki: -- [Do a dry run](#dry-run) -- [Smoothen captioning workflow](#caption-workflow):sachac: -- [Add category tags and possibly links between talks across 2022 and all previous years](#link-pages):quiliro:wiki: +- [Do another run](#dry-run) - [Turn off file upload service on media.emacsconf.org](#upload-off):sachac:infra: -- [JS/CSS enhancement](#watch-css):emacsconf: -- [Build up the ansible playbook](#ansible):sachac:opal: -- [Plan Etherpad use and hosting](#etherpad):sachac:ansible: -- [Set up BBB rooms and update conf.org](#create-bbb):sachac: -- [Coordinate and help volunteers](#coordinate-volunteers):sachac: -- [Investigate streaming options, maybe OBS in the cloud](#streaming):sachac: +- [Review notebook for tasks, priorities, and scheduling](#review) - [Use Mumble for backchannel coordination and also on-stage](#mumble) +- [Satellite events](#satellite) - [Volunteer update](#volunteer-2022-11-14) - [Make a linear hyperlist for managing EmacsConf](#hyperlist):sachac: +- [Record intro/outro for day-1 and day-2](#rec-intro):zaeph: +- [Add category tags and possibly links between talks across 2022 and all previous years](#link-pages):quiliro:wiki: +- [JS/CSS enhancement](#watch-css):emacsconf: +- [Build up the ansible playbook](#ansible):sachac:opal: +- [Consider breakout rooms for lunch break](#breakouts) +- [Work on the OBS scenes](#obs-scenes):zaeph:corwin:sachac: +- [Plan Etherpad use and hosting](#etherpad):sachac:ansible: -Roughly ordered by importance. + - +## TODO Prepare intros for the hosts to read :sachac: -## TODO Record intro/outro for day-1 and day-2 :zaeph: + +also in :INTRO\_NOTE: in conf.org so that we can plop it into the hyperlists +Doublecheck: -- Opening remarks - - Schedule overview - - How to participate -- Closing remarks Sat - - Thanks - - Come back tomorrow -- Closing remarks Sun - - Thanks - - +### DONE Set up Etherpad with the talks and see if we can involve the speakers and captioning volunteers :sachac: - + -## DONE Write speaker e-mail for people who have already submitted their talks +## TODO Write check-in email :sachac: -To: speakers who have already submitted their talks (so that we don’t distract people who are still working on their talks) - (defun emacsconf-mail-speaker-after-video (group &optional template) - (interactive (list (emacsconf-mail-complete-email-group - (seq-filter (lambda (o) (plist-get o :intro-note)) - (emacsconf-active-talks (emacsconf-get-talk-info)))))) - (setq template (or template (emacsconf-mail-merge-get-template "speaker-after-video"))) - (let ((talks (cdr group))) - (emacsconf-mail-prepare - template - (car group) - (list :speakers-short (plist-get (cadr group) :speakers-short) - :plural (if (= (length (cdr group)) 1) "" "s") - :email (plist-get (cadr group) :email) - :in-between (mapconcat (lambda (talk) - (emacsconf-surround "" "")) - (cdr group) - ", ") - :intro - (mapconcat (lambda (talk) - (string-join (org-wrap (emacsconf-surround "- " (plist-get talk :intro-note) "\n" "") 70) "\n")) - (cdr group) - "") - :chapters - (mapconcat (lambda (talk) - (format ":\n%s" - (plist-get talk :slug) - (mapconcat - (lambda (chapter) - (concat (format-seconds "%.2h:%z%.2m:%.2s" - (floor (/ (elt chapter 1) 1000))) - " " - (elt chapter 3) "\n")) - (subed-parse-file - (expand-file-name (concat (plist-get talk :video-slug) "--main--chapters.vtt") emacsconf-cache-dir))))) - (cdr group) - "\n\n") - :caption-note - (if (seq-find (lambda (o) (not (string= (plist-get o :status) "TO_STREAM"))) (cdr group)) - " The captions haven't been fully edited yet, so please ignore any errors in the captions themselves." - "") - :urls - (mapconcat (lambda (o) (concat "<" emacsconf-base-url (plist-get o :url) ">")) - (cdr group) " , ") - :tech-check-note - (if (string-match "live" (or (mapconcat (lambda (o) (or (plist-get o :q-and-a) "")) (cdr group) " ") "")) - (format - "*Tech check* - - Since you're planning to do a live Q&A session, you may want to - connect to the test BBB room at <%s> to make sure you can share - your audio, your window or screen, and your webcam (optional). Sharing - system audio or multi-monitor setups can sometimes be tricky, so - please let us know if you need help figuring things out. You can - double-check by connecting with a separate device, or you can arrange - to meet with one of the tech-check volunteers - ().${wrap} - - " emacsconf-test-bbb-room) ""))) - (add-hook 'message-sent-hook - `(lambda () - (mapc (lambda (o) - (emacsconf-add-to-talk-logbook o "Sent speaker-after-video email")) - (list - ,@(mapcar (lambda (talk) (plist-get talk :slug)) talks)))) - nil t))) - - (defun emacsconf-mail-speakers-after-videos () - (interactive) - (let* ((info (seq-filter (lambda (o) (plist-get o :intro-note)) - (emacsconf-active-talks (emacsconf-get-talk-info)))) - (grouped (seq-group-by (lambda (o) (plist-get o :email)) info)) - (template (emacsconf-mail-merge-get-template "speaker-after-video"))) - (mapc (lambda (group) - (emacsconf-mail-speaker-after-video group template)) - grouped))) +### TODO Draft e-mail to send speakers who may need to do it live -### Template + -Hi, ${speakers-short}! +## TODO Review the submissions for encoding issues :zaeph: -Thank you for uploading your video early! Let’s get a few more things -sorted out for a smooth EmacsConf 2022. +so that we don’t get surprised by missing or corrupted videos -${tech-check-note}\*Intro\* -I’ve written a brief (and possibly inaccurate! =) ) intro that the -host can read out before your talk while the in-between slide -(${in-between}) is being displayed: + -${intro} +## TODO Plan in-case-of-emergency schedule for dropping back to one track after Saturday morning :sachac: -Would you like to tweak it to better reflect your talk? +We might be able to do it on a modular basis (Saturday afternoon, Sunday morning, or Sunday afternoon). +We need a quick way to notify the affected speakers, and we should give them a heads-up as well. +We also need a quick way to update the schedule. -**Chapter markers** -I’ve added chapter markers to your video in the backstage area to help -with navigation. You can click on them in the backstage area if you -want to easily jump around, or review the list that I’ve included for -your convenience: +### STARTED Update conf.org and the wiki based on the selected schedule -${chapters} -If you prefer other headings or timestamps, please let me know!${caption-note} -**Bio, community support links** +### TODO Give speakers a heads-up regarding schedule tweaks and the potential for bigger schedule changes -People often want to learn more about speakers and show their -appreciation. If you’d like to include an author bio and any -social/support links to your talk page${plural} (${urls}), please -e-mail us the text that you’d like to include. You can also follow the -instructions at to edit your talk -page${plural} directly yourself, if you want to.${wrap} -Thanks again for all your contributions! +### TODO Draft the code for mailing all the affected speakers -Sacha +### Saturday afternoon - +- ![img](emergency-back-to-one-sat-pm.svg) -## TODO Prepare intros for the hosts to read :zaeph: +### Sunday morning -### TODO Set up Etherpad with the talks and see if we can involve the speakers and captioning volunteers :sachac: +- ![img](emergency-back-to-one-sun-am.svg) - +### Sunday afternoon -## TODO Write check-in email :sachac: +- ![img](emergency-back-to-one-sun-pm.svg) - +### TODO Get the emergency schedule sorted out so that we can easily switch to it -## TODO Plan in-case-of-emergency schedule for dropping back to one track after Saturday morning :sachac: + - +## TODO Create protocol for live Q&A :zaeph: -## Satellite events +Objective: +- Move smoothly from the talk to live-questions, and have adaptations based on how many questions the talk receives. -### Zurich +Comments: +- It would be nice to have a protocol with speakers to tell us that they’re uncomfortable with a question, just so that we can find a smooth way to skip it. -#### TODO Link to them on the wiki :zaeph: - + +## TODO Update viewing instructions and watch pages :sachac: -#### TODO announce on the emacsconf-discuss mailing list :zaeph: +Extra stuff to consider adding: +- Suggestions for mpv-filter to invert colourscape. - +Also add to watch page -## TODO Draft e-mail to send speakers who may need to do it live +- +- +- - +### DONE Add Q&A distinction to SVG schedule -## DONE Prepare for prerecs :zaeph: +### CANCELLED Make it easy to get to recent/current/next talk information while watching -### DONE Optimize ffmpeg incantation +Maybe links to the current shift’s pads -Remember to update <../prepare.md> with the new incantation. +### TODO Add pad to sched directive so that it will be linked when the pads are live -#### Incantation from last year - Q=32 - ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -an -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -threads 8 /dev/null && - ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -c:a copy -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -threads 8 "$2" +### TODO Update as well -#### New candidate + -Changelog: +## TODO Prepare to handle talk state changes :sachac:publish: -- Disable adaptive quantization by setting aq-mode to 0 (TODO: compare samples) -- Add `-row-mt 1` needed to support `tile-rows` (2×2 is enough for 720p) -- Also use tiles for first pass -- Remove `-frame-parallel 0` because it’s disabled by default (see [Notes on encoding settings · Kagami/webm.py Wiki](https://github.com/Kagami/webm.py/wiki/Notes-on-encoding-settings)) -- Put number of CPU in variable and use it for `cpu-used` and `threads` -- Stick to default for `auto-alt-ref` -- Stick to default for `lag-in-frames` - Q=32 - CPU=8 - ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -an -row-mt 1 -tile-columns 2 -tile-rows 2 -cpu-used $CPU -g 240 -pass 1 -f webm -threads $CPU /dev/null && - ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -c:a copy -row-mt 1 -tile-columns 2 -tile-rows 2 -cpu-used $CPU -pass 2 -g 240 -threads $CPU "$2" +### Talk states -Other considerations: +- **WAITING\_FOR\_PREREC(p):** waiting for the speaker to upload. Use this + to nudge people weekly after the deadline, keeping PREREC\_INFO in + mind for speakers who have told us they’ll need extra time. +- **TO\_PROCESS(a):** talk has been uploaded. zaeph will rename it, + process it using ffmpeg/audacity, and then put it in + media.emacsconf.org/2022/backstage along with any related files. + - VIDEO\_FILE + - VIDEO\_FILE\_SIZE + - VIDEO\_DURATION +- **TO\_AUTOCAP(y):** sachac will prepare automated captions for easier editing + - YOUTUBE\_URL + - TOOBNIX\_URL +- **TO\_ASSIGN(a):** captioning volunteers can call dibs on this talk by + e-mailing sacha@sachachua.com. talk will be listed on media.emacsconf.org/2022/backstage/index.html +- **TO\_CAPTION(c):** captioning is in progress. + - CAPTIONER property is set to the volunteer. +- **TO\_STREAM(s):** talk is captioned and ready to play. Transcript directives are prepared so that the talk can be published with the transcript when it streams. +- **PLAYING(m):** talk is being streamed live; announce in IRC and publish prerec and other resources on talk page +- **CLOSED\_Q(q):** host is doing closed Q&A session with speaker; announce Q&A in IRC, friendly BBB page should refresh with waiting message +- **OPEN\_Q(o):** host is doing open Q&A session with speaker, friendly BBB page should redirect to BBB; update IRC and Etherpad +- **UNSTREAMED\_Q(u):** Q&A session with speaker continues off the stream because another talk has started playing; list on current page +- **TO\_ARCHIVE:** Q&A session has ended; update talk page and current page. At some point, archive the pad and IRC onto the talk page. +- **TO\_EXTRACT:** Extract the recording from the Q&A room + - QA\_YOUTUBE + - QA\_TOOBNIX +- **TO\_FOLLOW\_UP:** Send questions to the speaker for follow-up +- **DONE(x):** all done, yay! +- **CANCELLED(!):** maybe next time -- We might want to tweak the time before keyframes (`-g`). +Other things that aren’t tracked by todo status: +- **CHECK\_IN: t:** once the speaker has been checked into the BBB room or IRC -### DONE Figure out workflow for handling submitted prerecs -We need time after the prerecs get submitted to: +#### TODO Prerec publishing -- convert the videos and check that they’ve been reencoded properly by watching the re-encoded ones all the way to the end -- caption videos -- capture any extra info -- follow up with missing prerecs +Move to public directory and create a link from the backstage directory +Update the wiki page -Make changes in [As prerecorded talks come in](#prerec-process) - - - -## INPROGRESS Work on the OBS scenes :zaeph:corwin:sachac: - -- [ ] corwin is out from Nov 11-20, and we should start working on them before then. - - - - -## DONE Make something to display between talks :akshay196: - -Goals: - -- Reassure people that they’re in the right stream for the talk that they’re looking for -- Direct them to the pad and Q&A for the talk - -What to show in between talks: - -- Previous talk: title, speaker, pronouns, talk page, Q&A information (if still live) -- Next talk: title, speaker, pronouns, talk page, Q&A information, countdown - - - - -- Good: Static image, maybe created with LaTeX -- Better: Video with unobtrusive sound so people can doublecheck that their audio works -- Best: Emacs thing so that we can have a dynamic timer and last-minute announcements, and so that it’s Emacs =) -- Even better than that: A compact view that can be overlaid on the Q&A session using OBS - -See break commercials - - -OBS scenes (maybe?): - -- splash-screen when we’re on break -- scene when broadcasting a talk (where we might want a logo and a bar or surrounding to broadcast messages like time left in - recording); and -- Q&A scene with host-webcam, optional speaker-webcam, and pad with questions. -- Q&A scene focusing on shared screen from speaker -- Q&A scene with IRC and pad - -Nothing is urgent, blocking it, or being blocked by it, so you can -play around with ideas. - -We’re experimenting with two tracks this year, so we expect that some -people will join midway through a talk or Q&A session and -would like to reorient themselves. Some Q&A sessions may end -early, so we would like to reassure people that they’re in -the right spot for the next talk. Most Q&As will be done -live, but some Q&As will be done over IRC, so we need to -point people to the right place. - -and if there’s room for a little extra info like public e-mail -addresses or pronouns, that can help people when they discuss -things. That info will be in the pad and IRC, though, so it’s -also okay to omit it - -We can programmatically replace strings in -SVG from Emacs, so we can easily use that as an overlay. - - …Or, if you just want to focus on the look of -things, we can think of the content on our own. - - oh yeah, totally, you can just focus on the design and use -placeholder text - -Overlay considerations: - -- talk videos will likely have subtitles; no subtitles for Q&A -- zaeph doesn’t like vertical text - - -### DONE Generate talk banners :sachac: - -![img](https://gitlab.com/akshay196/emacsconf-artwork/-/blob/main/2022/talk-banner/sample.svg) - - - - -## TODO Create protocol for live Q&A :zaeph: - -Objective: - -- Move smoothly from the talk to live-questions, and have adaptations based on how many questions the talk receives. - -Comments: - -- It would be nice to have a protocol with speakers to tell us that they’re uncomfortable with a question, just so that we can find a smooth way to skip it. - - - - -## INPROGRESS Find volunteers for tech-checks :zaeph: - - -### DONE Add entry in 2022/volunteer.md - - -### INPROGRESS Write protocol for adding tech-checker volunteer - -- Invite volunteer to BBB (ask core organizers) -- Update with new tech-checker info -- Coach tech-checker on the protocol - - -### INPROGRESS Write the tech-checking protocol (formerly referred to as “tech-checklist”) - -From previous years: - -> - Can you speak and be heard? Is there echo? -> - Can you hear the organizer? -> - Can you share your screen? Is the screen readable? -> - If you plan to show your keystrokes, is that display visible? -> - If you want to share your webcam (optional), can you enable it? Is it visible? Will there likely be distractions in the background? -> - Can you view the collaborative pad? Will you be comfortable reviewing questions on your own (perhaps by keeping it open beside your shared window), or will you need a volunteer to relay questions to you? -> - Can you share contact information (ex: phone number) so that we can get in touch with you in case of technical issues or scheduling changes? -> - Do you need help finding your way around IRC so that you can check into \`#emacsconf-org\`? What is your IRC nickname? - - - - -## DONE Update viewing instructions and watch pages :sachac: - -Extra stuff to consider adding: - -- Suggestions for mpv-filter to invert colourscape. - -Also add to watch page - -- -- -- +### TODO Check process for posting prerecs to the talk page and media directory as soon as the talk is live :sachac: -### DONE Add Q&A distinction to SVG schedule - - -### TODO Make it easy to get to recent/current/next talk information while watching - -Maybe links to the current shift’s pads - - -### TODO Add pad to sched directive so that it will be linked when the pads are live - + -### TODO Update as well +### DONE Prepare to announce talks on IRC +emacsconf-erc.el in the emacsconf-el repo - +- talks should be announced in their relevant track channel and in the main channel + - video starting now + - Q&A starting now & where +- a small announcement might go into the hallway and emacsconf-org +- announcement can include talk page, pad, IRC nick, pronouns -## TODO Prepare to handle talk state changes :sachac:publish: + -### Talk states +## STARTED Set up stream events on Toobnix and YouTube :sachac:stream: -- **WAITING\_FOR\_PREREC(p):** waiting for the speaker to upload. Use this - to nudge people weekly after the deadline, keeping PREREC\_INFO in - mind for speakers who have told us they’ll need extra time. -- **TO\_PROCESS(a):** talk has been uploaded. zaeph will rename it, - process it using ffmpeg/audacity, and then put it in - media.emacsconf.org/2022/backstage along with any related files. - - VIDEO\_FILE - - VIDEO\_FILE\_SIZE - - VIDEO\_DURATION -- **TO\_AUTOCAP(y):** sachac will prepare automated captions for easier editing - - YOUTUBE\_URL - - TOOBNIX\_URL -- **TO\_ASSIGN(a):** captioning volunteers can call dibs on this talk by - e-mailing sacha@sachachua.com. talk will be listed on media.emacsconf.org/2022/backstage/index.html -- **TO\_CAPTION(c):** captioning is in progress. - - CAPTIONER property is set to the volunteer. -- **TO\_STREAM(s):** talk is captioned and ready to play. Transcript directives are prepared so that the talk can be published with the transcript when it streams. -- **PLAYING(m):** talk is being streamed live; announce in IRC and publish prerec and other resources on talk page -- **CLOSED\_Q(q):** host is doing closed Q&A session with speaker; announce Q&A in IRC, friendly BBB page should refresh with waiting message -- **OPEN\_Q(o):** host is doing open Q&A session with speaker, friendly BBB page should redirect to BBB; update IRC and Etherpad -- **UNSTREAMED\_Q(u):** Q&A session with speaker continues off the stream because another talk has started playing; list on current page -- **TO\_ARCHIVE:** Q&A session has ended; update talk page and current page. At some point, archive the pad and IRC onto the talk page. -- **TO\_EXTRACT:** Extract the recording from the Q&A room - - QA\_YOUTUBE - - QA\_TOOBNIX -- **TO\_FOLLOW\_UP:** Send questions to the speaker for follow-up -- **DONE(x):** all done, yay! -- **CANCELLED(!):** maybe next time +so that people on other platforms can come across EmacsConf -Other things that aren’t tracked by todo status: -- **CHECK\_IN: t:** once the speaker has been checked into the BBB room or IRC +### TODO Write the restreaming shell scripts -##### TODO Prerec publishing +#### TODO Restream-gen-youtube -Move to public directory and create a link from the backstage directory -Update the wiki page +### DONE Create the events and save the keys :sachac: -### TODO Check process for posting prerecs to the talk page and media directory as soon as the talk is live :sachac: +[Other platforms](file:///home/sacha/proj/emacsconf/private/conf.md) +$1 is of the form rtmp://…/stream\_key - + MOUNT=$1 + while true; do ffmpeg -loglevel 24 -i http://localhost:8000/main.webm -cluster_size_limit 2M -cluster_time_limit 5100 -b:v 1M -crf 30 -g 125 -deadline good -threads 4 -vcodec libx264 -acodec libmp3lame -f flv $MOUNT; done -### DONE Prepare to announce talks on IRC +Creating the events -emacsconf-erc.el in the emacsconf-el repo +- YouTube: Create - Go Live - Schedule Stream - Streaming Software +- Toobnix: Publish - Go live + - max live is 5 hours -- talks should be announced in their relevant track channel and in the main channel - - video starting now - - Q&A starting now & where -- a small announcement might go into the hallway and emacsconf-org -- announcement can include talk page, pad, IRC nick, pronouns +##### EmacsConf 2022 - General track - +This is for the general track of EmacsConf, the conference about the joy of Emacs and Emacs Lisp. -## DONE Move conf.org management to orga@res.emacsconf.org :sachac: +Watch using free/open source software: +Conference info: +Schedule: +Chat on #emacsconf-dev via or irc.libera.chat +Etherpad: -so that more people can work with it during the conference -See the publish role in the ansible playbook +Videos are shared under the terms of the Creative Commons Attribution-ShareAlike 4.0 +International (CC BY-SA 4.0) license. Please observe the guidelines for conduct: - +##### EmacsConf 2022 - Development track -## TODO Set up stream events on Toobnix and YouTube :sachac:stream: +This is for the development track of EmacsConf, the conference about the joy of Emacs and Emacs Lisp. -so that people on other platforms can come across EmacsConf +Watch using free/open source software: +Conference info: +Schedule: +Chat on #emacsconf-dev via or irc.libera.chat +Etherpad: - MOUNT=$1 - while true; do ffmpeg -loglevel 24 -i http://localhost:8000/main.webm -cluster_size_limit 2M -cluster_time_limit 5100 -b:v 1M -crf 30 -g 125 -deadline good -threads 4 -vcodec libx264 -acodec libmp3lame -f flv $MOUNT; done +Videos are shared under the terms of the Creative Commons Attribution-ShareAlike 4.0 +International (CC BY-SA 4.0) license. Please observe the guidelines for conduct: -## BLOCKED Set up talks on Toobnix and YouTube :sachac:yt:toobnix: +## TODO Set up talks on Toobnix and YouTube :sachac:yt:toobnix: so that people can find the videos on other video platforms waiting for prerecs - - -## TODO Ask speakers for bios or support nudges to include on their talk pages :wiki: - -maybe after we get the prerecs -ex: liberapay, patreon, anyone looking for a job, etc. - - -## DONE Do a dry run +## TODO Do another run Summary: @@ -967,36 +716,80 @@ videotestsrc num\_buffers=2450 ! video/x-raw,width=400,height=300,framerate=10/1 1251,/home/sacha/proj/emacsconf/private/assets/titles% find -name community-title.svg -exec inkscape –export-type=png –export-width=1280 –export-height=720 –export-background-opacity=0 {} \\; - +### DONE Do mini dry run -## TODO Smoothen captioning workflow :sachac: -It looks like OpenAPI needs a little less editing in terms of -capitalization and punctuation, but it produces longer captions -(likely a 30-second sliding window). I’ll try to upload both YT and -OpenAPI captions so that people can decide what they like. +#### DONE Revisit OBS and streaming setup to prepare for the dry run next weekend -### DONE Figure out why it’s choking on SRV2 + -Can I use aeneas for alignment instead? +## TODO Turn off file upload service on media.emacsconf.org :sachac:infra: -Reflow the .txt file and reupload to res if needed -call ../run-aeneas.sh from the directory with the opus or ogg and the txt file +so that nginx can have more memory and we don’t risk slowdowns -sachac@res-https://emacsconf.org/2022/talks/~/current/meetups$ python3 -m aeneas.tools.execute\_task emacsconf-2022-meetups–attending-and-organizing-emacs-meetups–bhavin-gandhi–main.opus reflowed.srt “task\_language=eng|os\_task\_file\_format=json|is\_text\_type=subtitles” output.json -I might try out lhotse and torchaudio someday, but it’s low priority. aeneas seems to do a reasonable job of + +## STARTED Review notebook for tasks, priorities, and scheduling -### TODO Move publishing the backstage index to res so that we can trigger it after the files are uploaded + -### DONE Compare large, medium, and small models +## INPROGRESS Use Mumble for backchannel coordination and also on-stage -12 threads +[2022-11-19 Sat] sachac: Confirmed that you can join the emacsconf-dev or emacsconf-gen channel if you have access, and you can speak on air in just that channel -Original file: 21:16 21 minutes + +### DONE Update the Mumble setup :bandali: + +- [X] Add emacsconf-gen and emacsconf-dev channels +- [X] Give the emacsconf-gen and emacsconf-dev users access to them +- [X] Give the other organizers access to emacsconf-gen, emacsconf-dev, and org-private +- [X] Get emacsconf-gen and -dev to join the right channels + + +### DONE E-mail volunteers and help them get on Mumble :bandali: + + +#### Template + +We plan to use Mumble as a virtual walkie-talkie during the conference +so that we can quickly talk to each other as needed. It can also be a +way for us to add our audio to the streams. Please set up your system +as follows: + +1. Install a Mumble client on the device you want to use to connect to + the voice channel. It can be your computer or phone. You can choose + the username that you would like to log in with. +2. Create and backup your certificate. (This is part of the wizard for + the desktop client, and it might be automatic on a phone client.) +3. Connect to mumble.emacsconf.org with your desired username. +4. Register your account on the server using the `Self > Register` + command. This reserves your username using your certificate and + allows me to add you to ACLs. +5. Let me know (sachac on #emacsconf-org in IRC or + sacha@sachachua.com) when you’ve registered so that I can add you + to the access control lists for the private channels. If I’m around + on mumble (sachac), you can say hi to me there and confirm that + it’s working. + +You can enter a channel by double-clicking on it. (On Mumla for +Android, entering a channel is instead done by clicking on the arrow +to the right of the channel.) Then your audio will go to that channel, +and you can hear audio from that channel. We can use the +`emacsconf-gen` and `emacsconf-dev` channels to speak on air, and we +can use the `backstage` channel for coordination. + +Looking forward to hearing from you! + +Sacha + + +### DONE Generate certificates, add them to conf.org, and register the users :sachac: + + +### WAITING Set up Mumble and bring the volunteers on board @@ -1004,172 +797,134 @@ Original file: 21:16 21 minutes -- -+ + + + + + + + + - - - - + + + - - - - - - - - - - - + + - - - - + + +
 EmailedOnboarded
 HoursMultNotesFlowyCoderX[2022-11-19 Sat] access granted, briefed
Large2:498 
Medium2:035.9jmanX  
Small0:402More run-on sentencesvetrivlnX[2022-11-19 Sat] access granted, needs to figure out audio
-Large and medium might do better on a system with a GPU. I’ll default to the small model for now. + -### DONE Commit subed-tsv so that people can try a cleaner output +## Satellite events -### DONE Investigate more granular timestamps for the output from OpenAPI Whisper +### Zurich - +#### TODO Link to them on the wiki :bandali: -### DONE Upload srv2 from YouTube for word-level + -### CANCELLED Compare with Google Cloud Speech API +#### TODO announce on the emacsconf-discuss mailing list :bandali: -~/code/speech + -### DONE E-mail for bringing new captioning volunteers onboard +## Volunteer update - (defun emacsconf-mail-backstage-intro (volunteer &optional template) - (interactive (list (emacsconf-complete-volunteer))) - (emacsconf-mail-prepare - (or template (emacsconf-mail-merge-get-template "backstage-intro")) - (assoc-default "EMAIL" volunteer 'string=) - (list - :backstage "https://media.emacsconf.org/2022/backstage/" - :backstage-user "emacsconf" - :backstage-password emacsconf-backstage-password - :conf-name emacsconf-name - :year emacsconf-year - :name (assoc-default "NAME_SHORT" volunteer 'string=) - :email (assoc-default "EMAIL" volunteer 'string=)))) +- talk banners, akshay -#### Template + -Hi ${name}! +## TODO Make a linear hyperlist for managing EmacsConf :sachac: -Thank you for volunteering for ${conf-name} ${year}! +Goal: -We’ve set up ${backstage} as the backstage area where you can view the -videos and resources uploaded so far. You can access it with the -username "${backstage-user}“ and the password ”${backstage-password}“. -Please keep the backstage password and other speakers’ talk resources -secret. +- Volunteers should be able to coordinate everything by stepping through a linear list of things to do +- The hyperlist will primarily live on orga@res.emacsconf.org and be accessed through emacsclient. (Maybe sat.org and sun.org) +- Volunteers should be able to take breaks as needed -For some ideas on ways to help, you can check out - . You can also suggest other -things you might be interested in. +- 9:05 Journalism + - [ ] Check ${name} into BBB room + - [X] [Start talk]((emacsconf-update-talk-status "journalism" "." "PLAYING")) + - [X] [Start closed Q&A]((emacsconf-update-talk-status "journalism" "." "CLOSED_Q")) + - [ ] [Open Q&A]((emacsconf-update-talk-status "journalism" "." "OPEN_Q")) + - [ ] [Mark Q&A as unstreamed]((emacsconf-update-talk-status "journalism" "." "UNSTREAMED_Q")) + - [ ] [Finish talk]((emacsconf-update-talk-status "journalism" "." "TO_ARCHIVE")) +- 9:40 Handwritten + - [ ] [Start talk]((emacsconf-update-talk-status "handwritten" "." "PLAYING")) + - [ ] [Start closed Q&A]((emacsconf-update-talk-status "handwritten" "." "CLOSED_Q")) + - [ ] [Open Q&A]((emacsconf-update-talk-status "handwritten" "." "OPEN_Q")) + - [ ] [Mark Q&A as unstreamed]((emacsconf-update-talk-status "handwritten" "." "UNSTREAMED_Q")) + - [ ] [Finish talk]((emacsconf-update-talk-status "handwritten" "." "TO_ARCHIVE")) -You can ask questions or chat with other volunteers by e-mailing the -mailing list at emacsconf-org@gnu.org or dropping by #emacsconf on the -libera.chat IRC network. You can also e-mail me or -emacsconf-org-private@gnu.org if you have private questions. +See sat.org and sun.org in the conf private repo -Thank you again for your help! =) +Try them in an Etherpad -Sacha Chua + + + +[How do we want to coordinate during the conference itself?](#coordination) -### DONE E-mail for bringing new captioning volunteers onboard - (defun emacsconf-mail-captioning-intro (volunteer &optional template) - (interactive (list (emacsconf-complete-volunteer) - (emacsconf-mail-merge-get-template "captioning-intro"))) - (emacsconf-mail-prepare - (or template (emacsconf-mail-merge-get-template "captioning-intro")) - (assoc-default "EMAIL" volunteer 'string=) - (list - :backstage "https://media.emacsconf.org/2022/backstage/" - :backstage-user "emacsconf" - :backstage-password emacsconf-backstage-password - :conf-name emacsconf-name - :year emacsconf-year - :name (assoc-default "NAME_SHORT" volunteer 'string=) - :email (assoc-default "EMAIL" volunteer 'string=)))) +### DONE Try writing it to an Etherpad -#### Template +### TODO Revisit the hyperlists to make sure they make sense -Hi ${name}! -Thank you for volunteering to help with the captions for ${conf-name} -${year}! Last year, we were able to get almost all the talks captioned -in time for streaming. Participants found them very useful for -understanding different technical terms, names, accents, and so on. -We’d love to be able to pull that off again this year, and it would be -great to have you on board. +### TODO Add intro notes and specific talk notes to the hyperlist -We’ve set up ${backstage} as the backstage area where you can view the -videos and resources uploaded so far. You can access it with the -username "${backstage-user}“ and the password ”${backstage-password}“. -Please keep the backstage password and resources secret. If you see a -talk that you’d like to caption, you can e-mail me at -sacha@sachachua.com and I can reserve it for you. Then you can correct -any misrecognized words, fix capitalizations, remove filler words as -needed, and so on. -You’ll probably want to work with either the VTT or the TXT versions -(VTT is WebVTT format and has timestamps), but you can check the other -talk resources in case the speaker has posted scripts or other useful -things. Both VTT and TXT are plain text, so feel free to use your -favourite text or subtitle editor. I’ve posted a brief demo of how I -edit captions at - , and -you can find more captioning tips at -. You can convert it to whatever format you like. If you prefer to -work with plain text, we can figure out the timestamps afterwards. +### TODO Make a hyperlist for checking people in for easier copying and pasting -Let me know if you want to reserve a talk for captioning or if you have -any questions or suggestions. We’re also in the #emacsconf-org channel -on the libera.chat IRC network, which you can connect to with your -favourite IRC client or through the web-based interface at - . -Sacha Chua +### TODO Send FlowyCoder hyperlist for checking people in +[Use Mumble for backchannel coordination and also on-stage](file:///home/sacha/proj/emacsconf/wiki/2022/organizers-notebook/index.md) -### DONE Support cue IDs in subed-vtt.el +### TODO Make backstage redirects for pad and qa so that hosts and streamers can have an easier time -### TODO jiwer · PyPI - measure error rate - + + +## TODO Record intro/outro for day-1 and day-2 :zaeph: + +- Opening remarks + - Schedule overview + - How to participate + +- Closing remarks Sat + - Thanks + - Come back tomorrow +- Closing remarks Sun + - Thanks + - @@ -1188,11 +943,6 @@ Sacha Chua You can make a new heading called `# Related talks` - - -## TODO Turn off file upload service on media.emacsconf.org :sachac:infra: - - ## TODO JS/CSS enhancement :emacsconf: @@ -1220,6 +970,8 @@ in prod or docker container ### TODO restreamers on live0 +[Set up stream events on Toobnix and YouTube](#other-streams) + ### DONE icecast on live0 @@ -1229,7 +981,7 @@ in prod or docker container #### DONE Set up watch/gen-480p -### TODO publishing environment +### DONE publishing environment ### DONE Get ansible to run against a clean docker @@ -1238,6 +990,18 @@ in prod or docker container ### DONE Set up Etherpad with MySQL + + +## SOMEDAY Consider breakout rooms for lunch break + + + + +## INPROGRESS Work on the OBS scenes :zaeph:corwin:sachac: + +- [ ] corwin is out from Nov 11-20, and we should start working on them before then. + + ## INPROGRESS Plan Etherpad use and hosting :sachac:ansible: @@ -1349,3445 +1113,3884 @@ if we can get the anchor plugin `emacsconf-pad-export-initial-content-for-all-talks` - + -## TODO Set up BBB rooms and update conf.org :sachac: +# Projects to bear in mind but which are not actual -1. Log on to bbb.emacsverse.org as an admin. -2. Create a room. Enable **Mute users when they join**. - - The code below doesn’t quite work, but might be a good starting point for future automation. - - (setq list (seq-drop (emacsconf-bbb-room-title-list) 3)) ; skip some if needed - (progn - (setq name (pop list)) - (kill-new (format "name=\"%s\";$('#create-room-block').click();$('#create-room-name').val(name);$('#room_mute_on_join').click();$('.create-room-button').click();\n" - name)) - (sleep-for 1) - (shell-command "xdotool key alt+Tab sleep 3 key ctrl+v sleep 1 key Return")) -console.log(JSON.stringify([…document.querySelectorAll(’.delete-room’)].map((o) => { return { name: o.getAttribute(’data-name’), path: o.getAttribute(’data-path’) }}).filter((o) => o.name.match(*^ec22*)))) +## DONE Find a way to accommodate a specific return-speaker -see conf.org for the rest of the process +We’re not sure if we’re going to get a presentation or a prerec for them +this year, but we need to keep this at the back of our minds. +Note on how DebConf handled incidents: + -### DONE Add volunteers to the BBB rooms -- vetrivln: sat-am-dev, sun-am-dev -- FlowyCoder: sat-pm-gen, sun-pm-gen -- jman: sun-pm-gen + +# Things to figure out / decisions to make - +- [How do we want to coordinate during the conference itself?](#coordination) +- [How do we want to make the full schedule more manageable?](#sched-decision) +- [How much do we want to enrich the wiki with JS?](#wiki-design) +- [How do we want to make better use of Etherpad?](#pad-decision) +- [Can we nudge people to ask IRC questions in a way that will make it easier for us to follow them?](#irc-markers) +- [Do we want people to advertise any openings with their companies or any work that they’re looking for?](#advertising) +- [Decision archive](#decision-archive) +- [Think about what to do with schedule gaps due to cancelled talks](#schedule-gaps):thoughts: -## INPROGRESS Coordinate and help volunteers :sachac: -- <../volunteer> -- Figure out what information volunteers need in order to feel - comfortable signing up for tasks. ex: - -- Encourage people to sign up for [Shifts](#shifts) + +## How do we want to coordinate during the conference itself? -### TODO Plan training session(s), Q&A availability, recordings +- Considerations: + - Good to have something that the hosts and streamers can walk through step by step + - Do we want the check-in volunteer to also keep something + - Announcing and publishing are easier if the task states are updated +- Mumble for walkie-talkie communications? + - Can we keep it off the stream more reliably, but still be able to choose to put it on the stream? + - We can keep it in the combined sink and then manually go to that + channel in our clients when we want to talk on stream + - Should we have a Gen channel and a Dev channel so that we can choose to speak into ? +- Checklist + - Etherpad + - All the volunteers can access it easily + - Tasks can be updated through SSH commands + - conf.org + - Run Emacs commands directly from it + - A little trickier in terms of access -### BLOCKED Hold Q&A session with volunteers + - +## How do we want to make the full schedule more manageable? -## DONE Investigate streaming options, maybe OBS in the cloud :sachac: +Host role: -Current status: +- Give the speaker a heads-up before their Q&A session begins +- If needed, read the questions from the pad to the speaker (Many speakers are comfortable reading the pad on their own.) +- Give the speaker time warnings before the end of their Q&A session on the stream. Interested participants can continue -- res.emacsconf.org seems to be able to handle 2x (OBS + TigerVNC + MPV, should test with Firefox as well) -- corwin and jman will stream gen from OBS on res -- bandali will stream dev from his laptop -- let sachac know if you want manual control or more autopilot for the gen stream +Streamer role: -Goals: +- Switch between playing the prerec and joining the Q&A session +- Adjust audio volume at the beginning of the Q&A session +- (optional) Switch scene layouts to focus on different things -- [X] Be able to start a VNC server with OBS, MPV, and Firefox, connect to it, and stream -- [X] Have another session with the sound isolated -- [-] Split the audio so that we can join the Q&A room before the MPV ends - handled by automatic scene switcher detecting mpv, but we can’t share just a window, so we might as well just wait -- [X] Control MPV from the commandline: track-mpv appears in the correct display, and it can also be controlled via the socket like this: echo ’{ “command”: [“loadfile”, “test2.webm”] }’ | socat - ~/mpv-socket-emacsconf-dev -- [ ] Share the window instead of the desktop? +Shifts will be Sat AM, Sat PM, Sun AM, or Sun PM per track. People can take multiple shifts. -Prerequisites: + -- You need to be able to SSH out to res.emacsconf.org on port 46668 - and forward ports, so one of the main organizers needs to add your - SSH public key to the authorized\_keys file. Please e-mail your SSH - public key to sacha@sachachua.com and test that port 46668 is not - blocked. -- For streaming from OBS in VNC, you will need a VNC viewer like - tigervnc-viewer. -- For streaming from your local computer, you will need OBS and FFmpeg. +- Figure out how hosting can be done in shifts + - Add notes in one place +- Figure out how streaming can be done in shifts: OBS in the cloud? + - [Investigate streaming options, maybe OBS in the cloud](#streaming) +- Figure out how publishing can be done in shifts + - Console Emacs in a VM with everything set up for publishing to the wiki -During the conference, you will: +[2022-10-04 Tue] -- play the talk video (unless it’s automatically managed by the agenda) and update the overlays -- display intro/intermission information as needed -- open the Q&A windows, like the pad and the BBB room/IRC (unless it’s automatically managed by the agenda) -- adjust the volume if needed -- arrange windows and focus the BBB room on the speaker’s webcam if needed -- if you like, you can be responsible for managing the track from conf.org on orga@res.emacsconf.org +- Added option H: general starts with general Org use cases and moves on to more niche things on day 2. + - compared to A, general audience will be more interested in Org use + cases than in Hyperbole, and then we can look at specific + techniques on day 2 -Dry run checklist: +[2022-10-04 Tue] -- [ ] Connect to the server - ssh orga@res.emacsconf.org -p 46668 - emacsconf # runs emacsclient -c -a emacs -- [ ] Forward ports and connect via VNC -- [ ] Find the OBS or start it if it is not running -- [ ] Start recording -- [ ] Play a video -- [ ] Open two Firefox windows and arrange them -- [ ] Manage windows on the workspace -- [ ] Adjust the volume in OBS -- [ ] SSH to the server and play a video off-screen -- [ ] SSH to the server with X forwarding and adjust the volume off-screen +- Discussed option G with zaeph on #emacsconf-org. zaeph prefers + option A over option G because it gives people more choices - + they can hop from talk to talk. +[2022-10-03 Mon] -### Broadcasting from local OBS (option A) +- Discussed with bandali and zaeph on #emacsconf-org +- Decided on Option A with B, C, or F as fallbacks depending on volunteer roster +- Better for the viewers and the volunteers -- You can copy the profile from your track or look inside it for the icecast mount point details: - - Gen: rsync -avze ’ssh -p 46668’ emacsconf-gen@res.emacsconf.org:~/.config/obs-studio/basic/profiles/ ~/.config/obs-studio/basic/profiles/ - - Dev: rsync -avze ’ssh -p 46668’ emacsconf-dev@res.emacsconf.org:~/.config/obs-studio/basic/profiles/ ~/.config/obs-studio/basic/profiles/ -- Sacha will turn off the OBS recordings on res so that you can test streaming from your computer - - If you’re doing this independently, you can jump ahead to “Connecting to VNC” in order to stop the recording yourself + -- Verify with MPV: - - mpv https://live0.emacsconf.org/emacsconf/gen.webm - mpv https://live0.emacsconf.org/emacsconf/dev.webm +## How much do we want to enrich the wiki with JS? -- With luck, the 480p streams will be up automatically as well - - mpv https://live0.emacsconf.org/emacsconf/gen-480p.webm - mpv https://live0.emacsconf.org/emacsconf/dev-480p.webm +Ideas to consider: +- Toggling local time display on the schedule +- Making organizers-notebook nicer to browse through (or maybe use organice?) +- Improve the video player (resolution switching? chapter markers?) - for video? -### Connecting to VNC (option B) -1. Stop broadcasting locally if you were testing local OBS. +### SOMEDAY ?: Figure out JS and CSS niceties that will make organizers-notebook more enjoyable to browse through :css:js: -2. Install a VNC viewer on your system (ex: tigervnc-viewer). +- TODO/DONE/etc. keyword highlighting? +- Collapsible sections? -3. Set up your local environment: - - gen: export TRACK=gen; export TRACK\_PORT=5905; export SSH\_PORT=46668 - - dev: export TRACK=dev; export TRACK\_PORT=5906; export SSH\_PORT=46668 -4. Copy the password: - - scp emacsconf-$TRACK@res.emacsconf.org:~/.vnc/passwd vnc-passwd-$TRACK -p $SSH\_PORT +### SOMEDAY ?: Find a way to add JS libraries to the wiki but shield them from anon editing :js: -5. Forward your local ports and connect via VNC viewer to the - appropriate forwarded port from your laptop: - - ssh emacsconf-$TRACK@res.emacsconf.org -N -L $TRACK_PORT:127.0.0.1:$TRACK_PORT -p $SSH_PORT & - sleep 5 # Give it time to establish the tunnels - xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & - - (If this doesn’t find a VNC server to connect to, you can start it with `ssh emacsconf-$TRACK@res.emacsconf.org -p $SSH_PORT /home/emacsconf-$TRACK/bin/track-vnc`) +gitolite should have some options to do this -6. Start **recording** (not streaming). If you don’t see OBS when you connect, it’s probably on workspace 2, so you can switch with Alt-2. If you still don’t see it there, you can open a terminal with Alt-Enter and then run `track-obs`. After you start recording, confirm that it is now broadcasting to the stream. -7. Verify with MPV on your local system: - - mpv https://live0.emacsconf.org/emacsconf/$TRACK.webm & +### SOMEDAY ?: Beautify video players :js:css: -8. With luck, the 480p streams will be up automatically as well. On your local system: - - mpv https://live0.emacsconf.org/emacsconf/$TRACK-480p.webm & +Might not be necessary. -9. Play a video. It should display the video and update the overlays. If you need to update the overlays manually, you can copy files from `/data/emacsconf/overlays` onto `$HOME/other.png` and `$HOME/video.png`. - - You can play a video with `play video-id` (ex: `play meetups`), or you can specify the filename (ex: ~play ~/stream/emacsconf-2022-meetups\*.webm). - - termit: Ctrl-Shift-t makes a new tab - - i3 cheat sheet: - - - Alt-Enter creates a terminal - - Alt-d runs a command - - Alt-e toggles horizontal/vertical split - - Alt-f toggles full-screen - - Alt-w switches to tabbed view - - Alt-1 switches to workspace 1, Alt-2 switches to workspace 2 - - Alt-Shift-2 moves things to workspace 2 - - Alt-Shift-Left moves the current window to the left - - Alt-Shift-Right moves the current window to the right -10. Test Q&A. You can either wait for the video to finish or quit it with “q”. - You can paste in the URLs or use - `firefox /data/emacsconf/2022/index-$TRACK.html` + -11. Test adjusting the audio - - `ssh emacsconf-$TRACK@res.emacsconf.org -p 46668` - - Then use `qa-louder`, `qa-quieter`, or `qa-vol vol%` (ex: `qa-vol 90%`) +## How do we want to make better use of Etherpad? -Other notes and tips: +Pain points: -- You can use Emacs for emergency or ad-hoc announcements. -- Use OBS or `pavucontrol` to adjust the volume of BBB as needed. You might be able to manage `pavucontrol` off-screen with `ssh emacsconf-$TRACK@res.emacsconf.org -X -p $SSH_PORT pavucontrol`. -- You can also `ssh emacsconf-$TRACK@res.emasconf.org -p 46668` and start new processes from the command-line, such as using `track-mpv`. If you specify commands when you call SSH instead of using an interactive shell, you may need to also specify DISPLAY=:5 (for the gen track) or DISPLAY=:6 (for the dev track), since ssh won’t pick up the variables from `.bashrc`. -- If you have a Wayland-only desktop without any X11 compatibility layer (example: [Sway](https://swaywm.org) with `xwayland disable`) the suggested software (`tigervnc`) might no work. You can use instead for example `gnome-remote-desktop`. The password for the VNC connection can be retrieved from the file `vnc-passwd-$TRACK` (3DES encrypted). +- Lots of scrolling for speakers +- Takes some effort to move questions from IRC to the pad -### Managing the stream from the agenda (option B2) +### How many pads do we want? -ssh orga@res.emacsconf.org -p $SSH\_PORT -emacsconf # runs emacsclient -c -a emacs +- One pad for everything + - Scroll down, down, down + - Easy to set up at the beginning + - Inertia +- One pad per set of talks (Saturday AM, Saturday PM, Sunday AM, Sunday PM) + - Less scrolling +- One pad per talk, plus one meta pad + - Very little scrolling + - Can send people directly to the pad -You can then use -- emacsconf-stream-play-video -- emacsconf-stream-open-qa-windows-on-change -- emacsconf-agenda-by-track -- emacsconf-agenda +### Do we want to host our own? -If things are going well, you can use C-c C-t on the agenda view to change a talk to PLAYING, CLOSED\_Q, or OPEN\_Q, and various things should happen in the background. If they don’t happen in the background, use emacsconf-add-org-after-todo-state-change-hook to add the todo state change hook, then try again. +- Use etherpad.wikimedia.org + - Worked fine last year +- Host our own + - Might be able to use API to append questions to it, if we want to get super fancy -Task state shortcuts for C-c C-t: -- **m (mpv):** PLAYING - -stream-play-video, emacsconf-stream-set-talk-info, publish the files to the media directory -- **q (Q&A):** CLOSED\_Q -- **o (open):** update the BBB redirect URLs to let people into the room -- u (unstreamed) -- r (to archive) +### Do we want to embed the pad as an iframe on the watch page? on talk pages? -You can leave the emacsclient with `C-x 5 0` +This guides people to use the pad for discussion/questions instead of IRC +Options: -#### Do Q&A +- Current: None, just a link +- Big pad on the watch page: +- Individual pads: + - Watch page needs to be updated with current pad and link to previous pad + - Individual talk page can embed the iframe +- Embed the IRC channel instead -From the emacsclient on orga@res.emacsconf.org, you can open various talk-related things: -- emacsconf-stream-open-pad -- emacsconf-stream-join-qa -- emacsconf-stream-join-chat + -Alternatively, you can switch to the VNC viewer and use the links in - or - . +## Can we nudge people to ask IRC questions in a way that will make it easier for us to follow them? -For Q&A, you may want to have the Etherpad on the left, the BBB Q&A or -IRC chat on the right, and the terminal and OBS windows on -workspace 2. +Two tracks mean two IRC channels with lots of space for Q&A, so this may become less of an issue +Pain points: -### Other tasks as needed +- Q&A/discussions often overlap with the next talks +- Sometimes questions don’t get copied to the pad +- Fast discussions can get overwhelming +Ideas: -#### Display emergency news / announcements +- Announce pad link at the beginning of the talk and at the start of + live Q&A, encourage most people to ask questions there +- Encourage people to start questions with Q: + - A little extra work, but not as much as including the slug + - Easier to pick out when people search + - Volunteers can restate questions easily if people forget the Q: +- Encourage people to start questions with Q-slug: (ex: Q-news: question about Emacs News Highlights, Q-journalism: …) + - Easier to pick out questions even with overlapping Q&A/talks +- Use two or three IRC channels so that talks can rotate among channels + - Easier to pick out questions even with overlapping Q&A/talks + - Needs logging and more organizer attention +- Maybe a volunteer can have an ERC command that copies a question into a buffer, or even into the Etherpad -M-x emacsconf-stream-broadcast to send a message to both streams -or M-x emacsconf-stream-set-news to send a message to one stream. -If that doesn’t work, edit the news file directly with: -`ssh emacsconf-$TRACK@res.emacsconf.org > ~/news.txt` + -If that doesn’t work, use the VNC session to switch to an Emacs window -and type your message in. +## Do we want people to advertise any openings with their companies or any work that they’re looking for? +- Speakers on their page? +- General audience on a wiki page somewhere? -#### Kill the VNC server: -ssh emacsconf-$TRACK@res.emacsconf.org “vncserver -kill” + - +## Decision archive --+### Where should volunteers e-mail? -- - - - - - +- **Default to emacsconf-org and offer emacsconf-org-private as an option** +- emacsconf-org-private + - less public, e.g. if for whatever reason we might have to decline an offer of help + - Also, some people want to volunteer but do not want to be in the public’s eye. +- emacsconf-org + - If you’re thinking about the enticement factor of having people + volunteer publicly, we’ll still have a well-furnished list of people + helping us run the conf somewhere on the wiki. [11:22] + - i would think if someone doesn’t want to do it publicly, they could + opt to write to -org-private instead, but otherwise the defacto + should be public (-org) + - i just think most folks would want to do this publicly unless for + specific reasons, rather than the other way around - - - - - -
~/bin/track-obsstart OBS with the track’s profile and scene collection
~/bin/track-mpv file.webmplay the file using the track’s sink
+### CANCELLED Do we want to do alt-stream the same way again this year? +Superseded by decision to have multiple tracks -#### Making OBS scenes +- Alt stream joins the current session and then continues with it until the Q&A finishes; people join the BBB room if they want to ask questions + - Nice and convivial, Q&A still gets captured + - Inertia means most people get the main message +- Multiple streams with more space between talks, people choose which stream they want to watch + - How other conferences do it + - Speakers can attend related talks more easily -Making OBS scenes is pretty straightforward as you can move the -different blocks on your scene in the preview window. However, it’s -important to make sure that your video-captures and your overlays are -snapping properly to the edges of the view-port. To do this, make sure -to right-click on the block inside the preview window, and try the -different fitting options (fit by width, height, etc.) until you find -one that works best. -We’ll probably be streaming at 720p, but since we’re also considering -a 1080p update, try to create your overlays in a format or a resolution -that would support resizing. +### DONE Shall we put a generic e-mail address for sending feedback, maybe with different mailtos? +Pain points: -### Other notes +- Many talk pages don’t have public e-mail addresses, so it takes a + little extra work (or is sometimes impossible) for people to follow + up if they have questions -There are sockets in the home directory for MPV control if you want to keep that process. -echo ’{ “command”: [“loadfile”, “test2.webm”] }’ | socat - ~/mpv-socket-emacsconf-dev +Options: +- Do nothing (current) +- Add a mailto link to emacsconf-discuss that prepopulates the subject +- Add a mailto link to emacsconf-org + - Wider discussion +- **Add a mailto to emacsconf-org-private** + - Private feedback that can be forwarded to the speaker -### TODO Test and document command-line way of managing audio :sachac: +### DONE How many BBB rooms do we want to set up? -### DONE Move my conf.org setup to res so that we can control everything from there +- One per talk + - We can send speakers a direct link to their room and they can check into it themselves + - Needs a little more work when setting up rooms and when extracting videos + - Easier for the host to join + - Check-in person can just keep an ear open in that room +- Five or so, rotating among them + - Check-in person directs the speaker to the next available room + - Worked fine last time -### DONE Set timers for changing todo state +### DONE How easy do we want to make it to join the BBB session? - (defun emacsconf-schedule-test-buffer (info) - (mapcar (lambda (o) (plist-put o :buffer "1") o) info)) - (let ((emacsconf-schedule-strategies '(emacsconf-schedule-test-buffer))) - (emacsconf-stream-schedule-timers (emacsconf-schedule-prepare - (emacsconf-schedule-inflate-sexp - `(("Test gen" :start ,(format-time-string "%Y-%m-%d %H:%M" - (time-add (current-time) (seconds-to-time 60)))) - (journalism :time "1") - (school :time "2") - (handwritten :time "1") - ("Test dev" :start ,(format-time-string "%Y-%m-%d %H:%M" - (time-add (current-time) (seconds-to-time 60)))) - (treesitter :time "2") - (lspbridge :time "1") - (asmblox :time "1")))))) +Considerations: -the dev one worked, but the gen one gets -Couldn’t find local shell prompt for /bin/sh -Tramp: Opening connection **Async Shell Command** for emacsconf-gen@res.emacsconf.org using ssh…failed +- It’s easier for the checkin person to deal with only the speaker +- We may not want people to join the Q&A session at the beginning +- We want to make it easy for people to join the Q&A session eventually -Maybe I need to stagger them, or maybe I need to use a shell command. -Changed to call ssh directly instead of using tramp. +Options: +- PROBABLY EASIEST: Set it to anyone can join, but the meeting needs to be started by a + moderator. Start the meeting on the day of the talk. Announce the + BBB URL in the pad, IRC channel, and on the talk page when the host + is ready. Maybe add a rewrite rule when the host is ready. +- Set an access code. Announce the access code when the host is ready. + - Access codes are annoying to copy and paste. + - Access codes might get accidentally unset or regenerated. +- Set room so that moderators have to approve waiting users. + - Check-in has to watch out for waiting speaker. + - Host sets it to accept everyone who’s waiting when the host is ready. + - Changing it to turn the option off doesn’t seem to affect an + ongoing meeting, even though the web interface says you should be + able to change the setting any time. + - Waiting users don’t make the user notification go ding. -### DONE Figure out how to work with the layout +Change talk status to OPEN\_Q or UNSTREAMED\_Q, and change to TO\_ARCHIVE when done. +M-x emacsconf-publish-bbb-redirect to update the redirect for a single talk +M-x emacsconf-publish-bbb-redirect-all updates all the redirects - +#### DONE Add nginx redirect from emacsconf.org -### DONE Allow per-track configuration of todo hooks :sachac: +/ssh:front|sudo::/etc/nginx/sites-available/emacsconf.org -emacsconf-todo-hooks +### DONE How do we want to name the BBB rooms? -### CANCELLED Use xdotool to automate joining BBB in Firefox (signing in, clicking on listen only) +Needs to be easy to: +- share all the BBB rooms for a particular shift with the check-in volunteer +- start the BBB rooms for the morning +- match up the recordings with the talks afterwards +- find the BBB room for a talk or speaker +- remove all the BBB rooms for the year -### CANCELLED Experiment with sharing part of the screen so that there’s space for us to work a little off-screen +ec22-sat-am-dev Speaker Name (slugs) -We might just have to rely on xdotool to move windows the way we want them -Window fixes that didn’t work -- -- +### SOMEDAY Do we want to make the ikiwiki web-editable? +Pain points: -### DONE Set up scenes and try them +- Speakers usually ended up going through us +Options: -### DONE Set up text source for URL +- Web-editable: + - Speakers and general public will be able to edit it more easily +- Git: (current) + - Haven’t had a problem with spam + - Reduces merge conflict potential -### DONE Create Ansible tasks for setting up sinks for MPV and Firefox for the streams, and adding the scenes appropriately +### DONE What ideas do we want to borrow from other conferences? +- FOSDEM had a conference track + - +- DebConf + - Thorough documentation at + - + - Ansible: , + - SReview for cutting videos? + - + - Pentabarf + - Schedule shows local time and DebConf time: +- LibrePlanet + + - libreadventure, minetest? + + - : 4-person team, post-prod, break commercials -### DONE See if I can even Ansible-up the rest of the tasks -like starting up Firefox and mpv and everything + +## SOMEDAY Think about what to do with schedule gaps due to cancelled talks :thoughts: -### TODO obs-websocket control of OBS on the server +- just leave it on the in-between slide: no extra effort required +- host breakout rooms -so that the streamer can adjust volume offscreen? +### SOMEDAY Consider fillers covering conference stuff :thoughts: -### TODO document such that someone else could use/fix it + -### Other notes +# Roles needed -- bandali doesn’t have much cognitive bandwidth at the moment, so we can keep things simple with OBS on laptops +Each role comprises different responsibilities. A person may have multiple roles. An organizer might take the lead for a role, but if you want to volunteer, speak up and they’ll probably be glad to share the load. -- Issue: zaeph was dropping frames and couldn’t pay attention to as many things as he wanted -- Issue: corwin needs assistance to not be locked in his chair for the whole conf. Premptively, zaeph can do it by broadcasting OBS scenes via the rtmp (instead of just his webcam). -- With a long day, we may want to be able to schedule hosts/streamers/publishers in shifts -- Ideal: Easy reproducible setup to spin up an OBS VM with scenes set up, allowing multiple users to connect to it at the same time. Maybe x2go or vnc? VMs with 8 vCPUs and a vGPU cost more, so it would be good to figure out what’s needed, spin it down, and then spin it up maybe the day before or something like that. -- Plus points if we can control the OBS via password-protected websocket so we can tell it to switch scenes (and even more points if we do so from Emacs, maybe via that obs-websocket.el ;) ). MPV is also controllable via IPC, so we can use the same MPV player and then switch videos around. Maybe mpvc? -- Probably Linode’s Dedicated 32 GB + RTX6000 GPU x1 at $1.50 an hour for 2-3 days + dev time, since live.emacsconf.org is in Linode as well -- We should also look into normalization across the board, especially if we have BBB participants. pipewire + easyeffects on the box might be the easiest way to do it. +Some roles are also described on the page. If you want to encourage people to volunteer to help, add a role description there. -- -- Live Streaming using low configuration vps -- -- -- [OBS Studio 26.0 | Hacker News](https://news.ycombinator.com/item?id=24633139) -- -- -- -- -- +## During the proposal stage -### TODO recruit at least one more person to help operate the “video bouncer” +The roles below are related to the proposals in the early stages of the preparation. +- Scheduler (SCHED: sachac) + - Process talks as they come and find the best place for them in the timeline + - Keep track of availability and thematic constraints and find solutions that accommodate most +- Reviewer + - Review the proposals sent to emacsconf-submit before the speaker-notification deadline + - Raise flags if there are problems with a proposal (e.g. too much content for the short format) +- Listener + - Receive emails from emacsconf-submit + - Ensure that candidates are sticking to the prescribed format (esp. the 10/20/40 duration rule) + - Respond to people’s requests and suggestions, pulling in other people to help as needed +- Publisher (PUB: sachac) + - Set up the wiki page +- Infrastructure + - Figure out streaming options + - Set up file upload system that speakers will use + - Plan other systems that people will use - -## TODO Use Mumble for backchannel coordination and also on-stage +## When speakers have submitted their pre-recorded videos +- Copy to backstage as –original.webm and –main.webm using M-x emacsconf-upload-copy-from-json +- Copy to res /data/emacsconf/2022 +- Start /data/emacsconf/2022/process-captions.py if it’s not already running +- Use ~zaeph/scripts/reencode.sh on the file as well -### TODO E-mail volunteers and help them get on Mumble :bandali: +- Video processor (zaeph) + - Standardize and compress uploaded videos +- Caption lead (sachac) + - Prepare videos and starting captions for captioning volunteers +- Captioner + - Edit automatically-generated captions to correct misrecognized words + - Nice to have: Break up the captions in better places so that subtitles are neither too long nor too short + - Perk: Get access to prerecorded videos +- Quality checker + - Doublecheck videos for potential encoding issues or compression artifacts that get in the way of viewing + - Doublecheck captions +- Tech checker + - Help speakers check that their system works well with BBB for live Q&A -- [ ] FlowyCoder -- [ ] jman -- [ ] vetrivln +## During the conference -### TODO Update the Mumble setup :bandali: +- Streamer (STREAM) + - Download prerecorded videos + - Send the combined stream to Icecast for broadcasting +- Director (DIR: corwin) - possibly same as streamer + - Switch scenes, manage audio volumes as needed + - Provide timekeeping information to host (especially go-live countdowns) +- Host (HOST: zaeph) + - Introduce talks and speakers + - Read questions + - Give time warnings + - Thank speakers and transition to next talk +- Timekeeper - possibly same as host + - Manage time based on all available information (prerecs durations, speakers not showing up, etc.) +- Check in (CHECK) + - Notice speakers checking into IRC + - Get them into the correct room and help them doublecheck their audio and video quality + - Troubleshoot as needed + - Notify host about next room to join + - Follow up with speakers who haven’t checked in yet + - Check on speakers periodically so that they’re not waiting alone +- Questions + - Copy questions from IRC and the pad to wherever the host and speaker are looking +- Pad scribe + - Organize and format people’s contributions + - Add notes about links, key points, questions, answers +- Accessibility (ACCESS: dto) + - Describe visuals in #emacsconf-accessible + - Nice to have: echo the captions into #emacsconf-accessible +- Quality checker + - Doublecheck stream quality and audio volume +- Publisher (PUB: sachac) + - Announce talks in the IRC channels + - Nice to have: Update the wiki page with resources (video) + - Nice to have: Set resources to public as each talk is played (Toobnix, YouTube) + - Nice to have: Update the schedule to reflect changes throughout the day -- [ ] Add emacsconf-gen and emacsconf-dev channels -- [ ] Give the emacsconf-gen and emacsconf-dev users access to them -- [ ] Give the other organizers access to emacsconf-gen, emacsconf-dev, and org-private + -### DONE Generate certificates, add them to conf.org, and register the users :sachac: +### Shifts + - +AM: 9-12 PM EST, PM: 1-5 PM EST (plus a little extra for setup/transition) -## Volunteer update +Saturday Dec 3 -- talk banners, akshay + - ++-## DONE Make a linear hyperlist for managing EmacsConf :sachac: +-Goal: +-- Volunteers should be able to coordinate everything by stepping through a linear list of things to do -- The hyperlist will primarily live on orga@res.emacsconf.org and be accessed through emacsclient. (Maybe sat.org and sun.org) -- Volunteers should be able to take breaks as needed +-- 9:05 Journalism - - [ ] Check ${name} into BBB room - - [X] [Start talk]((emacsconf-update-talk-status "journalism" "." "PLAYING")) - - [X] [Start closed Q&A]((emacsconf-update-talk-status "journalism" "." "CLOSED_Q")) - - [ ] [Open Q&A]((emacsconf-update-talk-status "journalism" "." "OPEN_Q")) - - [ ] [Mark Q&A as unstreamed]((emacsconf-update-talk-status "journalism" "." "UNSTREAMED_Q")) - - [ ] [Finish talk]((emacsconf-update-talk-status "journalism" "." "TO_ARCHIVE")) -- 9:40 Handwritten - - [ ] [Start talk]((emacsconf-update-talk-status "handwritten" "." "PLAYING")) - - [ ] [Start closed Q&A]((emacsconf-update-talk-status "handwritten" "." "CLOSED_Q")) - - [ ] [Open Q&A]((emacsconf-update-talk-status "handwritten" "." "OPEN_Q")) - - [ ] [Mark Q&A as unstreamed]((emacsconf-update-talk-status "handwritten" "." "UNSTREAMED_Q")) - - [ ] [Finish talk]((emacsconf-update-talk-status "handwritten" "." "TO_ARCHIVE")) +-See sat.org and sun.org in the conf private repo ++ + + + + + + + + + + -Try them in an Etherpad - - - - + + + + + + + + + -[How do we want to coordinate during the conference itself?](#coordination) + + + + + + + + -### DONE Try writing it to an Etherpad + + + + + + + + - -# Projects to bear in mind but which are not actual + + + + + + + + + +
 HostStreamerCheckinIRCPad
Gen AMzaephcorwinsachacsachacpublicvoit
Gen PMzaephcorwinFlowyCoderdtopublicvoit
Dev AMbandalibandalisachacdto 
Dev PMvetrivlnbandaliFlowyCodervetrivln 
+publicvoit - pad until 4pm on Sat, until 2pm on Sun -## STANDBY Find a way to accommodate a specific return-speaker +Sunday Dec 4 -We’re not sure if we’re going to get a presentation or a prerec for them -this year, but we need to keep this at the back of our minds. + -Note on how DebConf handled incidents: - ++- +-# Things to figure out / decisions to make +-- [How do we want to coordinate during the conference itself?](#coordination) -- [How do we want to make the full schedule more manageable?](#sched-decision) -- [How much do we want to enrich the wiki with JS?](#wiki-design) -- [What ideas do we want to borrow from other conferences?](#other-confs) -- [Do we want to make the ikiwiki web-editable?](#cgi) -- [How do we want to make better use of Etherpad?](#pad-decision) -- [Can we nudge people to ask IRC questions in a way that will make it easier for us to follow them?](#irc-markers) -- [How many BBB rooms do we want to set up?](#bbb-rooms) -- [How easy do we want to make it to join the BBB session?](#bbb-join) -- [How do we want to name the BBB rooms?](#bbb-name) -- [Do we want people to advertise any openings with their companies or any work that they’re looking for?](#advertising) -- [Decision archive](#decision-archive) ++- ++ + + + + + + + + + + -## How do we want to coordinate during the conference itself? + + + + + + + + + -- Considerations: - - Good to have something that the hosts and streamers can walk through step by step - - Do we want the check-in volunteer to also keep something - - Announcing and publishing are easier if the task states are updated -- Mumble for walkie-talkie communications? - - Can we keep it off the stream more reliably, but still be able to choose to put it on the stream? - - We can keep it in the combined sink and then manually go to that - channel in our clients when we want to talk on stream - - Should we have a Gen channel and a Dev channel so that we can choose to speak into ? -- Checklist - - Etherpad - - All the volunteers can access it easily - - Tasks can be updated through SSH commands - - conf.org - - Run Emacs commands directly from it - - A little trickier in terms of access + + + + + + + + - + + + + + + + + -## How do we want to make the full schedule more manageable? -Host role: + + + + + + + + + +
 HostStreamerCheckinIRCPad
Gen AMzaephcorwinsachacsachacpublicvoit
Gen PMzaephjmanFlowyCoderdtopublicvoit
Dev AMbandalibandalisachacdto 
Dev PMvetrivlnbandaliFlowyCodervetrivln 
-- Give the speaker a heads-up before their Q&A session begins -- If needed, read the questions from the pad to the speaker (Many speakers are comfortable reading the pad on their own.) -- Give the speaker time warnings before the end of their Q&A session on the stream. Interested participants can continue +Backups: -Streamer role: +- dev host/streamer: bandali, sachac +- gen host/streamer: zaeph, sachac +- checkin, IRC, pad: sachac -- Switch between playing the prerec and joining the Q&A session -- Adjust audio volume at the beginning of the Q&A session -- (optional) Switch scene layouts to focus on different things +Interested in a shift? Please e-mail and we’ll help you figure out what you need to learn. -Shifts will be Sat AM, Sat PM, Sun AM, or Sun PM per track. People can take multiple shifts. + `(setq emacsconf-shifts + (list + ,@(apply #'append + (mapcar + (lambda (day) + (let ((headers (mapcar (lambda (field) (intern (concat ":" (downcase field)))) + (cdr (car (cadr day)))))) + (mapcar + (lambda (row) + (apply #'append + (list 'list :id + (when (string-match "^\\([^ ]+\\) \\(AM\\|PM\\)" (car row)) + (format "%s-%s-%s" + (car day) + (downcase (match-string 2 (car row))) + (downcase (match-string 1 (car row))))) + :track + (if (string-match "^Gen" (car row)) "General" "Development") + :start + (format "%sT%s:00:00%s" + (elt day 2) + (if (string-match "AM" (car row)) "08" "13") + emacsconf-timezone-offset) + :end + (format "%sT%s:00:00%s" + (elt day 2) + (if (string-match "AM" (car row)) "12" "18") + emacsconf-timezone-offset)) + (seq-map-indexed + (lambda (value index) + (unless (string= value "") + (list (elt headers index) value))) + (cdr row)))) + (cdr (cadr day))) + )) + (list + (list "sat" sat "2022-12-03") + (list "sun" sun "2022-12-04")))))) - -- Figure out how hosting can be done in shifts - - Add notes in one place -- Figure out how streaming can be done in shifts: OBS in the cloud? - - [Investigate streaming options, maybe OBS in the cloud](#streaming) -- Figure out how publishing can be done in shifts - - Console Emacs in a VM with everything set up for publishing to the wiki +## After the conference -[2022-10-04 Tue] +- Video processor + - Extract live segments into videos +- Captioner + - Add more captions + - Summarize Q&A +- Publisher + - Post more information -- Added option H: general starts with general Org use cases and moves on to more niche things on day 2. - - compared to A, general audience will be more interested in Org use - cases than in Hyperbole, and then we can look at specific - techniques on day 2 -[2022-10-04 Tue] + -- Discussed option G with zaeph on #emacsconf-org. zaeph prefers - option A over option G because it gives people more choices - - they can hop from talk to talk. +# Infrastructure notes -[2022-10-03 Mon] -- Discussed with bandali and zaeph on #emacsconf-org -- Decided on Option A with B, C, or F as fallbacks depending on volunteer roster -- Better for the viewers and the volunteers +## Uh… how should ikiwiki be set up? +- remove the ikiwiki\_src clone from the ansible config - + +bare repo has a post-update hook that updates the src repo +src repo is ~ikiwiki/emacsconf +~git/repositories/pub/emacsconf-wiki.git/hooks/post-update runs ~git/repositories/pub/emacsconf-wiki.git/hooks/post-update.h00-ikiwiki-wrapper +there is an anon mirror that’s updated with sudo -u anon /home/anon/fetch-wiki +the git wrapper is +/home/ikiwiki/hooks/emacsconf -## How much do we want to enrich the wiki with JS? +~anon/emacsconf-wiki.git has origin git@git.emacsconf.org:pub/emacsconf-wiki (fetch) +but git log does not have the new stuff +Where is the new stuff? +… hah, maybe I forgot to push -Ideas to consider: -- Toggling local time display on the schedule -- Making organizers-notebook nicer to browse through (or maybe use organice?) -- Improve the video player (resolution switching? chapter markers?) - for video? +## Backstage -### BLOCKED ?: Figure out JS and CSS niceties that will make organizers-notebook more enjoyable to browse through :css:js: +### File suffixes, and what they correspond to -- TODO/DONE/etc. keyword highlighting? -- Collapsible sections? +Per categories, earlier suffixes come earlier in the process. + -### BLOCKED ?: Find a way to add JS libraries to the wiki but shield them from anon editing :js: -gitolite should have some options to do this ++++ + + + + + + -### BLOCKED ?: Beautify video players :js:css: + + + + + -Might not be necessary. + + + + - - -## What ideas do we want to borrow from other conferences? - -- FOSDEM had a conference track - - -- DebConf - - Thorough documentation at - - - - Ansible: , - - SReview for cutting videos? - - - - Pentabarf - - Schedule shows local time and DebConf time: -- LibrePlanet - - - libreadventure, minetest? - - - : 4-person team, post-prod, break commercials - - - - -## Do we want to make the ikiwiki web-editable? - -Pain points: - -- Speakers usually ended up going through us - -Options: - -- Web-editable: - - Speakers and general public will be able to edit it more easily -- Git: (current) - - Haven’t had a problem with spam - - Reduces merge conflict potential + + + + - -## How do we want to make better use of Etherpad? + + + + + -Pain points: + + + + + -- Lots of scrolling for speakers -- Takes some effort to move questions from IRC to the pad + + + + -### How many pads do we want? -- One pad for everything - - Scroll down, down, down - - Easy to set up at the beginning - - Inertia -- One pad per set of talks (Saturday AM, Saturday PM, Sunday AM, Sunday PM) - - Less scrolling -- One pad per talk, plus one meta pad - - Very little scrolling - - Can send people directly to the pad + + + + + + + + + + -### Do we want to host our own? -- Use etherpad.wikimedia.org - - Worked fine last year -- Host our own - - Might be able to use API to append questions to it, if we want to get super fancy + + + + -### Do we want to embed the pad as an iframe on the watch page? on talk pages? + + + + + +
SuffixDescription
VIDEO 
–original.EXTFile as submitted by speaker
–reencoded.webmReencode via ffmpeg incantation
–final.webmBroadcast-ready reencode with normalized audio
AUDIO 
–original.EXTExtracted audio track from speaker upload; used for speech-recognition
–normalized.opusNormalized audio track
SUBTITLES 
–?(incomplete-)transcriptTranscript provided by speaker
–main.EXTBroadcast-ready reencode; different formats for different uses
-This guides people to use the pad for discussion/questions instead of IRC -Options: + -- Current: None, just a link -- Big pad on the watch page: -- Individual pads: - - Watch page needs to be updated with current pad and link to previous pad - - Individual talk page can embed the iframe -- Embed the IRC channel instead +# Other tasks and processes +- [Giving conf.org access to a new volunteer or fake user](#private-access) +- [As prerecorded talks come in](#prerec-process) +- [When a talk is captioned](#when-captioned) +- [Other tasks before the conference](#before) +- [During the conference](#during-conference) +- [After the conference](#after-conference) +- [In case of](#exceptions) - -## Can we nudge people to ask IRC questions in a way that will make it easier for us to follow them? + -Two tracks mean two IRC channels with lots of space for Q&A, so this may become less of an issue +## Giving conf.org access to a new volunteer or fake user -Pain points: +This can only be done by the admins of the gitolite instance (zaeph, +or bandali as a backup). This is because the changes need to be made +in the gitolite-admin repo that can only be accessed by admins. In a +pinch, people with access to the \`orga\` user on front0 can manually +add themselves to the list of admins and manually rebuild the +instance. -- Q&A/discussions often overlap with the next talks -- Sometimes questions don’t get copied to the pad -- Fast discussions can get overwhelming +Regular process: -Ideas: +- Get public key from volunteer, +- Add key under `./key/dir/`, +- Update permissions on `./conf/gitolite.conf`, +- Push to origin. -- Announce pad link at the beginning of the talk and at the start of - live Q&A, encourage most people to ask questions there -- Encourage people to start questions with Q: - - A little extra work, but not as much as including the slug - - Easier to pick out when people search - - Volunteers can restate questions easily if people forget the Q: -- Encourage people to start questions with Q-slug: (ex: Q-news: question about Emacs News Highlights, Q-journalism: …) - - Easier to pick out questions even with overlapping Q&A/talks -- Use two or three IRC channels so that talks can rotate among channels - - Easier to pick out questions even with overlapping Q&A/talks - - Needs logging and more organizer attention -- Maybe a volunteer can have an ERC command that copies a question into a buffer, or even into the Etherpad + - +## As prerecorded talks come in -## How many BBB rooms do we want to set up? +- Sacha: Parcel out captioning work to volunteers, help them get set up +- Volunteers: Caption pre-recorded videos (usually starting from autogenerated ones for easier work) +- Make sure all the links/resources mentioned are written down somewhere (web page and enriched captions for pasting into #emacsconf-accessible) -- One per talk - - We can send speakers a direct link to their room and they can check into it themselves - - Needs a little more work when setting up rooms and when extracting videos - - Easier for the host to join - - Check-in person can just keep an ear open in that room -- Five or so, rotating among them - - Check-in person directs the speaker to the next available room - - Worked fine last time +### Compress the video - +Usage: `compress-video.sh original-file output-file`: -## How easy do we want to make it to join the BBB session? +(zaeph might tinker with this) -Considerations: + Q=32 + ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -an -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -threads 8 /dev/null && + ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -c:a copy -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -threads 8 "$2" -- It’s easier for the checkin person to deal with only the speaker -- We may not want people to join the Q&A session at the beginning -- We want to make it easy for people to join the Q&A session eventually +We tried using q56 before, but it was a little too aggressive. Q=32 is the default and is probably a reasonable space vs. quality compromise. -Options: +2020 version used with parallel -- PROBABLY EASIEST: Set it to anyone can join, but the meeting needs to be started by a - moderator. Start the meeting on the day of the talk. Announce the - BBB URL in the pad, IRC channel, and on the talk page when the host - is ready. Maybe add a rewrite rule when the host is ready. -- Set an access code. Announce the access code when the host is ready. - - Access codes are annoying to copy and paste. - - Access codes might get accidentally unset or regenerated. -- Set room so that moderators have to approve waiting users. - - Check-in has to watch out for waiting speaker. - - Host sets it to accept everyone who’s waiting when the host is ready. - - Changing it to turn the option off doesn’t seem to affect an - ongoing meeting, even though the web interface says you should be - able to change the setting any time. - - Waiting users don’t make the user notification go ding. + Q=$1 + WIDTH=1280 + HEIGHT=720 + AUDIO_RATE=48000 + VIDEO_FILTER="scale=w=${WIDTH}:h=${HEIGHT}:force_original_aspect_ratio=1,pad=${WIDTH}:${HEIGHT}:(ow-iw)/2:(oh-ih)/2,fps=25,colorspace=all=bt709:iall=bt601-6-625:fast=1" + FILE=$2 + SUFFIX=$Q + shift + shift + if [ ! -f $FILE ]; then + wget https://mirror.csclub.uwaterloo.ca/emacsconf/2020/$FILE + fi + ffmpeg -y -i "$FILE" -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -an -threads 8 /dev/null && + if [[ $FILE =~ "webm" ]]; then + ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a copy "${FILE%.*}--compressed$SUFFIX.webm" + else + ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a libvorbis "${FILE%.*}--compressed$SUFFIX.webm" + fi + rm $FILE -Change talk status to OPEN\_Q or UNSTREAMED\_Q, and change to TO\_ARCHIVE when done. -M-x emacsconf-publish-bbb-redirect to update the redirect for a single talk -M-x emacsconf-publish-bbb-redirect-all updates all the redirects +2022 version used with parallel to compress low version + Q=$1 + WIDTH=1280 + HEIGHT=720 + AUDIO_RATE=48000 + VIDEO_FILTER="scale=w=${WIDTH}:h=${HEIGHT}:force_original_aspect_ratio=1,pad=${WIDTH}:${HEIGHT}:(ow-iw)/2:(oh-ih)/2,fps=25,colorspace=all=bt709:iall=bt601-6-625:fast=1" + FILE=$2 + SUFFIX=$Q + shift + shift + ffmpeg -y -i "$FILE" -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -an -threads 8 /dev/null && + if [[ $FILE =~ "webm" ]]; then + ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a copy "${FILE%.*}--compressed$SUFFIX.webm" + else + ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a libvorbis "${FILE%.*}--compressed$SUFFIX.webm" + fi -### TODO Add nginx redirect from emacsconf.org -/ssh:front|sudo::/etc/nginx/sites-available/emacsconf.org +### sachac +- download to local cache + ~/proj/emacsconf/private/sync-cache +- upload to YouTube in case we can get autogenerated subtitles from there + +- upload to res:~/2022/captions +- caption.sh +- sync-cache to copy the vtt +- emacsconf-make-backstage-index +- send confirmation e-mail - -## DONE How do we want to name the BBB rooms? +### Confirmation e-mail -Needs to be easy to: -- share all the BBB rooms for a particular shift with the check-in volunteer -- start the BBB rooms for the morning -- match up the recordings with the talks afterwards -- find the BBB room for a talk or speaker -- remove all the BBB rooms for the year +#### DONE Make sure all submissions have been acknowledged -ec22-sat-am-dev Speaker Name (slugs) +- [X] sibi +- [X] vidianos +- [X] bhavin +- [X] gopar +- [X] bala +- [X] andrea +- [X] andrew +- [X] zachary for asmblox (reception confirmed by zaeph, and no problem + with video) +- [X] ramin (ack’d by zaeph) +- [X] abin (meain, ack’d by zaeph) - + -## Do we want people to advertise any openings with their companies or any work that they’re looking for? +#### Acknowledge pre-rec submission -- Speakers on their page? -- General audience on a wiki page somewhere? + (defun emacsconf-mail-acknowledge-submission (talk &optional template) + (interactive (list (emacsconf-complete-talk-info))) + (save-window-excursion + (emacsconf-with-talk-heading (plist-get talk :slug) + (emacsconf-cache-video-data talk) + (when (string= (plist-get talk :status) "WAITING_FOR_PREREC") + (org-todo "TO_PROCESS")))) + (emacsconf-publish-backstage-index) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "ack-prerec")) + (plist-get talk :email) + (list + :backstage "https://media.emacsconf.org/2022/backstage/" + :backstage-user "emacsconf" + :backstage-password emacsconf-backstage-password + :time (plist-get talk :time) + :title (plist-get talk :title) + :email (plist-get talk :email) + :minutes (plist-get talk :video-time) + :speakers-short (plist-get talk :speakers-short) + :url (concat emacsconf-base-url (plist-get talk :url)) + :year emacsconf-year))) - +#### Template -## Decision archive +Hi, ${speakers-short}! +Just a quick note to let you know that I’ve downloaded your submission +for “${title}”. We’ve added your submission to the backstage area at +${backstage} (username: ${backstage-user}, password: +${backstage-password}), and we’ll post the files on your talk page +when the talk is public. A quick check shows that your video is about +${minutes} minutes long (${time} minutes budgeted). -### Where should volunteers e-mail? +We’ll be working on captioning it over the next few weeks. We’ll +e-mail again a little closer to the conference with schedule updates +and other useful information. If you want to upload a new version, you +can upload it the same way you did the previous one. -- **Default to emacsconf-org and offer emacsconf-org-private as an option** -- emacsconf-org-private - - less public, e.g. if for whatever reason we might have to decline an offer of help - - Also, some people want to volunteer but do not want to be in the public’s eye. -- emacsconf-org - - If you’re thinking about the enticement factor of having people - volunteer publicly, we’ll still have a well-furnished list of people - helping us run the conf somewhere on the wiki. [11:22] - - i would think if someone doesn’t want to do it publicly, they could - opt to write to -org-private instead, but otherwise the defacto - should be public (-org) - - i just think most folks would want to do this publicly unless for - specific reasons, rather than the other way around +Please feel free to e-mail us at emacsconf-submit@gnu.org if you need +help updating the talk wiki page at ${url} or if you have other +questions. +Thank you so much for all the work you put into preparing a talk for +EmacsConf ${year}, and thank you for submitting the prerecorded video +before the conference! -### CANCELLED Do we want to do alt-stream the same way again this year? +Sacha Chua -Superseded by decision to have multiple tracks -- Alt stream joins the current session and then continues with it until the Q&A finishes; people join the BBB room if they want to ask questions - - Nice and convivial, Q&A still gets captured - - Inertia means most people get the main message -- Multiple streams with more space between talks, people choose which stream they want to watch - - How other conferences do it - - Speakers can attend related talks more easily + +### Mastering the prerec’s audio-track -### DONE Shall we put a generic e-mail address for sending feedback, maybe with different mailtos? +Mastering is the process of preparing an audio-track for a purpose. For +us, the purpose is quite simple: maximize the intelligibility of the +speaker and minimize the noise. -Pain points: +We can get great results with Audacity for the vast majority of +audio-tracks. Sometimes, however, some audio-tracks have intractable +noise-profile that require the use of model-based denoising filters that +can applied with ffmpeg. -- Many talk pages don’t have public e-mail addresses, so it takes a - little extra work (or is sometimes impossible) for people to follow - up if they have questions +We’ll start with the average Audacity workflow, and we’ll move on to the +model-based filters after. -Options: -- Do nothing (current) -- Add a mailto link to emacsconf-discuss that prepopulates the subject -- Add a mailto link to emacsconf-org - - Wider discussion -- **Add a mailto to emacsconf-org-private** - - Private feedback that can be forwarded to the speaker +#### Audacity workflow +When we process a prerec, we extract the audio of the original upload +and add it to the backstage. You should be able to find it under the +name –original.$audio\_format or –main.$audio\_format. If it’s not +there, it’s easy to extract the audio from the original video, but +we’d prefer if you warned core-organizers about it because it’s not +normal. - +We’ve simplified the process down to these steps: -# Roles needed +1. Open the audio file in Audacity. + + You might want to increase the size of the waveform by pulling on the + bottom of the bottom of the track. + + [audacity-demo-noise-reduction.webm](https://media.emacsconf.org/misc/audacity-demo-noise-reduction.webm) -Each role comprises different responsibilities. A person may have multiple roles. An organizer might take the lead for a role, but if you want to volunteer, speak up and they’ll probably be glad to share the load. +2. Find a moment of quiet in the video, and select it. + + We ask our speakers to include 5 seconds of quiet at the beginning or + end of their prerecs, but even if they don’t, it’s relatively. -Some roles are also described on the page. If you want to encourage people to volunteer to help, add a role description there. +3. Effects → Noise Reduction → Get Noise Profile +4. Select → All -## During the proposal stage +5. Effects → Noise Reduction → OK + + You can select a spoken portion of the track before applying the + effect and preview it to test your settings. The default are usually + enough (Noise reduction (dB): 12, Sensitivity: 6.00, Frequency smoothing + (bands): 3). + + [audacity-demo-noise-reduction.webm](https://media.emacsconf.org/misc/audacity-demo-noise-reduction.webm) -The roles below are related to the proposals in the early stages of the preparation. +6. Tools → Apply Macro → Alpha + + Before you can apply the Alpha macro, you need to save its content to + disk and import it via Tools → Macro Manager → Import. -- Scheduler (SCHED: sachac) - - Process talks as they come and find the best place for them in the timeline - - Keep track of availability and thematic constraints and find solutions that accommodate most -- Reviewer - - Review the proposals sent to emacsconf-submit before the speaker-notification deadline - - Raise flags if there are problems with a proposal (e.g. too much content for the short format) -- Listener - - Receive emails from emacsconf-submit - - Ensure that candidates are sticking to the prescribed format (esp. the 10/20/40 duration rule) - - Respond to people’s requests and suggestions, pulling in other people to help as needed -- Publisher (PUB: sachac) - - Set up the wiki page -- Infrastructure - - Figure out streaming options - - Set up file upload system that speakers will use - - Plan other systems that people will use + Reverb:Delay="20" DryGain="5" HfDamping="99" Reverberance="15" RoomSize="70" StereoWidth="25" ToneHigh="0" ToneLow="100" WetGain="-13" WetOnly="0" + Amplify:Ratio="1" + FilterCurve:f0="79.621641" f1="101.02321" FilterLength="8191" InterpolateLin="0" InterpolationMethod="B-spline" v0="5.9148936" v1="0.042552948" + Normalize:ApplyGain="1" PeakLevel="-3" RemoveDcOffset="1" StereoIndependent="1" + Compressor:AttackTime="0.1" NoiseFloor="-50" Normalize="1" Ratio="2" ReleaseTime="1" Threshold="-30" UsePeak="0" +1. Export → Export Audio… → Opus Files (.opus format) + + Use the following settings: + + [audacity-export-settings.png](https://media.emacsconf.org/misc/audacity-export-settings.png) + + > Bit Rate: 64 kbps + > VBR Mode: On + > Compression: 10 + > Application: Audio + > Frame Duration: 20 ms + > Cutoff: Disabled -## When speakers have submitted their pre-recorded videos -- Copy to backstage as –original.webm and –main.webm using M-x emacsconf-upload-copy-from-json -- Copy to res /data/emacsconf/2022 -- Start /data/emacsconf/2022/process-captions.py if it’s not already running -- Use ~zaeph/scripts/reencode.sh on the file as well +#### Model-based denoising filter -- Video processor (zaeph) - - Standardize and compress uploaded videos -- Caption lead (sachac) - - Prepare videos and starting captions for captioning volunteers -- Captioner - - Edit automatically-generated captions to correct misrecognized words - - Nice to have: Break up the captions in better places so that subtitles are neither too long nor too short - - Perk: Get access to prerecorded videos -- Quality checker - - Doublecheck videos for potential encoding issues or compression artifacts that get in the way of viewing - - Doublecheck captions -- Tech checker - - Help speakers check that their system works well with BBB for live Q&A +If you can’t manage to get a good result with Audacity, chances are it’s +because there’s too much noise in the video, even after profile-based +denoising. This usually happens when the noise-pattern of an +audio-track evolves over the video, or if has an aperiodic quality. For +those, we’re going to need a bigger boat. +Model-based denoising means using an AI-generated model to remove the +audio frequencies that are usually associated to noise and preserve +those that aren’t. A different context (e.g. noisy room with statics, +noisy room with people chatting, etc.) means a different model; for us, +this means a model that minimizes background noise and maximizes clear +voices (the speakers’). -## During the conference +This is the model we’ve been using: -- Streamer (STREAM) - - Download prerecorded videos - - Send the combined stream to Icecast for broadcasting -- Director (DIR: corwin) - possibly same as streamer - - Switch scenes, manage audio volumes as needed - - Provide timekeeping information to host (especially go-live countdowns) -- Host (HOST: zaeph) - - Introduce talks and speakers - - Read questions - - Give time warnings - - Thank speakers and transition to next talk -- Timekeeper - possibly same as host - - Manage time based on all available information (prerecs durations, speakers not showing up, etc.) -- Check in (CHECK) - - Notice speakers checking into IRC - - Get them into the correct room and help them doublecheck their audio and video quality - - Troubleshoot as needed - - Notify host about next room to join - - Follow up with speakers who haven’t checked in yet - - Check on speakers periodically so that they’re not waiting alone -- Questions - - Copy questions from IRC and the pad to wherever the host and speaker are looking -- Pad scribe - - Organize and format people’s contributions - - Add notes about links, key points, questions, answers -- Accessibility (ACCESS: dto) - - Describe visuals in #emacsconf-accessible - - Nice to have: echo the captions into #emacsconf-accessible -- Quality checker - - Doublecheck stream quality and audio volume -- Publisher (PUB: sachac) - - Announce talks in the IRC channels - - Nice to have: Update the wiki page with resources (video) - - Nice to have: Set resources to public as each talk is played (Toobnix, YouTube) - - Nice to have: Update the schedule to reflect changes throughout the day +[audio-denoiser-model-mp.rnnn](https://media.emacsconf.org/misc/audio-denoiser-model-mp.rnnn) (download link) +Source: [rnnoise-models](https://github.com/GregorR/rnnoise-models), Model: [marathon-prescription](https://raw.githubusercontent.com/GregorR/rnnoise-models/master/marathon-prescription-2018-08-29/mp.rnnn) - +You should always apply the filter on the original’s audio, as opposed +to an Audacity-processed audio. This is to ensure that we have the most +information about the signal, which means we can have gather the most +information about the noise-profile. -### Shifts +Following is the ffmpeg incantation to use to apply the filter-model. +Make sure to modify the `DENOISER` variable and adapt input/output. - + DENOISER="/path/to/audio-denoiser-model-mp.rnnn" + input="original.opus" + output="denoised.opus" + ffmpeg -i "$input" -af "arnndn=m=$DENOISER" "$output" -AM: 9-12 PM EST, PM: 1-5 PM EST (plus a little extra for setup/transition) +There’s no need to customize the libopus export information; the default +is more than enough for human-speech. -Saturday Dec 3 +When you’re done with this step, you can then process the outputted +audio-track with Audacity, skipping the denoising steps (1 to 5). - +#### Questions? --+If you’ve got any question on the process, you canget in touch with me (zaeph)! --+ -- -- -- - - - - - - - - - - +## When a talk is captioned - - - - - - - - - +- Combine captions with talk +- Upload captions to YT and Toobnix +- Prepare captions for wiki inclusion - - - - - - - - + +## Other tasks before the conference - - - - - - - - +- Coordinate volunteer schedules so all the roles are covered - - - - - - - - - -
 HostStreamerCheckinIRCPad
Gen AMzaephcorwinsachacsachacpublicvoit
Gen PMzaephcorwinFlowyCoderdtopublicvoit
Dev AMbandalibandalisachacdto 
Dev PMvetrivlnbandaliFlowyCodervetrivln 
+### TODO Update ansible configuration :sachac: -publicvoit - pad until 4pm on Sat, until 2pm on Sun +in prod-vars.yml -Sunday Dec 4 +media\_protect\_root: true +icecast\_save\_dump: false - +Clean up the media root +then --+ansible-playbook -i inventory.yml prod-playbook.yml –tags media,stream --+### Test stream setup -+[Stream](#other-streams) --- - - - - - - - - - - +### Set up MPV for captions - - - - - - - - - +#### mpv profile - - - - - - - - +Add the following profile to `~/.config/mpv/mpv.conf`: + # Uncomment this line to load the profile by default + # Otherwise, use `--profile=emacsconf-talks` + # profile=emacsconf-talks + + [emacsconf-talks] + # Positioning + video-zoom=-0.15 + video-pan-y=-0.055 + sub-use-margins=yes + sub-scale-by-window=yes + sub-pos=103 + sub-margin-x=150 + sub-margin-y=40 + # Style + sub-font="Clear Sans Bold" + sub-color="1/0.82/0" + sub-blur=0.2 + sub-scale=0.9 + sub-font-size=40 + sub-border-size=0 + sub-border-color=0/1 + sub-shadow-color=0/1 + sub-shadow-offset=1.2 + sub-ass-force-style=Kerning=yes + sub-ass-line-spacing=0 - - - - - - - - +(Thanks, zaeph) - - - - - - - - - -
 HostStreamerCheckinIRCPad
Gen AMzaephcorwinsachacsachacpublicvoit
Gen PMzaephjmanFlowyCoderdtopublicvoit
Dev AMbandalibandalisachacdto 
Dev PMvetrivlnbandaliFlowyCodervetrivln 
+#### Font: Clear Sans -Backups: +Links: -- dev host/streamer: bandali, sachac -- gen host/streamer: zaeph, sachac -- checkin, IRC, pad: sachac +- tar.gz with all fonts: [from zaeph’s server](https://zaeph.tk/files/emacsconf/captions/fonts.tar.gz) (more convenient) +- WOFF from GitHub repo: [clear-sans/WOFF at main · intel/clear-sans](https://github.com/intel/clear-sans/tree/main/WOFF) -Interested in a shift? Please e-mail and we’ll help you figure out what you need to learn. - `(setq emacsconf-shifts - (list - ,@(apply #'append - (mapcar - (lambda (day) - (let ((headers (mapcar (lambda (field) (intern (concat ":" (downcase field)))) - (cdr (car (cadr day)))))) - (mapcar - (lambda (row) - (apply #'append - (list 'list :id - (when (string-match "^\\([^ ]+\\) \\(AM\\|PM\\)" (car row)) - (format "%s-%s-%s" - (car day) - (downcase (match-string 2 (car row))) - (downcase (match-string 1 (car row))))) - :track - (if (string-match "^Gen" (car row)) "General" "Development") - :start - (format "%sT%s:00:00%s" - (elt day 2) - (if (string-match "AM" (car row)) "08" "13") - emacsconf-timezone-offset) - :end - (format "%sT%s:00:00%s" - (elt day 2) - (if (string-match "AM" (car row)) "12" "18") - emacsconf-timezone-offset)) - (seq-map-indexed - (lambda (value index) - (unless (string= value "") - (list (elt headers index) value))) - (cdr row)))) - (cdr (cadr day))) - )) - (list - (list "sat" sat "2022-12-03") - (list "sun" sun "2022-12-04")))))) +### Download prerecorded videos from ${protected} +- STREAM: Download prerecorded videos from ${protected} + + rsync -avzue ssh front:/var/www/media.emacsconf.org/2021/protected/*--main.webm . -## After the conference -- Video processor - - Extract live segments into videos -- Captioner - - Add more captions - - Summarize Q&A -- Publisher - - Post more information + +## During the conference - -# Infrastructure notes +### Set up -## Uh… how should ikiwiki be set up? +#### Arrange screens -- remove the ikiwiki\_src clone from the ansible config +- CHECK: + - Share ${upcoming}, ${playbook}, and ${conf} via CRDT: `conf-crdt-connect-and-share` + - Current schedule, filenames/commands for playing, Q&A preference, IRC nick, pronunciation, intro notes, prerec duration, emergency contact information + - `conf-upcoming-add-subtree` + - Have #emacsconf-org, #emacsconf, #emacsconf-accessible, and #emacsconf-questions open + - Use `/opall` to get op privileges in all the channels + - Start backup process for pad + + while true; do + curl https://etherpad.wikimedia.org/p/emacsconf-2021/export/html > emacsconf-$(date +"%Y%m%d-%H%M%S").html + sleep 15m + done + - Computer for alternate streaming: + - Open browser for joining BBB + - Open MPV for playing +- HOST: + - rsync the newest –main.webm from front: rsync -avze ssh front:/var/www/media.emacsconf.org/2021/protected/\*–main.webm . + - Check OBS scenes for sharing windows/tabs as a virtual camera: + - chat.emacsconf.org with #emacsconf + - Etherpad + - Schedule + - next talk page + - Clock with current time on screen: `watch TZ=America/Toronto date` + - Set up backchannel for easy viewing + - ${upcoming} + - \#emacsconf-org and #emacsconf channels + - (?) Join organizer room S - -bare repo has a post-update hook that updates the src repo -src repo is ~ikiwiki/emacsconf -~git/repositories/pub/emacsconf-wiki.git/hooks/post-update runs ~git/repositories/pub/emacsconf-wiki.git/hooks/post-update.h00-ikiwiki-wrapper -there is an anon mirror that’s updated with sudo -u anon /home/anon/fetch-wiki -the git wrapper is -/home/ikiwiki/hooks/emacsconf -~anon/emacsconf-wiki.git has origin git@git.emacsconf.org:pub/emacsconf-wiki (fetch) -but git log does not have the new stuff -Where is the new stuff? -… hah, maybe I forgot to push +#### Start streaming :stream: +- HOST: Display getting-ready message and start streaming to main.webm +- HOST: Confirm that the stream is live at +- B: Update ${status} to say that the stream is live +- CHECK: Start low-resolution stream, confirm at + Call this on live0 with $CONF480PASS as the first parameter. The Icecast configuration is on `live0` at =. + + PASS=$1 + while true; do ffmpeg -loglevel 24 -f webm -reconnect_at_eof 1 -reconnect_streamed 1 -re -i http://localhost:8000/main.webm -vf scale=854:480 -f webm -c:a copy -b:v 500k -maxrate 1M -bufsize 1M -content_type video/webm -c:v libvpx icecast://ec2020main480pmu:$PASS@localhost:8000/main-480p.webm; done +- CHECK: Start Youtube and Toobnix streams. Call this with $YOUTUBE1PASS, $YOUTUBE2PASS, or $TOOBNIX as the parameter + + MOUNT=$1 + while true; do ffmpeg -loglevel 24 -i http://localhost:8000/main.webm -cluster_size_limit 2M -cluster_time_limit 5100 -b:v 1M -crf 30 -g 125 -deadline good -threads 4 -vcodec libx264 -acodec libmp3lame -f flv $MOUNT; done +- CHECK: Verify YouTube and Toobnix streams and the CPU load on live0. +- CHECK: Set the YouTube and Toobnix streams to public. +- B: Verify with #emacsconf that the stream is active. +- CHECK: Play main stream on alternate laptop. Start alternate stream and verify. Update ${status}. +- CHECK: Announce on Twitter (@emacs, @emacsconf, @sachac) and in #emacs + EmacsConf 2021 starting now: -## Backstage +##### Stream -### File suffixes, and what they correspond to -Per categories, earlier suffixes come earlier in the process. +###### Low-res stream - +Needs the `$main480p` environment variable set to something of the form `icecast://username:password@site:port/mount-point.webm`. Icecast configuration can be found on `live0` at `/etc/icecast2/icecast.xml`. It was okay to run this command directly on `live0` in 2020, since that kept the speed at roughly 1x. + while true; do ffmpeg -f webm -reconnect_at_eof 1 -reconnect_streamed 1 -re -i http://localhost:8000/main.webm -vf scale=854:480 -f webm -c:a copy -b:v 500k -maxrate 1M -bufsize 1M -content_type video/webm -c:v libvpx $main480p done ---- - - - - - - +###### Youtube - - - - - +### Check in a speaker - - - - +Exception: [CHECK is unavailable](#check-gone) +- Speaker checks in on #emacsconf-org via IRC or via e-mail ~30m before +- CHECK notes IRC nick for speaker. +- CHECK confirms Q&A preference: live/IRC/Etherpad, preferred way of getting questions +- [? unknown] Thanks for checking in! How would you like to handle Q&A + today - live video, the collaborative Etherpad at + , or IRC (like + this)? +- [? IRC] Thanks for checking in! Feel free to keep an eye on + \#emacsconf for questions and discussion, and we’ll copy things from + the pad to there. If the volume gets overwhelming, let us know and + we can forward questions to #emacsconf-questions for you. If you’d + like to try Q&A over live video or the collaborative pad instead, or + if you need help, please let us know. +- [? Etherpad] Thanks for checking in! The collaborative pad we’ll be + using for questions is at + . We’ll collect + questions from #emacsconf and put them there. If you’d like to jump + to your part of the document, you might be able to keep an eye on + questions. Please let us know if you need help, or if you want to + switch to live Q&A. +- [? live] Thanks for checking in! I’ll send you some private messages + with instructions, so please check there. Let me know if you don’t + get them. + - Private messages: + - (erc-message “PRIVMSG” (format “%s You can use this BBB room: %s . I’ll join you there shortly to set up the room and do the last-minute tech check.” nick room-url)) + - (erc-message “PRIVMSG” (format “%s The collaborative pad we’ll be using for questions is at %s . We’ll collect questions from #emacsconf and put them there. If you’d like to jump to your part of the document, you might be able to keep an eye on questions. Alternatively, we can read questions to you.” nick conf-collaborative-pad)) + - (erc-message “PRIVMSG” (format “%s Leo Vivier will join when it’s time, and he will give you the go-ahead when it’s time to present. See you in the BBB room!” nick)) + - CHECK directs speaker to available room with `/checkin ` + - Speaker joins talk room + - CHECK makes speaker presenter and moderator, does last-minute tech check + - Hello, thanks + - Speaker tries screen sharing and webcam (optional) + - check screen readability + - CHECK briefs speaker on process, including: + - live Q&A: reading questions themselves (can do in any order, + can skip; coach possible responses for awkward things) or asking HOST to read questions to them + - HOST can share the pad or IRC; speaker shares screen only if doing demo + - encouragement of webcam, although it’s optional + - how HOST will join shortly before the prerec ends and then + give them the go-ahead + - closing any tabs watching the stream as their talk starts + (otherwise the audio is confusing) + - If the speaker will be giving a live presentation, CHECK + collects emergency contact information (in case of technical + issues) and shares it with HOST in the CRDT buffer + - Okay to do other things until the prerec ends + - CHECK updates ${upcoming} with link to the talk room and + preferences for Q&A-. CHECK will also /msg the relevant + information. - - - - +#### bandali’s check-in steps - - - - - +- please leave webcam quality on ’medium’ +- please read each audience question out loud before responding +- please mute stream on your machine if you’re watching +- would you like to stay around for a longer q&a? +- would you like to share your webcam or screen? (quickly mention how) - - - - - +### Present talk - - - - +- CHECK announces the next talk on IRC and marks the previous talk as done. (`conf-announce`) +- PAD clears pad colours. +- [? prerec] + - HOST switches to MPV scene in OBS and plays the video (with captions if available). + - Exception: [Last-minute prerecording submission](#last-minute-prerec) + - Exception: [Last-minute caption update](#last-minute-captions) + - [CHECK publishes information](#publish) + - [HOST gets a head start on handling Q&A](#questions) + - When prerec finishes, HOST switches the OBS scene to show BBB. +- [? live] + - Exception: [Speaker does not have a prerec and has not checked in](#really-missing) + - HOST joins the BBB room and double-checks that recording is on. + - CHECK-alternate joins the BBB room and pauses main MPV. + - HOST switches to OBS scene for BBB. + - Speaker presents. + - Exception: [Technical issues during a live presentation](#live-issues) + - [? talk needs to be wrapped up] + - HOST nudges speaker verbally. - - - - - +### Publish information - - - - - +- CHECK updates the schedule in: + - ${conf} + - ${upcoming} + - wiki +- CHECK publishes the video to media.emacsconf.org using `conf-publish-files` +- CHECK commits the wiki page and the captions for the talk. +- CHECK publishes the video on YouTube and ToobNix using `conf-video-share`. + - Update description: + + This video is available under the terms of the + Creative Commons Attribution-ShareAlike 4.0 International (CC + BY-SA 4.0) license. + + You can view it using free and open source software at + ${url} + + ${description} + - Mark it as public. + - Add it to EmacsConf 2021 playlist. + - Update title and description. + - Mark it as public. + - Doublecheck subtitles + - Add it to the EmacsConf 2021 playlist. +- [? live sections] + - CHECK does a rough-cut of the recording from ${dump} to get the last X minutes or by time range. There’s about a 1-2 minute delay. + Ex: `(kill-new (conf-dump-get "alt" "10:24" "10:30" "qa_"))` + - When there’s an opportunity to do so: + - CHECK finetunes the rough-cut recording (trim start and end) and posts it to: + - media.emacsconf.org/2021 + - wiki page for talk - - - - +#### TODO Make sure VTTs only get published when they’re edited - - - - - -
SuffixDescription
VIDEO 
–original.EXTFile as submitted by speaker
–reencoded.webmReencode via ffmpeg incantation
–final.webmBroadcast-ready reencode with normalized audio
AUDIO 
–original.EXTExtracted audio track from speaker upload; used for speech-recognition
–normalized.opusNormalized audio track
SUBTITLES 
–?(incomplete-)transcriptTranscript provided by speaker
–main.EXTBroadcast-ready reencode; different formats for different uses
+##### publishing - +##### webm -# Other tasks and processes -- [Giving conf.org access to a new volunteer or fake user](#private-access) -- [As prerecorded talks come in](#prerec-process) -- [When a talk is captioned](#when-captioned) -- [Other tasks before the conference](#before) -- [During the conference](#during-conference) -- [After the conference](#after-conference) -- [In case of](#exceptions) +##### media directory - +### Handle Q&A -## Giving conf.org access to a new volunteer or fake user +Exceptions: -This can only be done by the admins of the gitolite instance (zaeph, -or bandali as a backup). This is because the changes need to be made -in the gitolite-admin repo that can only be accessed by admins. In a -pinch, people with access to the \`orga\` user on front0 can manually -add themselves to the list of admins and manually rebuild the -instance. +- [Speaker has not checked in](#missing) -Regular process: +- [? live] + - CHECK-alternate joins the BBB room and pauses MPV. + - HOST joins the BBB room + - HOST starts recording in BBB or confirms that it’s already recording + - HOST switches to the BBB scene in OBS. + - HOST describes how to ask questions. + - [? No questions yet] + - HOST thanks speaker, says nice things about talk, and asks a couple of prepared questions + - [? Awkward question] + - HOST can try rephrasing the question. + - HOST adds note to IRC/Etherpad that speakers can answer in any order, skip questions, answer afterwards, etc. + - [? Q&A needs to be wrapped up] + - HOST writes in Etherpad/IRC or nudges speaker verbally. + - CHECK notes the time that the live Q&A finished and switches back to the main stream on CHECK-alternate. +- [? IRC/pad] + - HOST switches to pad/chat OBS scene. + - HOST describes Q&A method and shows it on the screen. + - While there’s buffer time before the next talk, HOST can read out + questions and answers, or transition to the next talk early + - HOST: It’s time for the next talk, but if you want to keep + discussing the previous talk, please feel free to continue doing + so on IRC or the pad. +- [? speaker will answer after the conference] + - HOST switches to pad/chat OBS scene. + - HOST says the speaker is not available right now, but we’ll + forward the questions to the speaker and we’ll post the speaker’s + answers on the wiki page. Leave your contact information if you + want to be notified, or subscribe to the emacsconf-discuss mailing + list to get the announcement. Please feel free to continue + discussing the talk on IRC or the pad. +- [Present next talk](#present) -- Get public key from volunteer, -- Add key under `./key/dir/`, -- Update permissions on `./conf/gitolite.conf`, -- Push to origin. +\* - +### During each talk -## As prerecorded talks come in +- Volunteers: post links/resources/descriptions/captions (depending on your level of energy) to #emacsconf-accessible +- Volunteers: making sure questions get posted somewhere the speaker can see them -- Sacha: Parcel out captioning work to volunteers, help them get set up -- Volunteers: Caption pre-recorded videos (usually starting from autogenerated ones for easier work) -- Make sure all the links/resources mentioned are written down somewhere (web page and enriched captions for pasting into #emacsconf-accessible) +### Break time -### Compress the video +- CHECK marks the last talk as done. `conf-end-current-talk` +- CHECK stops and restarts the Toobnix restreaming process, and re-checks the stream +- CHECK uses `conf-upcoming-add-subtree` to add the afternoon talks to upcoming.org +- HOST doublechecks network transfer limit and server health -Usage: `compress-video.sh original-file output-file`: -(zaeph might tinker with this) +### End of stream - Q=32 - ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -an -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -threads 8 /dev/null && - ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -c:a copy -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -threads 8 "$2" +- CHECK removes live Q&A links +- CHECK stops ffmpeg process for Youtube +- CHECK stops ffmpeg process for Toobnix +- CHECK stops ffmpeg process for main-480p +- STREAM stops streaming +- B updates the status pages +- bandali figures out the downstream -We tried using q56 before, but it was a little too aggressive. Q=32 is the default and is probably a reasonable space vs. quality compromise. -2020 version used with parallel + - Q=$1 - WIDTH=1280 - HEIGHT=720 - AUDIO_RATE=48000 - VIDEO_FILTER="scale=w=${WIDTH}:h=${HEIGHT}:force_original_aspect_ratio=1,pad=${WIDTH}:${HEIGHT}:(ow-iw)/2:(oh-ih)/2,fps=25,colorspace=all=bt709:iall=bt601-6-625:fast=1" - FILE=$2 - SUFFIX=$Q - shift - shift - if [ ! -f $FILE ]; then - wget https://mirror.csclub.uwaterloo.ca/emacsconf/2020/$FILE - fi - ffmpeg -y -i "$FILE" -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -an -threads 8 /dev/null && - if [[ $FILE =~ "webm" ]]; then - ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a copy "${FILE%.*}--compressed$SUFFIX.webm" - else - ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a libvorbis "${FILE%.*}--compressed$SUFFIX.webm" - fi - rm $FILE +## After the conference -2022 version used with parallel to compress low version - Q=$1 - WIDTH=1280 - HEIGHT=720 - AUDIO_RATE=48000 - VIDEO_FILTER="scale=w=${WIDTH}:h=${HEIGHT}:force_original_aspect_ratio=1,pad=${WIDTH}:${HEIGHT}:(ow-iw)/2:(oh-ih)/2,fps=25,colorspace=all=bt709:iall=bt601-6-625:fast=1" - FILE=$2 - SUFFIX=$Q - shift - shift - ffmpeg -y -i "$FILE" -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -an -threads 8 /dev/null && - if [[ $FILE =~ "webm" ]]; then - ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a copy "${FILE%.*}--compressed$SUFFIX.webm" - else - ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a libvorbis "${FILE%.*}--compressed$SUFFIX.webm" - fi +### Send thanks +[Thank you, next steps](#thanks) -### sachac -- download to local cache - ~/proj/emacsconf/private/sync-cache -- upload to YouTube in case we can get autogenerated subtitles from there - -- upload to res:~/2022/captions -- caption.sh -- sync-cache to copy the vtt -- emacsconf-make-backstage-index -- send confirmation e-mail +### Extract the opening and closing remarks -### Confirmation e-mail +### Extract the Q&A recordings, trimming as needed +From -#### TODO Make sure all submissions have been acknowledged + console.log([...document.querySelectorAll('.email-link')].map((o) => '| ' + o.closest('tr').querySelector('time').getAttribute('datetime') + ' | ' + o.closest('tr').querySelector('#recording-text').innerHTML.trim() + ' | ' + o.getAttribute('data-pres-link').trim() + ' |').join('\n')) -- [X] sibi -- [X] vidianos -- [X] bhavin -- [X] gopar -- [X] bala -- [X] andrea -- [X] andrew -- [X] zachary for asmblox (reception confirmed by zaeph, and no problem - with video) -- [ ] ramin (ack’d by zaeph) -- [ ] abin (meain, ack’d by zaeph) +Make an `ids.txt` with the IDs extracted from BBB. +In the same directory: - + while read p; do + mkdir -p "$p"; + cd "$p"; + wget "https://bbb.emacsverse.org/presentation/${p}/slides_new.xml" \ + "https://bbb.emacsverse.org/presentation/${p}/video/webcams.webm" \ + "https://bbb.emacsverse.org/presentation/${p}/deskshare.xml" \ + "https://bbb.emacsverse.org/presentation/${p}/deskshare/deskshare.webm" \ + "https://bbb.emacsverse.org/presentation/${p}/metadata.xml" + cd ..; + done \\(.+?\\)" + "<\\1>" (dom-attr node 'message))))) + (if (string-match speaker (dom-attr node 'name)) + (format "- %s: %s\n" speaker message) + (format "- %s\n" message))))) + (dom-by-tag (xml-parse-region (point-min) (point-max)) 'chattimeline) + ""))) + (emacsconf-edit-wiki-page slug) + (if (re-search-forward "# Discussion" nil t) + (progn + (goto-char (match-end 0)) + (insert "\n\n")) + (goto-char (point-max))) + (kill-new text))) + ;; TODO: Combine lines from same nick, or identify speakers with anon1/2/etc. + (defun emacsconf-extract-chat-from-dired () + (interactive) + (find-file (expand-file-name "slides_new.xml" (dired-get-file-for-visit))) + (call-interactively 'emacsconf-extract-chat)) -Hi, ${speakers-short}! + (defun emacsconf-make-webcams-deskshare-spans (deskshare start-ms stop-ms strategy source-dir) + (let ((secs (/ start-ms 1000.0)) + (webcam-video (expand-file-name "webcams.webm" source-dir)) + (deskshare-video (expand-file-name "deskshare.webm" source-dir)) + spans) + (mapc (lambda (o) + (unless (or (= secs (string-to-number (dom-attr o 'start_timestamp))) + (= (string-to-number (dom-attr o 'start_timestamp)) 0) + (> secs (/ stop-ms 1000.0))) + (setq spans (cons (list :source webcam-video + :start-ms (* secs 1000) + :stop-ms + (* 1000 + (if (eq strategy 'test) + (+ secs 3) + (max secs (string-to-number (dom-attr o 'start_timestamp)))))) + spans))) + (when (and (<= (string-to-number (dom-attr o 'start_timestamp)) + (/ stop-ms 1000.0)) + (>= (string-to-number (dom-attr o 'stop_timestamp)) + (/ start-ms 1000.0))) + (setq spans (cons (list :source deskshare-video + :start-ms (max (* 1000 (string-to-number (dom-attr o 'start_timestamp))) + start-ms) + :stop-ms + (if (eq strategy 'test) + (* 1000 (+ (string-to-number (dom-attr o 'start_timestamp)) 3)) + (min (* 1000 (string-to-number (dom-attr o 'stop_timestamp))) + stop-ms))) + spans)) + (setq secs (string-to-number (dom-attr o 'stop_timestamp))))) + (dom-by-tag deskshare 'event)) + (unless (>= (floor (* secs 1000)) stop-ms) + (setq spans (cons (list :source webcam-video + :start-ms (* 1000 secs) + :stop-ms (if (eq strategy 'test) + (* 1000 (+ secs 3)) + stop-ms)) + spans))) + (if (eq strategy 'test) + `((video ,@(reverse spans)) + (audio ,@(mapcar (lambda (o) + (list :source webcam-video + :start-ms (plist-get o :start-ms) + :stop-ms (plist-get o :stop-ms))) + (reverse spans)))) + `((video ,@(nreverse spans)) + (audio (:source ,webcam-video :start-ms ,start-ms :stop-ms ,stop-ms)))))) + + (defun emacsconf-get-ffmpeg-to-splice-webcam-and-recording (slug start-ms stop-ms info &optional strategy) + "Return FFMPEG command for slicing. + Strategies: + - 'fast-cut-start-keyframe - find the keyframe before the start ms and cut from there, doing a fast copy. + - 'start-keyframe-and-reencode - find the keyframe before the start ms and cut from there, reencoding. + - 'cut-and-concat - seek to the keyframe before, slowly find the start-ms, reencode the snippet, and then do a fast copy of the remaining. May have encoding errors. + - default: copy from start-ms to stop-ms, reencoding. + " + (let* ((source-dir (expand-file-name (concat "../questions/by-slug/" slug) emacsconf-captions-directory)) + (video-slug (plist-get (seq-find (lambda (o) (string= (plist-get o :slug) slug)) info) :video-slug)) + (output (expand-file-name (concat video-slug "--answers.webm") emacsconf-captions-directory)) + (webcam-video (expand-file-name "webcams.webm" source-dir))) + (if (file-exists-p (expand-file-name "deskshare.webm" source-dir)) + ;; Has deskshare + (let* ((deskshare (xml-parse-file (expand-file-name "deskshare.xml" source-dir))) + (final-size (compile-media-max-dimensions + (expand-file-name "deskshare.webm" source-dir) + (expand-file-name "webcams.webm" source-dir))) + (duration (compile-media-get-file-duration-ms (expand-file-name "webcams.webm" source-dir))) + (spans (emacsconf-make-webcams-deskshare-spans deskshare start-ms stop-ms strategy source-dir)) + (compile-media-output-video-width (car final-size)) + (compile-media-output-video-height (cdr final-size))) + (compile-media-get-command spans output)) + ;; Just webcams + (compile-media-get-command + (compile-media-split-tracks + (list (list :source webcam-video :start-ms start-ms :stop-ms stop-ms))) + output)))) -Just a quick note to let you know that I’ve downloaded your submission -for “${title}”. We’ve added your submission to the backstage area at -${backstage} (username: ${backstage-user}, password: -${backstage-password}), and we’ll post the files on your talk page -when the talk is public. A quick check shows that your video is about -${minutes} minutes long (${time} minutes budgeted). +Make a table of the form -We’ll be working on captioning it over the next few weeks. We’ll -e-mail again a little closer to the conference with schedule updates -and other useful information. If you want to upload a new version, you -can upload it the same way you did the previous one. + -Please feel free to e-mail us at emacsconf-submit@gnu.org if you need -help updating the talk wiki page at ${url} or if you have other -questions. -Thank you so much for all the work you put into preparing a talk for -EmacsConf ${year}, and thank you for submitting the prerecorded video -before the conference! - -Sacha Chua +++- +-### Mastering the prerec’s audio-track +-Mastering is the process of preparing an audio-track for a purpose. For -us, the purpose is quite simple: maximize the intelligibility of the -speaker and minimize the noise. +-We can get great results with Audacity for the vast majority of -audio-tracks. Sometimes, however, some audio-tracks have intractable -noise-profile that require the use of model-based denoising filters that -can applied with ffmpeg. ++ + + + + + + + + + + +
StartEndSlugNotesURLTimestamp
-We’ll start with the average Audacity workflow, and we’ll move on to the -model-based filters after. + (defun emacsconf-process-qa-recordings (qa dir) + ;; (setq conf-qa-recordings qa) + ;; (memoize 'conf-ffmpeg-get-closest-keyframe-in-msecs) + ;; (memoize 'conf-ffmpeg-get-keyframes-between) + ;; (memoize 'conf-video-dimensions) + ;; (memoize 'compile-media-get-file-duration-ms) + ;; (memoize-restore 'conf-ffmpeg-get-keyframes-around) + + (let ((info (emacsconf-get-talk-info))) + (replace-regexp-in-string + "captions/" "answers-slow/" + (replace-regexp-in-string + dir "" + (string-join + (nreverse + (sort + (delq nil + (mapcar + (lambda (o) + (when (> (length (car o)) 0) + (emacsconf-get-ffmpeg-to-splice-webcam-and-recording + (elt o 2) + (compile-media-timestamp-to-msecs (elt o 0)) + (compile-media-timestamp-to-msecs (elt o 1)) + info))) + ; (seq-take qa 2) + qa + )) + (lambda (a b) (string-match "trim" a)))) + "\n"))))) -#### Audacity workflow +### Update the wiki -When we process a prerec, we extract the audio of the original upload -and add it to the backstage. You should be able to find it under the -name –original.$audio\_format or –main.$audio\_format. If it’s not -there, it’s easy to extract the audio from the original video, but -we’d prefer if you warned core-organizers about it because it’s not -normal. -We’ve simplified the process down to these steps: +### Update captions -1. Open the audio file in Audacity. - - You might want to increase the size of the waveform by pulling on the - bottom of the bottom of the track. +- Merge them into the video with `add-captions.sh` - [audacity-demo-noise-reduction.webm](https://media.emacsconf.org/misc/audacity-demo-noise-reduction.webm) + #!/usr/bin/zsh + BASE="${1%.*}" + BASE="${BASE%--main}" + ffmpeg -y -i "$1" ${BASE}--main.vtt + if [ -f "${BASE}--normalized.webm" ]; then + ffmpeg -y -i "$1" -i "${BASE}--normalized.webm" -c:a copy -c:v copy "${BASE}--captioned.webm" + else + ffmpeg -y -i "$1" -i "${BASE}--compressed.webm" -c:a copy -c:v copy "${BASE}--captioned.webm" + fi + cp ${BASE}--main.vtt ${BASE}--chapters.vtt ~/vendor/emacsconf-wiki/2021/captions + scp "${BASE}--captioned.webm" "${BASE}--main.webm" + scp "${BASE}--main.webm" front:~/protected + scp "${BASE}--main.vtt" front:~/protected + scp "${BASE}--chapters.vtt" front:~/protected + ssh front 'cd protected; chmod ugo+r *' +- Update Toobnix and Youtube captions with `conf-video-share`. +- Update Toobnix and Youtube descriptions with chapters. +- Update ${conf-year}/${captions}/${slug}.md in the wiki. To make this from scratch, use `M-x conf-prepare-transcript-directives` from the talk heading in the conference Org file. -2. Find a moment of quiet in the video, and select it. - - We ask our speakers to include 5 seconds of quiet at the beginning or - end of their prerecs, but even if they don’t, it’s relatively. -3. Effects → Noise Reduction → Get Noise Profile +### BLOCKED Downsize the server :bandali: -4. Select → All -5. Effects → Noise Reduction → OK - - You can select a spoken portion of the track before applying the - effect and preview it to test your settings. The default are usually - enough (Noise reduction (dB): 12, Sensitivity: 6.00, Frequency smoothing - (bands): 3). - - [audacity-demo-noise-reduction.webm](https://media.emacsconf.org/misc/audacity-demo-noise-reduction.webm) + -6. Tools → Apply Macro → Alpha - - Before you can apply the Alpha macro, you need to save its content to - disk and import it via Tools → Macro Manager → Import. +## In case of - Reverb:Delay="20" DryGain="5" HfDamping="99" Reverberance="15" RoomSize="70" StereoWidth="25" ToneHigh="0" ToneLow="100" WetGain="-13" WetOnly="0" - Amplify:Ratio="1" - FilterCurve:f0="79.621641" f1="101.02321" FilterLength="8191" InterpolateLin="0" InterpolationMethod="B-spline" v0="5.9148936" v1="0.042552948" - Normalize:ApplyGain="1" PeakLevel="-3" RemoveDcOffset="1" StereoIndependent="1" - Compressor:AttackTime="0.1" NoiseFloor="-50" Normalize="1" Ratio="2" ReleaseTime="1" Threshold="-30" UsePeak="0" -1. Export → Export Audio… → Opus Files (.opus format) - - Use the following settings: - - [audacity-export-settings.png](https://media.emacsconf.org/misc/audacity-export-settings.png) - - > Bit Rate: 64 kbps - > VBR Mode: On - > Compression: 10 - > Application: Audio - > Frame Duration: 20 ms - > Cutoff: Disabled +### Stuck wiki +sudo -iu ikiwiki – ikiwiki –setup ~ikiwiki/emacsconf.setup -#### Model-based denoising filter -If you can’t manage to get a good result with Audacity, chances are it’s -because there’s too much noise in the video, even after profile-based -denoising. This usually happens when the noise-pattern of an -audio-track evolves over the video, or if has an aperiodic quality. For -those, we’re going to need a bigger boat. +### Cancelled talk -Model-based denoising means using an AI-generated model to remove the -audio frequencies that are usually associated to noise and preserve -those that aren’t. A different context (e.g. noisy room with statics, -noisy room with people chatting, etc.) means a different model; for us, -this means a model that minimizes background noise and maximizes clear -voices (the speakers’). +1. Update conf.org to mark the talk as cancelled. +2. Update the `schedule-choices` block to fix the time for the following talk, or recalculate all the schedules. Check for any validation errors in the `:results:` block. +3. When you’re happy with the schedule, run the `draft-schedule` block. +4. Update the talk page to add CANCELLED to the title. +5. Publish the wiki and doublecheck it. + - Talk gone from the schedule? + - Talk listed among the cancelled talks? + - Talk page has cancelled info? +6. Remove the talk from the [one-track emergency schedule](#one-track) -This is the model we’ve been using: -[audio-denoiser-model-mp.rnnn](https://media.emacsconf.org/misc/audio-denoiser-model-mp.rnnn) (download link) +### Last-minute prerecording submission -Source: [rnnoise-models](https://github.com/GregorR/rnnoise-models), Model: [marathon-prescription](https://raw.githubusercontent.com/GregorR/rnnoise-models/master/marathon-prescription-2018-08-29/mp.rnnn) +- CHECK will copy it from the FTP upload server to ${protected} and name it appropriately. +- CHECK will notify STREAM with the scp command and the mpv command so that STREAM can choose. -You should always apply the filter on the original’s audio, as opposed -to an Audacity-processed audio. This is to ensure that we have the most -information about the signal, which means we can have gather the most -information about the noise-profile. -Following is the ffmpeg incantation to use to apply the filter-model. -Make sure to modify the `DENOISER` variable and adapt input/output. +### Last-minute caption update - DENOISER="/path/to/audio-denoiser-model-mp.rnnn" - input="original.opus" - output="denoised.opus" - ffmpeg -i "$input" -af "arnndn=m=$DENOISER" "$output" +- CHECK uploads the –main.vtt file to ${protected} +- CHECK notifies STREAM via ${upcoming} +- STREAM uses the provided commands to download the VTT file and load it into MPV with `--sub-file` -There’s no need to customize the libopus export information; the default -is more than enough for human-speech. -When you’re done with this step, you can then process the outputted -audio-track with Audacity, skipping the denoising steps (1 to 5). +### Speaker has not checked in +- Let the previous talk run a little longer for Q&A; end at least in time for the prerec +- After the previous Q&A wraps up, play the prerec +- [? still not around after prerec finishes] + - HOST: Speaker might be having some difficulty connecting, but we’ll collect your questions on the pad and send them afterwards. + - Can play next prerec a few minutes early -#### Questions? -If you’ve got any question on the process, you canget in touch with me (zaeph)! +### Speaker does not have a prerec and has not checked in +- Let the previous talk do live Q&A/demo if ready +- Close to the time of the missing talk: + - See if any of the previous speakers want to be set up for an impromptu talk/extension in a BBB room, just in case + - HOST: The next speaker might be having some difficulty connecting. In the meantime, let’s… + - OR: + - highlight ongoing discussions + - invite another speaker for an impromptu extension; mplsCorwin will keep a list of possible speakers who are still active + - replay a short prerec + - let mplsCorwin or zaeph fill in - -## When a talk is captioned +### Speaker whose talk was reallocated shows up and has a prerec -- Combine captions with talk -- Upload captions to YT and Toobnix -- Prepare captions for wiki inclusion +- CHECK copies it to ${protected} +- Plan to play prerec at the end of the day, or in any gaps if a live talk falls through - +### Speaker whose talk was reallocated shows up and wants to do it live -## Other tasks before the conference +- See if there’s enough time if buffers are shuffled back; if so, set up for a live presentation +- Check for alternate stream volunteers +- [? not enough time] Offer to set up a BBB room for recording or to + accept a prerecording afterwards, then include it on the site and in + post-conference communication -- Coordinate volunteer schedules so all the roles are covered +### Alternate stream volunteer wants to stream (nice to have, at risk) -### TODO Update ansible configuration :sachac: +- CHECK gives ALTERNATE the BBB room URL for the talk they are interested in +- ALTERNATE starts streaming to assigned end point +- CHECK confirms stream +- CHECK updates ${stream-status} +- CHECK notifies STREAM and HOST + - After prerec plays: + - HOST: This talk has an extended demo/Q&A. You can go to ${alternate-url} to watch it, and we’ll post a recording afterwards. + - HOST sends ${alternate-url} to IRC: Alternate stream for ${title}: ${alternate-url} +- ALTERNATE notifies #emacsconf-org when the stream is done. +- CHECK updates ${stream-status} to note that the alternate stream is finished. + + FFMPEG process for sending the desktop and audio to the $CONFALT mountpoint on Linux with X11 and Alsa: + + 1. Set the CONFALT environment variable to icecast://user:password@live0.emacsconf.org:8000/alt.webm + 2. Install pavucontrol if you don’t have it already. + 3. Start the following command (: + + while true; do ffmpeg -loglevel 0 -ar 48000 -f alsa -channels 2 -sample_rate 48000 -i default -re -video_size 1280x720 -framerate 25 -f x11grab -i :0.0 -cluster_size_limit 2M -cluster_time_limit 5100 -content_type video/webm -c:v libvpx -b:v 1M -crf 30 -g 125 -deadline good -threads 4 -f webm $CONFALT; done + 4. Use pavucontrol to set the recording source for the ffmpeg + command to be the audio monitor, so you get system output as + well. + - OR: + - [? splitting audio] (look for “Set up sinks for sound” under 2021/) + - [? same audio] + - Set up audio monitor as the input for FFMPEG + - MPV goes to MPV sink, browser goes to recording sink, FFMPEG takes in recording monitor -in prod-vars.yml -media\_protect\_root: true -icecast\_save\_dump: false +### Pad malfunction or mess-up -Clean up the media root +- PAD resets the pad using +- [? still not recovered] + - PAD reimports the pad from backup -then -ansible-playbook -i inventory.yml prod-playbook.yml –tags media,stream +### CRDT malfunctions +- HOST notifies CHECK and tries reconnecting +- [? still doesn’t work] + - Switch to backup Etherpad -### Test stream setup -[Stream](#other-streams) +### Conduct guidelines issue +- HOST addresses it (on-camera if needed) with a reminder and/or a kick or a ban -### Set up MPV for captions +### CHECK is unavailable -#### mpv profile +- HOST does check-ins +- HOST refers to conf.org for Q&A preference etc. +- STREAM checks conf.org for prerec filenames etc. +- Dropped goals: + - Publishing recordings ASAP + - Updating schedule/wiki on the fly -Add the following profile to `~/.config/mpv/mpv.conf`: - # Uncomment this line to load the profile by default - # Otherwise, use `--profile=emacsconf-talks` - # profile=emacsconf-talks - - [emacsconf-talks] - # Positioning - video-zoom=-0.15 - video-pan-y=-0.055 - sub-use-margins=yes - sub-scale-by-window=yes - sub-pos=103 - sub-margin-x=150 - sub-margin-y=40 - # Style - sub-font="Clear Sans Bold" - sub-color="1/0.82/0" - sub-blur=0.2 - sub-scale=0.9 - sub-font-size=40 - sub-border-size=0 - sub-border-color=0/1 - sub-shadow-color=0/1 - sub-shadow-offset=1.2 - sub-ass-force-style=Kerning=yes - sub-ass-line-spacing=0 +### HOST is unavailable -(Thanks, zaeph) +- STREAM joins the BBB room and streams directly from there (or streams the prerecs). +- STREAM will do the hosting. -#### Font: Clear Sans +### Technical issues during a live presentation -Links: +- HOST tries to contact the speaker +- [? back on track] + - [? can be squeezed into remaining time]: Continue + - [? need extra time]: CHECK fiddles with buffer of following talks in conf.org and updates schedule + - [? need too much extra time (ex: 10min)]: HOST acknowledges + technical issues and says we may be able to follow up after the + conference +- [? can’t resume]: HOST acknowledges technical issues and says we may + be able to follow up after the conference -- tar.gz with all fonts: [from zaeph’s server](https://zaeph.tk/files/emacsconf/captions/fonts.tar.gz) (more convenient) -- WOFF from GitHub repo: [clear-sans/WOFF at main · intel/clear-sans](https://github.com/intel/clear-sans/tree/main/WOFF) +### Big technical issues with streaming -### Download prerecorded videos from ${protected} +- HOST notifies #emacsconf and #emacsconf-org and adds a note at the top of the ${pad}. +- HOST updates the 2021.md wiki page +- CHECK publishes prerecordings + - media.emacsconf.org + - wiki + - Toobnix + - Peertube +- STREAM e-mails the mailing list -- STREAM: Download prerecorded videos from ${protected} - - rsync -avzue ssh front:/var/www/media.emacsconf.org/2021/protected/*--main.webm . +### live0 can’t handle the load or is close to network transfer limit - +- OR: + - Redirect some viewers via asking in #emacsconf: + - watch via main-480p + - watch via Toobnix (if we can get that working) + - Consider dropping the restream to Toobnix (lower audience?) or to Youtube + - Add additional node to Linode account for shared transfer pool (TODO: doublecheck) -## During the conference +### People have a hard time seeing dark-mode presentations (or light-mode) -### Set up +mpv –vf=negate $url -#### Arrange screens +### Schedule update -- CHECK: - - Share ${upcoming}, ${playbook}, and ${conf} via CRDT: `conf-crdt-connect-and-share` - - Current schedule, filenames/commands for playing, Q&A preference, IRC nick, pronunciation, intro notes, prerec duration, emergency contact information - - `conf-upcoming-add-subtree` - - Have #emacsconf-org, #emacsconf, #emacsconf-accessible, and #emacsconf-questions open - - Use `/opall` to get op privileges in all the channels - - Start backup process for pad - - while true; do - curl https://etherpad.wikimedia.org/p/emacsconf-2021/export/html > emacsconf-$(date +"%Y%m%d-%H%M%S").html - sleep 15m - done - - Computer for alternate streaming: - - Open browser for joining BBB - - Open MPV for playing -- HOST: - - rsync the newest –main.webm from front: rsync -avze ssh front:/var/www/media.emacsconf.org/2021/protected/\*–main.webm . - - Check OBS scenes for sharing windows/tabs as a virtual camera: - - chat.emacsconf.org with #emacsconf - - Etherpad - - Schedule - - next talk page - - Clock with current time on screen: `watch TZ=America/Toronto date` - - Set up backchannel for easy viewing - - ${upcoming} - - \#emacsconf-org and #emacsconf channels - - (?) Join organizer room S +- Test it using the blocks near the beginning of conf.org +- emacsconf-publish-update-schedule +- E-mail affected speakers - see emacsconf-mail-schedule-update function -#### Start streaming :stream: +### New talk -- HOST: Display getting-ready message and start streaming to main.webm -- HOST: Confirm that the stream is live at -- B: Update ${status} to say that the stream is live -- CHECK: Start low-resolution stream, confirm at - Call this on live0 with $CONF480PASS as the first parameter. The Icecast configuration is on `live0` at =. - - PASS=$1 - while true; do ffmpeg -loglevel 24 -f webm -reconnect_at_eof 1 -reconnect_streamed 1 -re -i http://localhost:8000/main.webm -vf scale=854:480 -f webm -c:a copy -b:v 500k -maxrate 1M -bufsize 1M -content_type video/webm -c:v libvpx icecast://ec2020main480pmu:$PASS@localhost:8000/main-480p.webm; done -- CHECK: Start Youtube and Toobnix streams. Call this with $YOUTUBE1PASS, $YOUTUBE2PASS, or $TOOBNIX as the parameter - - MOUNT=$1 - while true; do ffmpeg -loglevel 24 -i http://localhost:8000/main.webm -cluster_size_limit 2M -cluster_time_limit 5100 -b:v 1M -crf 30 -g 125 -deadline good -threads 4 -vcodec libx264 -acodec libmp3lame -f flv $MOUNT; done -- CHECK: Verify YouTube and Toobnix streams and the CPU load on live0. -- CHECK: Set the YouTube and Toobnix streams to public. -- B: Verify with #emacsconf that the stream is active. -- CHECK: Play main stream on alternate laptop. Start alternate stream and verify. Update ${status}. -- CHECK: Announce on Twitter (@emacs, @emacsconf, @sachac) and in #emacs - EmacsConf 2021 starting now: +- Create entry in conf.org +- Fit it into the schedule using the emacsconf-schedule-plan variable +- When happy, execute the draft-schedule block to update the SCHEDULED properties +- emacsconf-generate-talk-page +- emacsconf-update-schedule +- emacsconf +- emacsconf-stream-generate-assets-for-talk -##### Stream + +# Task archive -###### Low-res stream -Needs the `$main480p` environment variable set to something of the form `icecast://username:password@site:port/mount-point.webm`. Icecast configuration can be found on `live0` at `/etc/icecast2/icecast.xml`. It was okay to run this command directly on `live0` in 2020, since that kept the speed at roughly 1x. +## DONE Write preparation instructions :zaeph: - while true; do ffmpeg -f webm -reconnect_at_eof 1 -reconnect_streamed 1 -re -i http://localhost:8000/main.webm -vf scale=854:480 -f webm -c:a copy -b:v 500k -maxrate 1M -bufsize 1M -content_type video/webm -c:v libvpx $main480p done +2021/prepare.md can be reused. +Extra stuff to consider adding: -###### Youtube +- DONE Suggestions for themes (especially wrt colourscape) +- DONE “Please don’t squeeze your talk by fast-forwarding your speech. Trimming silences and filler words can help, though. Sometimes it’s easier to write, record, and edit your voiceover, and then record the video to go along with it.“ +- DONE Allowing speakers to plant questions, esp. to cover tangential stuff that couldn’t fit in the prerec -### Check in a speaker +## CANCELLED Allocate extra time if possible; send e-mail :sachac: -Exception: [CHECK is unavailable](#check-gone) -- Speaker checks in on #emacsconf-org via IRC or via e-mail ~30m before -- CHECK notes IRC nick for speaker. -- CHECK confirms Q&A preference: live/IRC/Etherpad, preferred way of getting questions -- [? unknown] Thanks for checking in! How would you like to handle Q&A - today - live video, the collaborative Etherpad at - , or IRC (like - this)? -- [? IRC] Thanks for checking in! Feel free to keep an eye on - \#emacsconf for questions and discussion, and we’ll copy things from - the pad to there. If the volume gets overwhelming, let us know and - we can forward questions to #emacsconf-questions for you. If you’d - like to try Q&A over live video or the collaborative pad instead, or - if you need help, please let us know. -- [? Etherpad] Thanks for checking in! The collaborative pad we’ll be - using for questions is at - . We’ll collect - questions from #emacsconf and put them there. If you’d like to jump - to your part of the document, you might be able to keep an eye on - questions. Please let us know if you need help, or if you want to - switch to live Q&A. -- [? live] Thanks for checking in! I’ll send you some private messages - with instructions, so please check there. Let me know if you don’t - get them. - - Private messages: - - (erc-message “PRIVMSG” (format “%s You can use this BBB room: %s . I’ll join you there shortly to set up the room and do the last-minute tech check.” nick room-url)) - - (erc-message “PRIVMSG” (format “%s The collaborative pad we’ll be using for questions is at %s . We’ll collect questions from #emacsconf and put them there. If you’d like to jump to your part of the document, you might be able to keep an eye on questions. Alternatively, we can read questions to you.” nick conf-collaborative-pad)) - - (erc-message “PRIVMSG” (format “%s Leo Vivier will join when it’s time, and he will give you the go-ahead when it’s time to present. See you in the BBB room!” nick)) - - CHECK directs speaker to available room with `/checkin ` - - Speaker joins talk room - - CHECK makes speaker presenter and moderator, does last-minute tech check - - Hello, thanks - - Speaker tries screen sharing and webcam (optional) - - check screen readability - - CHECK briefs speaker on process, including: - - live Q&A: reading questions themselves (can do in any order, - can skip; coach possible responses for awkward things) or asking HOST to read questions to them - - HOST can share the pad or IRC; speaker shares screen only if doing demo - - encouragement of webcam, although it’s optional - - how HOST will join shortly before the prerec ends and then - give them the go-ahead - - closing any tabs watching the stream as their talk starts - (otherwise the audio is confusing) - - If the speaker will be giving a live presentation, CHECK - collects emergency contact information (in case of technical - issues) and shares it with HOST in the CRDT buffer - - Okay to do other things until the prerec ends - - CHECK updates ${upcoming} with link to the talk room and - preferences for Q&A-. CHECK will also /msg the relevant - information. +## DONE Review metadata for speakers in conf.org :zaeph: +See the bottom of conf.org for some automated validation -#### bandali’s check-in steps -- please leave webcam quality on ’medium’ -- please read each audience question out loud before responding -- please mute stream on your machine if you’re watching -- would you like to stay around for a longer q&a? -- would you like to share your webcam or screen? (quickly mention how) +## DONE Review the submissions in the pad (see emacsconf-org-private or conf.org for the link) and add any objections or comments by Sept 26 for possible [early speaker notification](#acceptance), Oct 7 for everything :organizers: +- zaeph: will start reviewing on Sep 21 -### Present talk -- CHECK announces the next talk on IRC and marks the previous talk as done. (`conf-announce`) -- PAD clears pad colours. -- [? prerec] - - HOST switches to MPV scene in OBS and plays the video (with captions if available). - - Exception: [Last-minute prerecording submission](#last-minute-prerec) - - Exception: [Last-minute caption update](#last-minute-captions) - - [CHECK publishes information](#publish) - - [HOST gets a head start on handling Q&A](#questions) - - When prerec finishes, HOST switches the OBS scene to show BBB. -- [? live] - - Exception: [Speaker does not have a prerec and has not checked in](#really-missing) - - HOST joins the BBB room and double-checks that recording is on. - - CHECK-alternate joins the BBB room and pauses main MPV. - - HOST switches to OBS scene for BBB. - - Speaker presents. - - Exception: [Technical issues during a live presentation](#live-issues) - - [? talk needs to be wrapped up] - - HOST nudges speaker verbally. +## DONE Write preparation instructions :zaeph: +2021/prepare.md can be reused. -### Publish information +Extra stuff to consider adding: -- CHECK updates the schedule in: - - ${conf} - - ${upcoming} - - wiki -- CHECK publishes the video to media.emacsconf.org using `conf-publish-files` -- CHECK commits the wiki page and the captions for the talk. -- CHECK publishes the video on YouTube and ToobNix using `conf-video-share`. - - Update description: - - This video is available under the terms of the - Creative Commons Attribution-ShareAlike 4.0 International (CC - BY-SA 4.0) license. - - You can view it using free and open source software at - ${url} - - ${description} - - Mark it as public. - - Add it to EmacsConf 2021 playlist. - - Update title and description. - - Mark it as public. - - Doublecheck subtitles - - Add it to the EmacsConf 2021 playlist. -- [? live sections] - - CHECK does a rough-cut of the recording from ${dump} to get the last X minutes or by time range. There’s about a 1-2 minute delay. - Ex: `(kill-new (conf-dump-get "alt" "10:24" "10:30" "qa_"))` - - When there’s an opportunity to do so: - - CHECK finetunes the rough-cut recording (trim start and end) and posts it to: - - media.emacsconf.org/2021 - - wiki page for talk +- DONE Suggestions for themes (especially wrt colourscape) +- DONE “Please don’t squeeze your talk by fast-forwarding your speech. Trimming silences and filler words can help, though. Sometimes it’s easier to write, record, and edit your voiceover, and then record the video to go along with it.“ +- DONE Allowing speakers to plant questions, esp. to cover tangential stuff that couldn’t fit in the prerec -### Handle Q&A +## DONE Add more submissions (CFP deadline Sept 30) :sachac: -Exceptions: +- Sacha: Add submissions to emacsconf-2022-private, draft 2-day schedule by Oct 10 -- [Speaker has not checked in](#missing) -- [? live] - - CHECK-alternate joins the BBB room and pauses MPV. - - HOST joins the BBB room - - HOST starts recording in BBB or confirms that it’s already recording - - HOST switches to the BBB scene in OBS. - - HOST describes how to ask questions. - - [? No questions yet] - - HOST thanks speaker, says nice things about talk, and asks a couple of prepared questions - - [? Awkward question] - - HOST can try rephrasing the question. - - HOST adds note to IRC/Etherpad that speakers can answer in any order, skip questions, answer afterwards, etc. - - [? Q&A needs to be wrapped up] - - HOST writes in Etherpad/IRC or nudges speaker verbally. - - CHECK notes the time that the live Q&A finished and switches back to the main stream on CHECK-alternate. -- [? IRC/pad] - - HOST switches to pad/chat OBS scene. - - HOST describes Q&A method and shows it on the screen. - - While there’s buffer time before the next talk, HOST can read out - questions and answers, or transition to the next talk early - - HOST: It’s time for the next talk, but if you want to keep - discussing the previous talk, please feel free to continue doing - so on IRC or the pad. -- [? speaker will answer after the conference] - - HOST switches to pad/chat OBS scene. - - HOST says the speaker is not available right now, but we’ll - forward the questions to the speaker and we’ll post the speaker’s - answers on the wiki page. Leave your contact information if you - want to be notified, or subscribe to the emacsconf-discuss mailing - list to get the announcement. Please feel free to continue - discussing the talk on IRC or the pad. -- [Present next talk](#present) +## DONE Publish talk pages :sachac: -\* +## DONE Send early acceptances :sachac: -### During each talk +Ideal sequence: -- Volunteers: post links/resources/descriptions/captions (depending on your level of energy) to #emacsconf-accessible -- Volunteers: making sure questions get posted somewhere the speaker can see them +1. publish /2022/prepare (zaeph) +2. publish wiki pages +3. send acceptance e-mails + - Allocate at most 20 minutes, say we’ll try to add more time depending on the schedule (probably know by Sept 30 or Oct 1) + - Include review comments +4. Send an additional e-mail introducing speakers who may want to coordinate -### Break time +## DONE Prepare to export talk information to wiki :sachac: -- CHECK marks the last talk as done. `conf-end-current-talk` -- CHECK stops and restarts the Toobnix restreaming process, and re-checks the stream -- CHECK uses `conf-upcoming-add-subtree` to add the afternoon talks to upcoming.org -- HOST doublechecks network transfer limit and server health +Tested code in a fork, can publish talk information once talks are approved. +emacsconf-publish.el +emacsconf-generate-info-pages +emacsconf-generate-main-schedule +emacsconf-generate-talk-pages -### End of stream +## DONE Give access to emacsconf-2022-private to dto :zaeph: -- CHECK removes live Q&A links -- CHECK stops ffmpeg process for Youtube -- CHECK stops ffmpeg process for Toobnix -- CHECK stops ffmpeg process for main-480p -- STREAM stops streaming -- B updates the status pages -- bandali figures out the downstream +## DONE Write better subtitle documentation :sachac: - + + +That will help more people subtitle things -## After the conference +## DONE Write volunteer page :sachac: -### Send thanks + -[Thank you, next steps](#thanks) +## DONE Review the submissions in the pad (see emacsconf-org-private or conf.org for the link) and add any objections or comments by Sept 26 for possible [early speaker notification](#acceptance), Oct 7 for everything :organizers: -### Extract the opening and closing remarks +- zaeph: will start reviewing on Sep 21 -### Extract the Q&A recordings, trimming as needed +## DONE Double-check sachac’s timezone conversions for availability :zaeph: -From +zaeph helped with this, even catching some based on e-mail timestamps - console.log([...document.querySelectorAll('.email-link')].map((o) => '| ' + o.closest('tr').querySelector('time').getAttribute('datetime') + ' | ' + o.closest('tr').querySelector('#recording-text').innerHTML.trim() + ' | ' + o.getAttribute('data-pres-link').trim() + ' |').join('\n')) -Make an `ids.txt` with the IDs extracted from BBB. +## DONE Copy things over from previous notebooks :sachac: -In the same directory: - while read p; do - mkdir -p "$p"; - cd "$p"; - wget "https://bbb.emacsverse.org/presentation/${p}/slides_new.xml" \ - "https://bbb.emacsverse.org/presentation/${p}/video/webcams.webm" \ - "https://bbb.emacsverse.org/presentation/${p}/deskshare.xml" \ - "https://bbb.emacsverse.org/presentation/${p}/deskshare/deskshare.webm" \ - "https://bbb.emacsverse.org/presentation/${p}/metadata.xml" - cd ..; - done -- **slides\_new.xml:** Text chat -- **webcams.webm:** Webcam as video stream, also has audio -- **deskshare.xml:** start and stop time of desktop sharing, if any -- **deskshare.webm:** Shared desktop as video -- metadata.xml +- With JS and grid CSS: +- Fallback -Probably focus on grabbing the audio first and seeing what’s worth keeping +Draft: - (defun emacsconf-extract-chat (slug speaker) - (interactive (list - (emacsconf-complete-talk) - (completing-read "Speaker: " - (seq-uniq - (mapcar (lambda (node) (dom-attr node 'name)) - (dom-by-tag (xml-parse-region (point-min) (point-max)) 'chattimeline))) - ))) - (let ((text - (mapconcat (lambda (node) - (when (string= (dom-attr node 'target) "chat") - (let ((message - (replace-regexp-in-string - "\\(^[^ +]?\\): " "" - (replace-regexp-in-string "\\(.+?\\)" - "<\\1>" (dom-attr node 'message))))) - (if (string-match speaker (dom-attr node 'name)) - (format "- %s: %s\n" speaker message) - (format "- %s\n" message))))) - (dom-by-tag (xml-parse-region (point-min) (point-max)) 'chattimeline) - ""))) - (emacsconf-edit-wiki-page slug) - (if (re-search-forward "# Discussion" nil t) - (progn - (goto-char (match-end 0)) - (insert "\n\n")) - (goto-char (point-max))) - (kill-new text))) - ;; TODO: Combine lines from same nick, or identify speakers with anon1/2/etc. - (defun emacsconf-extract-chat-from-dired () - (interactive) - (find-file (expand-file-name "slides_new.xml" (dired-get-file-for-visit))) - (call-interactively 'emacsconf-extract-chat)) - (defun emacsconf-make-webcams-deskshare-spans (deskshare start-ms stop-ms strategy source-dir) - (let ((secs (/ start-ms 1000.0)) - (webcam-video (expand-file-name "webcams.webm" source-dir)) - (deskshare-video (expand-file-name "deskshare.webm" source-dir)) - spans) - (mapc (lambda (o) - (unless (or (= secs (string-to-number (dom-attr o 'start_timestamp))) - (= (string-to-number (dom-attr o 'start_timestamp)) 0) - (> secs (/ stop-ms 1000.0))) - (setq spans (cons (list :source webcam-video - :start-ms (* secs 1000) - :stop-ms - (* 1000 - (if (eq strategy 'test) - (+ secs 3) - (max secs (string-to-number (dom-attr o 'start_timestamp)))))) - spans))) - (when (and (<= (string-to-number (dom-attr o 'start_timestamp)) - (/ stop-ms 1000.0)) - (>= (string-to-number (dom-attr o 'stop_timestamp)) - (/ start-ms 1000.0))) - (setq spans (cons (list :source deskshare-video - :start-ms (max (* 1000 (string-to-number (dom-attr o 'start_timestamp))) - start-ms) - :stop-ms - (if (eq strategy 'test) - (* 1000 (+ (string-to-number (dom-attr o 'start_timestamp)) 3)) - (min (* 1000 (string-to-number (dom-attr o 'stop_timestamp))) - stop-ms))) - spans)) - (setq secs (string-to-number (dom-attr o 'stop_timestamp))))) - (dom-by-tag deskshare 'event)) - (unless (>= (floor (* secs 1000)) stop-ms) - (setq spans (cons (list :source webcam-video - :start-ms (* 1000 secs) - :stop-ms (if (eq strategy 'test) - (* 1000 (+ secs 3)) - stop-ms)) - spans))) - (if (eq strategy 'test) - `((video ,@(reverse spans)) - (audio ,@(mapcar (lambda (o) - (list :source webcam-video - :start-ms (plist-get o :start-ms) - :stop-ms (plist-get o :stop-ms))) - (reverse spans)))) - `((video ,@(nreverse spans)) - (audio (:source ,webcam-video :start-ms ,start-ms :stop-ms ,stop-ms)))))) - - (defun emacsconf-get-ffmpeg-to-splice-webcam-and-recording (slug start-ms stop-ms info &optional strategy) - "Return FFMPEG command for slicing. - Strategies: - - 'fast-cut-start-keyframe - find the keyframe before the start ms and cut from there, doing a fast copy. - - 'start-keyframe-and-reencode - find the keyframe before the start ms and cut from there, reencoding. - - 'cut-and-concat - seek to the keyframe before, slowly find the start-ms, reencode the snippet, and then do a fast copy of the remaining. May have encoding errors. - - default: copy from start-ms to stop-ms, reencoding. - " - (let* ((source-dir (expand-file-name (concat "../questions/by-slug/" slug) emacsconf-captions-directory)) - (video-slug (plist-get (seq-find (lambda (o) (string= (plist-get o :slug) slug)) info) :video-slug)) - (output (expand-file-name (concat video-slug "--answers.webm") emacsconf-captions-directory)) - (webcam-video (expand-file-name "webcams.webm" source-dir))) - (if (file-exists-p (expand-file-name "deskshare.webm" source-dir)) - ;; Has deskshare - (let* ((deskshare (xml-parse-file (expand-file-name "deskshare.xml" source-dir))) - (final-size (compile-media-max-dimensions - (expand-file-name "deskshare.webm" source-dir) - (expand-file-name "webcams.webm" source-dir))) - (duration (compile-media-get-file-duration-ms (expand-file-name "webcams.webm" source-dir))) - (spans (emacsconf-make-webcams-deskshare-spans deskshare start-ms stop-ms strategy source-dir)) - (compile-media-output-video-width (car final-size)) - (compile-media-output-video-height (cdr final-size))) - (compile-media-get-command spans output)) - ;; Just webcams - (compile-media-get-command - (compile-media-split-tracks - (list (list :source webcam-video :start-ms start-ms :stop-ms stop-ms))) - output)))) +### DONE Set up main schedule as plain text -Make a table of the form +general track +day 1 and day 2 - +dev track +day 1 and day 2 +by day +all talks ---+### DONE Set up talk page navigation -+- program phase: by track +- schedule phase: chronological + + +### CANCELLED See if I can get the schedule to split into a nice grid on larger devices that support it + +Slightly annoying to do with JS/CSS because I want it to fall back to an interleaved schedule on small screens, so we would probably need to duplicate the elements and then use media queries. + + +## DONE Process confirmations as we receive them :sachac:zaeph: + +- Reply to the speaker and Cc -submit to confirm the confirmation. Something like “Confirming your confirmation, no reply needed to this one. Thank you!” +- Update talk to WAITING\_FOR\_PREREC in conf.org +- Add a note in the logbook (C-c C-z - org-add-note) for the talk entry +- Add :PUBLIC\_EMAIL: t if given permission to use the e-mail on the + talk page, or set it to an alternative e-mail if provided. +- Update the public wiki’s ${year}/talks/{$slug}.md page to add the + e-mail address as on the speaker + information line. +- At some point, use `M-x emacsconf-generate-talk-pages` to update the e-mail address used in the footer. + + (let (waiting) + (save-window-excursion + (with-current-buffer (find-file emacsconf-org-file) + (org-map-entries (lambda () (add-to-list 'waiting + (list (org-entry-get (point) "SLUG") + (org-entry-get (point) "ITEM")))) "TODO=\"TO_CONFIRM\""))) + waiting) + + +## CANCELLED Create Org heading for scheduling caption team’s live IRC duty shifts :dto: + +See [Shifts](#shifts) + + +## DONE Sacha: Organize volunteer information :sachac: + + +## DONE Once talks are approved + +- sacha: Publish initial talk information pages +- Double-check talk pages, format them nicely +- Publish draft schedule +- Confirm e-mail communication with all of the speakers + +Process for accepting a talk: + +- Create subtree for talk and populate it with properties. + - Required: CUSTOM\_ID SLUG NAME NAME\_SHORT EMAIL AVAILABILITY Q\_AND\_A TRACK MAX\_TIME + - Optional: PRONOUNS PRONUNCIATION IRC PUBLIC\_EMAIL MIN\_TIME EMERGENCY + - Can be validated with `emacsconf-validate-talk-subtree` + - Add a talk abstract subtree +- Add it to emacsconf-schedule-plan and fiddle with it until the flow looks good +- Execute the draft-schedule block to update the schedule in the Org file +- Add the talk page to the wiki with `emacsconf-add-talk-page`. +- Stage, commit, and push the wiki files. Make sure to add the talk page and the info pages. +- Doublecheck the wiki page on the web, since the e-mail refers to it. +- E-mail the speaker the acceptance by using `emacsconf-draft-acceptance-for-email-group` from `organizers-notebook/`. +- Log the acceptance using `C-c C-z` in the talk subtree in `conf.org`, noting the number of minutes. +- Change the status to TO\_CONFIRM. + + +## DONE Remind people about confirming e-mail communications :sachac:email:speakers: + +Look for the TO\_CONFIRM status in conf.org, probably include in schedule e-mail + + + + +## DONE Send people schedule information and doublecheck their availability/Q&A preference :sachac:email:speakers:sched: + + (defun emacsconf-mail-schedule (group &optional template) + "Send draft schedule. + GROUP is (email . (talk talk))" + (interactive (list (emacsconf-mail-complete-email-group))) + (require 'emacsconf-ical) + (let ((reply-by-date (date-to-time "2022-10-14")) + (draft-schedule (concat emacsconf-base-url emacsconf-year "/draft-schedule/"))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "check-sched")) + (car group) + (list + :titles + (mapconcat (lambda (o) (format "%s: %s" + (plist-get o :slug) + (format-time-string + "%b %-e %-I:%M %#p %Z" + (plist-get o :start-time) + emacsconf-timezone))) + (cdr group) "; ") + :draft-schedule + draft-schedule + :speakers-short + (plist-get (cadr group) :speakers-short) + :plural + (if (= (length (cdr group)) 1) "" "s") + :email + (plist-get (cadr group) :email) + :year + (or (plist-get (cadr group) :year) emacsconf-year) + :coordination-note + (if (seq-find (lambda (o) (member (plist-get o :slug) '("journalism" "rolodex" "orgsuperlinks" "buttons" "hyperorg" "science"))) + (cdr group)) + "I've changed the order slightly from the coordination e-mail I sent you. The sequence is now journalism - science - rolodex - orgsuperlinks - buttons - hyperorg. science is now second instead of last, and the first two talks are on Sat while the last four are on Sun. That probably means you don't have to coordinate as much, but you can still do so if you would like to build on other people's talks." + "") + :schedule + (mapconcat + (lambda (o) (format "* TODO Check time for \"%s\" (%s) :emacsconf:\nDEADLINE: %s\n(Not a hard deadline, just encouragement to e-mail us before that date if you can)\nPlease e-mail [[mailto:emacsconf-submit@gnu.org]] if you need it changed\n%s track\n%s\nIn context: %s" + (plist-get o :title) + (plist-get o :slug) + (format-time-string (car org-time-stamp-formats) reply-by-date emacsconf-timezone) + (plist-get o :track) + (string-join + (let ((emacsconf-timezones + (if (plist-get o :timezone) + (seq-uniq (append (list emacsconf-timezone) + (split-string (plist-get o :timezone) " ") + (list "UTC"))) + emacsconf-timezones))) + (emacsconf-timezone-strings o)) + "\n") + draft-schedule)) + (cdr group) + "\n----------------------------------------------------------------\n") + :reply-by + (format-time-string "%b %-e (%a)" reply-by-date emacsconf-timezone) + :timezone-note + (if (plist-get (cadr group) :timezone) + (format "I've included timezone conversion to %s. Let me know if you'd like me to use a different timezone in future e-mails." + (plist-get (cadr group) :timezone) " ") + "I can translate times into your local timezone. Let me know what timezone you'd like me to use.") + :availability-note + (cond + ((seq-find (lambda (o) (string-match "yes" (or (plist-get o :availability) ""))) (cdr group)) + (format "I think you've indicated that you're available during the conference.")) + ((seq-find (lambda (o) (string-match "not indicated" (or (plist-get o :availability) ""))) (cdr group)) + (format "I think you didn't indicate any particular availability constraints in your submission.")) + (t (format "I think it respects your indicated availability, which we've noted as %s." + (string-join + (seq-uniq + (mapcar + (lambda (o) (format "\"%s\"" (plist-get o :availability))) + (cdr group))) + " and ")))))))) + + (defun emacsconf-mail-schedule-update (group &optional template) + "Send draft schedule update. + GROUP is (email . (talk talk))" + (interactive (list (emacsconf-mail-complete-email-group))) + (require 'emacsconf-ical) + (let ((reply-by-date (date-to-time "2022-10-14")) + (draft-schedule (concat emacsconf-base-url emacsconf-year "/draft-schedule/"))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "check-sched")) + (car group) + (list + :titles + (mapconcat (lambda (o) (format "%s: %s" + (plist-get o :slug) + (format-time-string + "%b %-e %-I:%M %#p %Z" + (plist-get o :start-time) + emacsconf-timezone))) + (cdr group) "; ") + :draft-schedule + draft-schedule + :speakers-short + (plist-get (cadr group) :speakers-short) + :plural + (if (= (length (cdr group)) 1) "" "s") + :email + (plist-get (cadr group) :email) + :year + (or (plist-get (cadr group) :year) emacsconf-year) + :coordination-note + (if (seq-find (lambda (o) (member (plist-get o :slug) '("journalism" "rolodex" "orgsuperlinks" "buttons" "hyperorg" "science"))) + (cdr group)) + "I've changed the order slightly from the coordination e-mail I sent you. The sequence is now journalism - science - rolodex - orgsuperlinks - buttons - hyperorg. science is now second instead of last, and the first two talks are on Sat while the last four are on Sun. That probably means you don't have to coordinate as much, but you can still do so if you would like to build on other people's talks." + "") + :schedule + (mapconcat + (lambda (o) (format "\"%s\" (%s)\n%s track\n%s\nIn context: %s" + (plist-get o :title) + (plist-get o :slug) + (plist-get o :track) + (replace-regexp-in-string + "^\\(.*\\)\n\\(.*\\)" + "\\1\nIn other timezones:\n\\2" + (string-join + (let ((emacsconf-timezones + (if (plist-get o :timezone) + (seq-uniq (append (list emacsconf-timezone) + (split-string (plist-get o :timezone) " ") + (list "UTC"))) + emacsconf-timezones))) + (emacsconf-timezone-strings o)) + "\n")) + draft-schedule)) + (cdr group) + "\n----------------------------------------------------------------\n") + :reply-by + (format-time-string "%b %-e (%a)" reply-by-date emacsconf-timezone) + :timezone-note + (if (plist-get (cadr group) :timezone) + (format "I've included timezone conversion to %s. Let me know if you'd like me to use a different timezone in future e-mails." + (plist-get (cadr group) :timezone)) + "I can translate times into your local timezone. Let me know what timezone you'd like me to use.") + :availability-note + (cond + ((seq-find (lambda (o) (string-match "yes" (or (plist-get o :availability) ""))) (cdr group)) + (format "I think you've indicated that you're available during the conference.")) + ((seq-find (lambda (o) (string-match "not indicated" (or (plist-get o :availability) ""))) (cdr group)) + (format "I think you didn't indicate any particular availability constraints in your submission.")) + (t (format "I think it respects your indicated availability, which we've noted as %s." + (string-join + (seq-uniq + (mapcar + (lambda (o) (format "\"%s\"" (plist-get o :availability))) + (cdr group))) + " and ")))))))) + + +### Template + +Hi, ${speakers-short}! + +Here’s the tentative schedule for when your EmacsConf talk${plural} +will be streamed. Your talk${plural} will be streamed once, but I’ve +included a few timezone conversions for convenience. + +--- + +${schedule} + +--- + +${availability-note} You’ll also have time for Q&A afterwards, which +can be as short or as long as you like. We’ll send you more +information about how the Q&A will work as the conference gets closer. + +If you’d like to see the other talks for context, you can check out +the draft schedule at . +The times may move around a bit as we update the schedule, so I’ll +check in with you if things change a lot. ${coordination-note} + +We’d like to publish the schedule this month, so we’d love to hear +from you by **${reply-by}** if the times don’t work for you. (We can +shuffle things around even after that date if something comes up.) +Also, if you think your talk${plural} would go better next to a +different talk, please let us know. ${timezone-note} Please keep +emacsconf-submit@gnu.org in To or Cc when replying. Thanks! + +Sacha + + +### Schedule change affecting dev + +(Please ignore the previous update, I included the wrong times in the +e-mail. The web version’s been fine, though! Sorry about the extra +e-mails.) + +I tweaked the schedule to put treesitter and lspbridge earlier, so +asmblox and wayland are a little later on Saturday morning. If you’d +like to see the latest schedule for your talk, you can go to + . Thanks for your +patience! + +--- + +${schedule} + +--- + +(no need to reply to this to confirm, unless I broke the schedule for +you and you want me to fix it) + +Sacha + + +### Schedule change for buddy/meetup + +Hi ${speakers-short}! + +I tweaked the schedule to allocate a little more time for the meetups +talk, and I moved the buddy talk earlier to make space. I think this +might improve the flow as well, since the meetups will refer to how +meeting up with a buddy is a good way to get a public Emacs meetup off +the ground. If you’d like to see the latest schedule for your talk, +you can go to . Thanks for your +patience! + +--- + +${schedule} + +--- + +(no need to reply to this to confirm, unless I broke the schedule for +you and you want me to fix it) + +Sacha + + +## DONE Volunteer communications: E-mail update for Oct 9, 2022 :email:volunteers: + +Add your news and requests to this. + + +### Template so far + +Hello, EmacsConf volunteers! + +We’re starting to gear up for EmacsConf 2022, and we would love to +figure out how to work with your skills, interests, and availability. + has some specific task ideas and +general roles. + + has an +overall prioritization matrix. If any of those options look like +something you want to learn or help with, or if you want to make +things even better than what’s in the table, let me know. + +Given the number of talks this year, we’re going to try to see if we +can pull off two tracks. I’ve posted a draft schedule at + and have e-mailed speakers +to confirm their availability. This schedule staggers live Q&A +sessions so that the person managing the streams can jump back and +forth as needed. We’ll figure out shifts once we’ve sorted out the +processes and training info, but if you want to call dibs on +something, feel free. + + +Please let me know what kinds of things you’d like to learn more about +or help out with! + +Sacha Chua + +(You’re receiving this e-mail because you’re on the emacsconf-org +mailing list. Thanks for wanting to help out!) + + +## DONE Delete all the EmacsConf BBB rooms from last year :chore:bbb:zaeph: + +For the admins on BBB. The list is accessible here: [Organization Settings](https://bbb.emacsverse.org/b/admins/rooms). +Should take no more than ~20′. + + +## DONE Write volunteer update + +Hello, folks! Here’s the weekly update on what’s happening backstage +for EmacsConf 2022 in case you notice something that you want to help +out with. =) + +- All the speakers have confirmed that they’ve gotten the acceptance + e-mails. Many speakers have confirmed that the schedule works for + them after I reshuffled a few talks for better availability. I’ve + posted the schedule at . We’ll + announce the schedule on the emacsconf-discuss mailing, Reddit, and + various places this week. + +- zaeph has been working on the ffmpeg incantations for preprocessing + the videos that will be submitted soon. bandali is working on + getting the FTP and web-based uploads sorted out so that speakers + can submit their videos. + +- I created some watch pages to support viewing different tracks: + . The livestreams won’t work yet + and it would be nice to figure out something that can dynamically + display info for recent/current/upcoming talks, but it’s a start. + +- We set up a self-hosted Etherpad (ex: + ) with an easy way to + redirect to using Wikimedia in case we run into scaling issues. I’ve + added it to our Ansible playbook + (git@git.emacsconf.org:pub/emacsconf-ansible) and I’m looking + forward to incorporating Ry P.’s improvements. Karl Voit gave + feedback on the first draft of the template. + +- vetrivln volunteered for some of the dev hosting shifts, Karl Voit + volunteered for some of the gen pad shifts, and FlowyCoder + volunteered for some of the gen check-in shifts. Thanks! + +Next week, we hope to: + +- Announce the EmacsConf 2022 schedule in the usual places (got any wording/JS/CSS suggestions?) +- Finalize the upload instructions so that speakers can start submitting their files +- Put together volunteer training materials +- Set up per-speaker BBB rooms and friendly URLs + +Sacha + + +## DONE Publish icals :sachac: + +It would be nice to have track-specific icals as well. + + + + +## DONE Figure out web-based file upload :needsowner:sachac:ansible: + +zaeph: I can work on it, but I’m not experienced in this domain, so I’d prefer to be a back-up. +task is currently with bandali + +Lesson learned from last year: “Since people kept running into ftp +problems, we might want to set up a web-frontend next year to minimise +problems.” + +Maybe we could ask some of the volunteers who wanted to help us with +the infra? It shouldn’t be complicated to deploy a ready-made +solution. + +“file drop” is a common keyword for looking for information. +Considerations: + +- Probably run it on media.emacsconf.org +- Bonus features: + - password-protected or hidden behind some kind of authentication or hidden behind some kind of URL, so we don’t have to worry too much about spam + - extra points for sending speakers links to upload to specific folders so that we can separate resources by talk + - Resumable uploads would be good, since some speakers had a hard time with unreliable connections +- What other conferences do: + - LibrePlanet uses plain FTP and recommends FileZilla + - FOSSDEM uses Pentabarf to receive uploads + - DebConf uses SReview(?) + - FOSSGIS uses Seafile +- Some options: + +
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
ProjectDockerBusterBaseNotes
https://www.projectsend.org/  php+mysql 
https://github.com/pomf/pomf  php+mysql 
https://github.com/psi-4ward/psitransferofficial nodecan set upload password, resumable; data volume needs uid 1000
https://github.com/epoupon/fileshelterofficialppaC++ 
https://github.com/mickael-kerjean/filestashofficial  general FTP client
https://gitlab.com/moejo42/Jirafeauofficial php 
https://github.com/YouTransfer/YouTransferofficial nodelooking for maint
https://github.com/dutchcoders/transfer.sh/    
https://github.com/eikek/sharry    
+ + - NextCloud + + anon FTP upload currently goes to *srv/ftp/anon* on media.emacsconf.org + + + + Maybe I’ll do psitransfer as a direct install - - +### DONE Create 2022/upload.md with the same workflow as last year for a start - - - - -Start -End -Slug -Notes -URL -Timestamp - - - - (defun emacsconf-process-qa-recordings (qa dir) - ;; (setq conf-qa-recordings qa) - ;; (memoize 'conf-ffmpeg-get-closest-keyframe-in-msecs) - ;; (memoize 'conf-ffmpeg-get-keyframes-between) - ;; (memoize 'conf-video-dimensions) - ;; (memoize 'compile-media-get-file-duration-ms) - ;; (memoize-restore 'conf-ffmpeg-get-keyframes-around) - - (let ((info (emacsconf-get-talk-info))) - (replace-regexp-in-string - "captions/" "answers-slow/" - (replace-regexp-in-string - dir "" - (string-join - (nreverse - (sort - (delq nil - (mapcar - (lambda (o) - (when (> (length (car o)) 0) - (emacsconf-get-ffmpeg-to-splice-webcam-and-recording - (elt o 2) - (compile-media-timestamp-to-msecs (elt o 0)) - (compile-media-timestamp-to-msecs (elt o 1)) - info))) - ; (seq-take qa 2) - qa - )) - (lambda (a b) (string-match "trim" a)))) - "\n"))))) +### DONE Implement new workflow -### Update the wiki + +## DONE Update IRC instructions because of multiple tracks -### Update captions +Added to watch pages -- Merge them into the video with `add-captions.sh` + + + +## DONE Move scheduling and publishing code to Emacs on a VPS so that other people can help out :sachac: + +Ideal: + +- Update pages with watching information, additional resources, etc. as talks go live +- Update the schedule as needed (cancelled or reordered talks, etc.) + +Where: + +- front? my own VPS? - #!/usr/bin/zsh - BASE="${1%.*}" - BASE="${BASE%--main}" - ffmpeg -y -i "$1" ${BASE}--main.vtt - if [ -f "${BASE}--normalized.webm" ]; then - ffmpeg -y -i "$1" -i "${BASE}--normalized.webm" -c:a copy -c:v copy "${BASE}--captioned.webm" - else - ffmpeg -y -i "$1" -i "${BASE}--compressed.webm" -c:a copy -c:v copy "${BASE}--captioned.webm" - fi - cp ${BASE}--main.vtt ${BASE}--chapters.vtt ~/vendor/emacsconf-wiki/2021/captions - scp "${BASE}--captioned.webm" "${BASE}--main.webm" - scp "${BASE}--main.webm" front:~/protected - scp "${BASE}--main.vtt" front:~/protected - scp "${BASE}--chapters.vtt" front:~/protected - ssh front 'cd protected; chmod ugo+r *' -- Update Toobnix and Youtube captions with `conf-video-share`. -- Update Toobnix and Youtube descriptions with chapters. -- Update ${conf-year}/${captions}/${slug}.md in the wiki. To make this from scratch, use `M-x conf-prepare-transcript-directives` from the talk heading in the conference Org file. + Nice if there’s an Ansible playbook + + sachac’s notes: + +- probably good to set it up on front + +It’s now on front. + + + + +## DONE Prepare email for nudging speakers to send prerec, and inform on upload workflow :timesensitive:needsowner: + + +### Code + + (defun emacsconf-mail-upload (group &optional template) + "Send upload instructions and reminder. + GROUP is (email . (talk talk))" + (interactive (list (emacsconf-mail-complete-email-group))) + (let ((action-date (date-to-time "2022-11-04"))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "upload")) + (car group) + (list + :slugs (mapconcat (lambda (o) (plist-get o :slug)) (cdr group) " or ") + :speakers-short (plist-get (cadr group) :speakers-short) + :plural (if (= (length (cdr group)) 1) "" "s") + :email (plist-get (cadr group) :email) + :year (or (plist-get (cadr group) :year) emacsconf-year) + :prerec-note (emacsconf-surround + (make-string 64 ?-) + (string-join (seq-uniq (mapcar + (lambda (o) + (plist-get o :prerec-info)) + (cdr group))) + "\n") + (make-string 64 ?-) + ""))))) + + +### Template + +Hi, ${speakers-short}! + +${prerec-note}Here are the instructions for uploading the +video${plural} for your talk${plural}. You can find the latest version +of the instructions at https://emacsconf.org/2022/upload/ . There are +two ways to upload your talk${plural} this year, so you can pick the +one that works best for you: + +- Web-based: , password emacsconf +- FTP: host: ftp-upload.emacsconf.org, port: 21, username: anonymous + folder: upload-here + +If you upload slides and other resources, we can include them on the +talk page when your talk goes live. If you happen to have a script or +a transcript, please include them as well (it’ll speed up the +captioning for us). + +Please add a comment or start your filenames with the ID for the talk +that it’s for: ${slugs}. + +If you’re still working on your talk, you might find the tips at + useful. In brief: + +- at least 1280x720 resolution +- we recommend dark text on a light background, with enough contrast + to make it easy to read +- if possible, use a headset or external microphone to record audio + in order to minimize computer noise +- upload a separate 5 second recording of quiet or leave 5 seconds + of quiet at the end of your talk video so that we can process your + video for noise reduction + +Please plan to upload your talk by November 4 (next Friday) so that we +can get started preparing it for streaming. If you can’t make it by +then, we can accept later submissions, although it’s a bit more of a +scramble and our stress levels go up as the conference approaches. =) +We’d really appreciate the extra time for captioning and +double-checking. Thank you for your help in getting ready for a smooth +EmacsConf 2022! + +Sacha Chua + + +## DONE Send backstage email + + (defun emacsconf-mail-backstage-info (group &optional template) + (interactive (list (emacsconf-complete-talk-info))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "backstage")) + (plist-get group :email) + (append group + (list + :backstage "https://media.emacsconf.org/2022/backstage/" + :backstage-user "emacsconf" + :backstage-password emacsconf-backstage-password + :conf-name emacsconf-name + :year emacsconf-year)))) + (defun emacsconf-mail-backstage-info-to-speakers-and-captioners () + (interactive) + (let ((template (emacsconf-mail-merge-get-template "backstage")) + (speaker-groups + (seq-uniq + (mapcar + (lambda (talk) + (list + :name (plist-get talk :speakers-short) + :email (plist-get talk :email) + :role "speaker" + :backstage-use + "As we add more talks, you can skim through any relevant ones to + see if there are any points you'd like to build on in your talk. + Also, you can get a sense of what we do behind the scenes to try + to get as many talks captioned for broadcast, and what you can do + to make it easier. (A text file with names and technical terms + can be helpful. No need to type out a manual transcript if you + don't start from a script.) After you upload your talk and we + process the files, you can use the backstage area to check the + quality of the reencoded video.")) + (seq-filter (lambda (o) (string= (plist-get o :status) "WAITING_FOR_PREREC")) + (emacsconf-filter-talks (emacsconf-get-talk-info)))))) + (volunteer-groups + (with-current-buffer (find-file-noselect emacsconf-org-file) + (org-map-entries (lambda () + (list :name (org-entry-get (point) "NAME_SHORT") + :email (org-entry-get (point) "EMAIL") + :role "captioning volunteer" + :backstage-use "If you see a talk that you'd like to caption, you can e-mail me at sacha@sachachua.com and I can reserve it for you.")) + "captions")))) + (mapcar (lambda (g) (emacsconf-mail-backstage-info g template)) + (append + speaker-groups + (seq-remove (lambda (v) (seq-find (lambda (s) (string= (plist-get s :email) + (plist-get v :email))) + speaker-groups)) + volunteer-groups))))) -### BLOCKED Downsize the server :bandali: +### Template +Hi ${name}! - +You’re getting this e-mail because you are a ${role} for ${conf-name} +${year}. (Thanks!) -## In case of +I’m so excited! =) A number of speakers have uploaded their videos, +and OpenAI Whisper looks like a promising way to get automatically +generated captions that we can use as a starting point. +We’ve set up ${backstage} as the backstage area where you can view the +videos and resources uploaded so far. You can access it with the +username "${backstage-user}“ and the password ”${backstage-password}“. +Please keep the backstage password and other speakers’ talk resources +secret. ${backstage-use} -### Stuck wiki +Thank you! -sudo -iu ikiwiki – ikiwiki –setup ~ikiwiki/emacsconf.setup +Sacha Chua -### Last-minute prerecording submission +## DONE Write playbooks -- CHECK will copy it from the FTP upload server to ${protected} and name it appropriately. -- CHECK will notify STREAM with the scp command and the mpv command so that STREAM can choose. +### DONE Host :zaeph: -### Last-minute caption update + -- CHECK uploads the –main.vtt file to ${protected} -- CHECK notifies STREAM via ${upcoming} -- STREAM uses the provided commands to download the VTT file and load it into MPV with `--sub-file` +### CANCELLED Streamer :zaeph: -### Speaker has not checked in +Blocked by [Investigate streaming options, maybe OBS in the cloud](#streaming) -- Let the previous talk run a little longer for Q&A; end at least in time for the prerec -- After the previous Q&A wraps up, play the prerec -- [? still not around after prerec finishes] - - HOST: Speaker might be having some difficulty connecting, but we’ll collect your questions on the pad and send them afterwards. - - Can play next prerec a few minutes early +bandali and corwin/zaeph will do the streaming, so writing the streaming playbook is a little lower priority for now -### Speaker does not have a prerec and has not checked in +### DONE Check-in -- Let the previous talk do live Q&A/demo if ready -- Close to the time of the missing talk: - - See if any of the previous speakers want to be set up for an impromptu talk/extension in a BBB room, just in case - - HOST: The next speaker might be having some difficulty connecting. In the meantime, let’s… - - OR: - - highlight ongoing discussions - - invite another speaker for an impromptu extension; mplsCorwin will keep a list of possible speakers who are still active - - replay a short prerec - - let mplsCorwin or zaeph fill in + -### Speaker whose talk was reallocated shows up and has a prerec +### DONE IRC -- CHECK copies it to ${protected} -- Plan to play prerec at the end of the day, or in any gaps if a live talk falls through + -### Speaker whose talk was reallocated shows up and wants to do it live +### DONE Pad -- See if there’s enough time if buffers are shuffled back; if so, set up for a live presentation -- Check for alternate stream volunteers -- [? not enough time] Offer to set up a BBB room for recording or to - accept a prerecording afterwards, then include it on the site and in - post-conference communication + -### Alternate stream volunteer wants to stream (nice to have, at risk) +### DONE Captions -- CHECK gives ALTERNATE the BBB room URL for the talk they are interested in -- ALTERNATE starts streaming to assigned end point -- CHECK confirms stream -- CHECK updates ${stream-status} -- CHECK notifies STREAM and HOST - - After prerec plays: - - HOST: This talk has an extended demo/Q&A. You can go to ${alternate-url} to watch it, and we’ll post a recording afterwards. - - HOST sends ${alternate-url} to IRC: Alternate stream for ${title}: ${alternate-url} -- ALTERNATE notifies #emacsconf-org when the stream is done. -- CHECK updates ${stream-status} to note that the alternate stream is finished. - - FFMPEG process for sending the desktop and audio to the $CONFALT mountpoint on Linux with X11 and Alsa: - - 1. Set the CONFALT environment variable to icecast://user:password@live0.emacsconf.org:8000/alt.webm - 2. Install pavucontrol if you don’t have it already. - 3. Start the following command (: - - while true; do ffmpeg -loglevel 0 -ar 48000 -f alsa -channels 2 -sample_rate 48000 -i default -re -video_size 1280x720 -framerate 25 -f x11grab -i :0.0 -cluster_size_limit 2M -cluster_time_limit 5100 -content_type video/webm -c:v libvpx -b:v 1M -crf 30 -g 125 -deadline good -threads 4 -f webm $CONFALT; done - 4. Use pavucontrol to set the recording source for the ffmpeg - command to be the audio monitor, so you get system output as - well. - - OR: - - [? splitting audio] (look for “Set up sinks for sound” under 2021/) - - [? same audio] - - Set up audio monitor as the input for FFMPEG - - MPV goes to MPV sink, browser goes to recording sink, FFMPEG takes in recording monitor + -### Pad malfunction or mess-up +## CANCELLED Figure out why ikiwiki is slow :infra:wiki: -- PAD resets the pad using -- [? still not recovered] - - PAD reimports the pad from backup +complex regular expression issues? +should the captions be outside the wiki? -### CRDT malfunctions +## CANCELLED Add nice-to-have stuff to prepare.md :zaeph: -- HOST notifies CHECK and tries reconnecting -- [? still doesn’t work] - - Switch to backup Etherpad +- org-reveal config +- SIL fonts choice -### Conduct guidelines issue + -- HOST addresses it (on-camera if needed) with a reminder and/or a kick or a ban +## DONE Write volunteer update 2022-10-23 :update: +Hello, folks! Here’s the weekly update on what’s happening backstage +for EmacsConf 2022 in case you notice something that you want to help +out with. =) -### CHECK is unavailable +- We’ve e-mailed the speakers instructions for uploading their files through either a web browser or an FTP client, and three speakers have already done so! Those talks are now available in the backstage area (), along with the first set of edited captions (thanks Jai Vetrivelan!). If you don’t have the username and password for the backstage area and you would like to access it, please e-mail me and I’ll send you the details. +- We’ve created a BBB room for each speaker’s live Q&A session. The URLs are in conf.org in the private repository if you need them. +- We’ve drafted some documentation for different volunteer roles. If you’d like to volunteer as a captioner, check-in person (hmm, reception?), Etherpad scribe, IRC monitor, or host, please check out the appropriate link and let me know if I need to add anything to the docs: + - + - + - + - + - +- Thanks to David O’Toole for signing up for some IRC shifts! If you would like to volunteer for a shift, check out . +- We’ve updated our streaming configuration for the General and Development tracks, and have started testing them using mpv and the watch pages. Videos aren’t currently streaming, but you can check out the layout of the watch pages at: + + - + - + - + - + + These pages could probably be a lot prettier and easier to use. If you have some ideas for improving them or if you’d like to work on the HTML/CSS/JS, we’d love your help! +- There are now Q&A waiting rooms with friendly URLs so that it’s easier for people to join the live Q&A when the host decides it’s okay to let everyone in. They’re linked on the watch pages (along with the pads) and they’ll be linked from the talk pages once we’re ready to share them. +- zaeph has been busy tweaking the ffmpeg workflow for reencoding and normalizing videos. Thanks to Ry P. for sharing the res.emacsconf.org server with us - we’ve been using it for all the processing that our laptops can’t handle. +- We experimented with using the OpenAI Whisper speech-to-text toolkit to create the auto-generated captions that captioning volunteers can edit. Looks promising! If you’d like to compare the performance between small, medium, and large models, you can look at the VTT files for the sqlite talk in the backstage area. I’ve also added support for tab-separated values (like Audacity label exports) and a subed-convert command to subed.el, which might give us a more concise format to work with. I’ll work on getting word-level timing data so that our captioning workflow can be even easier. -- HOST does check-ins -- HOST refers to conf.org for Q&A preference etc. -- STREAM checks conf.org for prerec filenames etc. -- Dropped goals: - - Publishing recordings ASAP - - Updating schedule/wiki on the fly +Next week, we hope to: +- improve the prerec and captioning workflows +- get more captions underway -### HOST is unavailable +Lots of good stuff happening! -- STREAM joins the BBB room and streams directly from there (or streams the prerecs). -- STREAM will do the hosting. +Sacha Chua -### Technical issues during a live presentation +## DONE 2022-10-30 volunteer update -- HOST tries to contact the speaker -- [? back on track] - - [? can be squeezed into remaining time]: Continue - - [? need extra time]: CHECK fiddles with buffer of following talks in conf.org and updates schedule - - [? need too much extra time (ex: 10min)]: HOST acknowledges - technical issues and says we may be able to follow up after the - conference -- [? can’t resume]: HOST acknowledges technical issues and says we may - be able to follow up after the conference +Hello, everyone! Here’s the weekly update on what’s happening backstage +for EmacsConf 2022 in case you notice something that you want to help +out with. =) +- Help wanted - Captioning: There are three talks open for captioning + in , so feel free to + e-mail me if you’d like to reserve one. I’ve tweaked the captioning + process a little bit so that I can reflow the transcripts into + shorter subtitles before people edit the captions, so editing is + easier to do because you don’t have to split along the way. (If + you’re curious about the technical stuff, I switched to manually + splitting the text using emacsconf-reflow from emacsconf-el and then + the using aeneas for forced alignment, because I couldn’t figure out + how to get torchaudio unstuck sometimes.) + + If you don’t have the username and password for the backstage area + and you would like to access it, please e-mail me and I’ll send you + the details. -### Big technical issues with streaming +- Help wanted - tech checks: For sessions with live Q&A, we’d like to + set up tech-checks with speakers to make sure that their setup works + well with BigBlueButton. A rough outline of the process is in the + tech-checking protocol heading at + . If you + would like to help with tech-checks, please e-mail us with your + general availability (including timezones) and preferred public + contact information so that we can include you on the list at + and in the e-mail to + speakers. -- HOST notifies #emacsconf and #emacsconf-org and adds a note at the top of the ${pad}. -- HOST updates the 2021.md wiki page -- CHECK publishes prerecordings - - media.emacsconf.org - - wiki - - Toobnix - - Peertube -- STREAM e-mails the mailing list +- Help wanted - intro/intermission slides, OBS overlay, ??: It might + be interesting to design something to show right before and right + after a talk so that people can see the title, speaker name, talk + page URL, Q&A info, pad URL, pronouns, etc. Ideally we’d be able to + generate a whole bunch of these from the talk data, so maybe SVG or + a TikZ picture? If this is your jam, let us know. +- OBS in the cloud: We’ve been able to figure out how to stream both + streams using OBS, VNC, and PulseAudio on Ry P.’s virtual server, so + it’s even more likely that we’re going to pull off two tracks this + year. Yay! -### live0 can’t handle the load or is close to network transfer limit +- Tom Purl has joined as a captioning volunteer. Hi Tom! -- OR: - - Redirect some viewers via asking in #emacsconf: - - watch via main-480p - - watch via Toobnix (if we can get that working) - - Consider dropping the restream to Toobnix (lower audience?) or to Youtube - - Add additional node to Linode account for shared transfer pool (TODO: doublecheck) +This week we hope to get lots of talks submitted, processed, and on +the way to being captioned. We’re also planning to make the captioning +workflow even better, and to improve the OBS streaming workflow. Whee! +Sacha -### People have a hard time seeing dark-mode presentations (or light-mode) -mpv –vf=negate $url +## Volunteer update 2022-11-07 +Hi everyone! -### Schedule update +Here’s what’s been happening backstage. -- Test it using the blocks near the beginning of conf.org -- emacsconf-publish-update-schedule -- E-mail affected speakers - see emacsconf-mail-schedule-update function +- Speakers have been submitting their videos, hooray! I added a + schedule to the backstage page at + so that people can see + how the schedule’s coming along. We expect more talks to come in the + next two weeks. Not panicking yet. =) +- Thanks to all the people who’ve been working on captions so far! + Bhavin, Andrea, and Ramin did the captions for their talks, and Jai + captioned Bala’s talk. Tom, Bhavin, and Hannah are currently working + on captions. There are three more talks backstage if anyone wants to + work on them. -### New talk +- I just posted some notes on how I reflow and edit subtitles in case + they’re helpful: + + It’s also linked from the backstage page under More info: editing + captions. -- Create entry in conf.org -- Fit it into the schedule using the emacsconf-schedule-plan variable -- When happy, execute the draft-schedule block to update the SCHEDULED properties -- emacsconf-generate-talk-page -- emacsconf-update-schedule -- emacsconf -- emacsconf-stream-generate-assets-for-talk +- We added the Emacs development updates talk from John Wiegley and + updated the times of other talks based on messages from the + speakers. +- We did a dry run of the OBS streaming setup with Leo, Amin, and + Corwin. I think we’re on track to being able to broadcast two + streams this year. - +- IRC announcements, BBB redirection, and media file publishing can + now all automatically happen when the talk status changes, + simplifying our work during the conference. Video playback and Q&A + browser windows can happen automatically if streaming from + res.emacsconf.org. I want to get the publishing workflow all + smoothed out too, so that talks and transcripts can be more easily + published to the wiki pages during the conference. -# Task archive +Plans for this week: +- More videos and captions! +- I plan to work on talk page publishing so that it happens smoothly during the conference +- Leo’s going to review the videos submitted so far and prepare intros for them +- Might be a good idea to reach out to speakers for tech checks and bios -## DONE Write preparation instructions :zaeph: +EmacsConf is a little less than four weeks away. Stuff is happening! -2021/prepare.md can be reused. +Sacha -Extra stuff to consider adding: -- DONE Suggestions for themes (especially wrt colourscape) -- DONE “Please don’t squeeze your talk by fast-forwarding your speech. Trimming silences and filler words can help, though. Sometimes it’s easier to write, record, and edit your voiceover, and then record the video to go along with it.“ -- DONE Allowing speakers to plant questions, esp. to cover tangential stuff that couldn’t fit in the prerec +## DONE Send prerec reminder :sachac: -## CANCELLED Allocate extra time if possible; send e-mail :sachac: +### DONE Update logbook with notes from e-mails :sachac: -## DONE Review metadata for speakers in conf.org :zaeph: +### DONE Follow up with speakers based on their availability -See the bottom of conf.org for some automated validation + -## DONE Review the submissions in the pad (see emacsconf-org-private or conf.org for the link) and add any objections or comments by Sept 26 for possible [early speaker notification](#acceptance), Oct 7 for everything :organizers: +## DONE Send schedule-published email for emacsconf-discuss :needsowner:timesensitive:email: -- zaeph: will start reviewing on Sep 21 +Schedule is now available; post to emacsconf-discuss, emacs-tangents + -## DONE Write preparation instructions :zaeph: +### DONE Post it to r/emacs as well :reddit:zaeph: -2021/prepare.md can be reused. +Please let zaeph know when it’s live so that the post can be distinguished. -Extra stuff to consider adding: -- DONE Suggestions for themes (especially wrt colourscape) -- DONE “Please don’t squeeze your talk by fast-forwarding your speech. Trimming silences and filler words can help, though. Sometimes it’s easier to write, record, and edit your voiceover, and then record the video to go along with it.“ -- DONE Allowing speakers to plant questions, esp. to cover tangential stuff that couldn’t fit in the prerec +### Template +Greetings, fellow Emacsians! -## DONE Add more submissions (CFP deadline Sept 30) :sachac: +On behalf of the EmacsConf 2022 organizers team, I’m very excited to +announce the schedule for EmacsConf 2022 (Dec 3 and 4), available at: -- Sacha: Add submissions to emacsconf-2022-private, draft 2-day schedule by Oct 10 + +All of the times listed on the schedule are in EST (UTC-5). You can +click on each talk’s title to open its page for more information, +including its scheduled time in your local time. (Displaying local time +requires running a tiny bit of AGPLv3+-licensed free/libre JavaScript +code, included on the talk pages.) -## DONE Publish talk pages :sachac: +For prerecorded talks, this time is also when the talk’s video will be +made available on the same page. Please note that the times are +approximations, and that the schedule may change leading up to the +conference. +As the conference approaches, we’ll post more details on how to watch +and participate. -## DONE Send early acceptances :sachac: +You can subscribe to the emacsconf-discuss mailing list at + to +be sure you’ll get updates. -Ideal sequence: +Want to help make EmacsConf even awesomer? Volunteer! + -1. publish /2022/prepare (zaeph) -2. publish wiki pages -3. send acceptance e-mails - - Allocate at most 20 minutes, say we’ll try to add more time depending on the schedule (probably know by Sept 30 or Oct 1) - - Include review comments -4. Send an additional e-mail introducing speakers who may want to coordinate +We hope to see you all around on Dec 3-4 for EmacsConf 2022! +P.S. please direct all replies to this post either to myself or to the +emacsconf-discuss list, so as to help avoid generating extra off-topic +chatter in the other lists cc’d in this message; thank you. -## DONE Prepare to export talk information to wiki :sachac: -Tested code in a fork, can publish talk information once talks are approved. -emacsconf-publish.el -emacsconf-generate-info-pages -emacsconf-generate-main-schedule -emacsconf-generate-talk-pages +## DONE Flesh out prepare.md for audio-recording tips before the prerec-deadline :zaeph: -## DONE Give access to emacsconf-2022-private to dto :zaeph: +## DONE Write speaker e-mail for people who have already submitted their talks +To: speakers who have already submitted their talks (so that we don’t distract people who are still working on their talks) -## DONE Write better subtitle documentation :sachac: + (defun emacsconf-mail-speaker-after-video (group &optional template) + (interactive (list (emacsconf-mail-complete-email-group + (seq-filter (lambda (o) (plist-get o :intro-note)) + (emacsconf-active-talks (emacsconf-get-talk-info)))))) + (setq template (or template (emacsconf-mail-merge-get-template "speaker-after-video"))) + (let ((talks (cdr group))) + (emacsconf-mail-prepare + template + (car group) + (list :speakers-short (plist-get (cadr group) :speakers-short) + :plural (if (= (length (cdr group)) 1) "" "s") + :email (plist-get (cadr group) :email) + :in-between (mapconcat (lambda (talk) + (emacsconf-surround "" "")) + (cdr group) + ", ") + :intro + (mapconcat (lambda (talk) + (string-join (org-wrap (emacsconf-surround "- " (plist-get talk :intro-note) "\n" "") 70) "\n")) + (cdr group) + "") + :chapters + (mapconcat (lambda (talk) + (format ":\n%s" + (plist-get talk :slug) + (mapconcat + (lambda (chapter) + (concat (format-seconds "%.2h:%z%.2m:%.2s" + (floor (/ (elt chapter 1) 1000))) + " " + (elt chapter 3) "\n")) + (subed-parse-file + (expand-file-name (concat (plist-get talk :video-slug) "--main--chapters.vtt") emacsconf-cache-dir))))) + (cdr group) + "\n\n") + :caption-note + (if (seq-find (lambda (o) (not (string= (plist-get o :status) "TO_STREAM"))) (cdr group)) + " The captions haven't been fully edited yet, so please ignore any errors in the captions themselves." + "") + :urls + (mapconcat (lambda (o) (concat "<" emacsconf-base-url (plist-get o :url) ">")) + (cdr group) " , ") + :tech-check-note + (if (string-match "live" (or (mapconcat (lambda (o) (or (plist-get o :q-and-a) "")) (cdr group) " ") "")) + (format + "*Tech check* + + Since you're planning to do a live Q&A session, you may want to + connect to the test BBB room at <%s> to make sure you can share + your audio, your window or screen, and your webcam (optional). Sharing + system audio or multi-monitor setups can sometimes be tricky, so + please let us know if you need help figuring things out. You can + double-check by connecting with a separate device, or you can arrange + to meet with one of the tech-check volunteers + ().${wrap} + + " emacsconf-test-bbb-room) ""))) + (add-hook 'message-sent-hook + `(lambda () + (mapc (lambda (o) + (emacsconf-add-to-talk-logbook o "Sent speaker-after-video email")) + (list + ,@(mapcar (lambda (talk) (plist-get talk :slug)) talks)))) + nil t))) + + (defun emacsconf-mail-speakers-after-videos () + (interactive) + (let* ((info (seq-filter (lambda (o) (plist-get o :intro-note)) + (emacsconf-active-talks (emacsconf-get-talk-info)))) + (grouped (seq-group-by (lambda (o) (plist-get o :email)) info)) + (template (emacsconf-mail-merge-get-template "speaker-after-video"))) + (mapc (lambda (group) + (emacsconf-mail-speaker-after-video group template)) + grouped))) - - -That will help more people subtitle things +### Template -## DONE Write volunteer page :sachac: +Hi, ${speakers-short}! - +Thank you for uploading your video early! Let’s get a few more things +sorted out for a smooth EmacsConf 2022. +${tech-check-note}\*Intro\* -## DONE Review the submissions in the pad (see emacsconf-org-private or conf.org for the link) and add any objections or comments by Sept 26 for possible [early speaker notification](#acceptance), Oct 7 for everything :organizers: +I’ve written a brief (and possibly inaccurate! =) ) intro that the +host can read out before your talk while the in-between slide +(${in-between}) is being displayed: -- zaeph: will start reviewing on Sep 21 +${intro} +Would you like to tweak it to better reflect your talk? -## DONE Double-check sachac’s timezone conversions for availability :zaeph: +**Chapter markers** -zaeph helped with this, even catching some based on e-mail timestamps +I’ve added chapter markers to your video in the backstage area to help +with navigation. You can click on them in the backstage area if you +want to easily jump around, or review the list that I’ve included for +your convenience: +${chapters} +If you prefer other headings or timestamps, please let me know!${caption-note} -## DONE Copy things over from previous notebooks :sachac: +**Bio, community support links** +People often want to learn more about speakers and show their +appreciation. If you’d like to include an author bio and any +social/support links to your talk page${plural} (${urls}), please +e-mail us the text that you’d like to include. You can also follow the +instructions at to edit your talk +page${plural} directly yourself, if you want to.${wrap} -## DONE Prepare to publish schedule :sachac:wiki: +Thanks again for all your contributions! -- Should be understandable as plain text -- Ideally responsive to take advantage of more screen space on monitors while still being understandable on mobile -- Organize by tracks and then days -- Links to jump to a track and day -- Graphics to make it easier for people to see nearby talk options -- Optionally, graphical view on talk pages as well (might need to publish a JSON somewhere to front) - - Schedule inspiration: - - - [DebConf 2022](https://debconf22.debconf.org/schedule/) converted times to your local timezone - - [LibrePlanet 2022](https://libreplanet.org/2022/program/) used table columns for the different tracks - - [SFSCON 2022](https://www.sfscon.it/programs/2022/) lists sessions chronologically, indicating tracks with labels and dots on a diagram. Dropdowns act as filters. - - +Sacha -- With JS and grid CSS: -- Fallback -Draft: + +## DONE Prepare for prerecs :zaeph: -### DONE Set up main schedule as plain text -general track -day 1 and day 2 +### DONE Optimize ffmpeg incantation -dev track -day 1 and day 2 +Remember to update <../prepare.md> with the new incantation. -by day -all talks +#### Incantation from last year -### DONE Set up talk page navigation + Q=32 + ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -an -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -threads 8 /dev/null && + ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -c:a copy -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -threads 8 "$2" -- program phase: by track -- schedule phase: chronological +#### New candidate -### CANCELLED See if I can get the schedule to split into a nice grid on larger devices that support it +Changelog: -Slightly annoying to do with JS/CSS because I want it to fall back to an interleaved schedule on small screens, so we would probably need to duplicate the elements and then use media queries. +- Disable adaptive quantization by setting aq-mode to 0 (TODO: compare samples) +- Add `-row-mt 1` needed to support `tile-rows` (2×2 is enough for 720p) +- Also use tiles for first pass +- Remove `-frame-parallel 0` because it’s disabled by default (see [Notes on encoding settings · Kagami/webm.py Wiki](https://github.com/Kagami/webm.py/wiki/Notes-on-encoding-settings)) +- Put number of CPU in variable and use it for `cpu-used` and `threads` +- Stick to default for `auto-alt-ref` +- Stick to default for `lag-in-frames` + Q=32 + CPU=8 + ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -an -row-mt 1 -tile-columns 2 -tile-rows 2 -cpu-used $CPU -g 240 -pass 1 -f webm -threads $CPU /dev/null && + ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -c:a copy -row-mt 1 -tile-columns 2 -tile-rows 2 -cpu-used $CPU -pass 2 -g 240 -threads $CPU "$2" -## DONE Process confirmations as we receive them :sachac:zaeph: +Other considerations: -- Reply to the speaker and Cc -submit to confirm the confirmation. Something like “Confirming your confirmation, no reply needed to this one. Thank you!” -- Update talk to WAITING\_FOR\_PREREC in conf.org -- Add a note in the logbook (C-c C-z - org-add-note) for the talk entry -- Add :PUBLIC\_EMAIL: t if given permission to use the e-mail on the - talk page, or set it to an alternative e-mail if provided. -- Update the public wiki’s ${year}/talks/{$slug}.md page to add the - e-mail address as on the speaker - information line. -- At some point, use `M-x emacsconf-generate-talk-pages` to update the e-mail address used in the footer. +- We might want to tweak the time before keyframes (`-g`). - (let (waiting) - (save-window-excursion - (with-current-buffer (find-file emacsconf-org-file) - (org-map-entries (lambda () (add-to-list 'waiting - (list (org-entry-get (point) "SLUG") - (org-entry-get (point) "ITEM")))) "TODO=\"TO_CONFIRM\""))) - waiting) +### DONE Figure out workflow for handling submitted prerecs -## CANCELLED Create Org heading for scheduling caption team’s live IRC duty shifts :dto: +We need time after the prerecs get submitted to: -See [Shifts](#shifts) +- convert the videos and check that they’ve been reencoded properly by watching the re-encoded ones all the way to the end +- caption videos +- capture any extra info +- follow up with missing prerecs +Make changes in [As prerecorded talks come in](#prerec-process) -## DONE Sacha: Organize volunteer information :sachac: + -## DONE Once talks are approved +## DONE Make something to display between talks :akshay196: -- sacha: Publish initial talk information pages -- Double-check talk pages, format them nicely -- Publish draft schedule -- Confirm e-mail communication with all of the speakers +Goals: -Process for accepting a talk: +- Reassure people that they’re in the right stream for the talk that they’re looking for +- Direct them to the pad and Q&A for the talk -- Create subtree for talk and populate it with properties. - - Required: CUSTOM\_ID SLUG NAME NAME\_SHORT EMAIL AVAILABILITY Q\_AND\_A TRACK MAX\_TIME - - Optional: PRONOUNS PRONUNCIATION IRC PUBLIC\_EMAIL MIN\_TIME EMERGENCY - - Can be validated with `emacsconf-validate-talk-subtree` - - Add a talk abstract subtree -- Add it to emacsconf-schedule-plan and fiddle with it until the flow looks good -- Execute the draft-schedule block to update the schedule in the Org file -- Add the talk page to the wiki with `emacsconf-add-talk-page`. -- Stage, commit, and push the wiki files. Make sure to add the talk page and the info pages. -- Doublecheck the wiki page on the web, since the e-mail refers to it. -- E-mail the speaker the acceptance by using `emacsconf-draft-acceptance-for-email-group` from `organizers-notebook/`. -- Log the acceptance using `C-c C-z` in the talk subtree in `conf.org`, noting the number of minutes. -- Change the status to TO\_CONFIRM. +What to show in between talks: +- Previous talk: title, speaker, pronouns, talk page, Q&A information (if still live) +- Next talk: title, speaker, pronouns, talk page, Q&A information, countdown -## DONE Remind people about confirming e-mail communications :sachac:email:speakers: + + -Look for the TO\_CONFIRM status in conf.org, probably include in schedule e-mail +- Good: Static image, maybe created with LaTeX +- Better: Video with unobtrusive sound so people can doublecheck that their audio works +- Best: Emacs thing so that we can have a dynamic timer and last-minute announcements, and so that it’s Emacs =) +- Even better than that: A compact view that can be overlaid on the Q&A session using OBS +See break commercials + - +OBS scenes (maybe?): -## DONE Send people schedule information and doublecheck their availability/Q&A preference :sachac:email:speakers:sched: +- splash-screen when we’re on break +- scene when broadcasting a talk (where we might want a logo and a bar or surrounding to broadcast messages like time left in + recording); and +- Q&A scene with host-webcam, optional speaker-webcam, and pad with questions. +- Q&A scene focusing on shared screen from speaker +- Q&A scene with IRC and pad - (defun emacsconf-mail-schedule (group &optional template) - "Send draft schedule. - GROUP is (email . (talk talk))" - (interactive (list (emacsconf-mail-complete-email-group))) - (require 'emacsconf-ical) - (let ((reply-by-date (date-to-time "2022-10-14")) - (draft-schedule (concat emacsconf-base-url emacsconf-year "/draft-schedule/"))) - (emacsconf-mail-prepare - (or template (emacsconf-mail-merge-get-template "check-sched")) - (car group) - (list - :titles - (mapconcat (lambda (o) (format "%s: %s" - (plist-get o :slug) - (format-time-string - "%b %-e %-I:%M %#p %Z" - (plist-get o :start-time) - emacsconf-timezone))) - (cdr group) "; ") - :draft-schedule - draft-schedule - :speakers-short - (plist-get (cadr group) :speakers-short) - :plural - (if (= (length (cdr group)) 1) "" "s") - :email - (plist-get (cadr group) :email) - :year - (or (plist-get (cadr group) :year) emacsconf-year) - :coordination-note - (if (seq-find (lambda (o) (member (plist-get o :slug) '("journalism" "rolodex" "orgsuperlinks" "buttons" "hyperorg" "science"))) - (cdr group)) - "I've changed the order slightly from the coordination e-mail I sent you. The sequence is now journalism - science - rolodex - orgsuperlinks - buttons - hyperorg. science is now second instead of last, and the first two talks are on Sat while the last four are on Sun. That probably means you don't have to coordinate as much, but you can still do so if you would like to build on other people's talks." - "") - :schedule - (mapconcat - (lambda (o) (format "* TODO Check time for \"%s\" (%s) :emacsconf:\nDEADLINE: %s\n(Not a hard deadline, just encouragement to e-mail us before that date if you can)\nPlease e-mail [[mailto:emacsconf-submit@gnu.org]] if you need it changed\n%s track\n%s\nIn context: %s" - (plist-get o :title) - (plist-get o :slug) - (format-time-string (car org-time-stamp-formats) reply-by-date emacsconf-timezone) - (plist-get o :track) - (string-join - (let ((emacsconf-timezones - (if (plist-get o :timezone) - (seq-uniq (append (list emacsconf-timezone) - (split-string (plist-get o :timezone) " ") - (list "UTC"))) - emacsconf-timezones))) - (emacsconf-timezone-strings o)) - "\n") - draft-schedule)) - (cdr group) - "\n----------------------------------------------------------------\n") - :reply-by - (format-time-string "%b %-e (%a)" reply-by-date emacsconf-timezone) - :timezone-note - (if (plist-get (cadr group) :timezone) - (format "I've included timezone conversion to %s. Let me know if you'd like me to use a different timezone in future e-mails." - (plist-get (cadr group) :timezone) " ") - "I can translate times into your local timezone. Let me know what timezone you'd like me to use.") - :availability-note - (cond - ((seq-find (lambda (o) (string-match "yes" (or (plist-get o :availability) ""))) (cdr group)) - (format "I think you've indicated that you're available during the conference.")) - ((seq-find (lambda (o) (string-match "not indicated" (or (plist-get o :availability) ""))) (cdr group)) - (format "I think you didn't indicate any particular availability constraints in your submission.")) - (t (format "I think it respects your indicated availability, which we've noted as %s." - (string-join - (seq-uniq - (mapcar - (lambda (o) (format "\"%s\"" (plist-get o :availability))) - (cdr group))) - " and ")))))))) - - (defun emacsconf-mail-schedule-update (group &optional template) - "Send draft schedule update. - GROUP is (email . (talk talk))" - (interactive (list (emacsconf-mail-complete-email-group))) - (require 'emacsconf-ical) - (let ((reply-by-date (date-to-time "2022-10-14")) - (draft-schedule (concat emacsconf-base-url emacsconf-year "/draft-schedule/"))) - (emacsconf-mail-prepare - (or template (emacsconf-mail-merge-get-template "check-sched")) - (car group) - (list - :titles - (mapconcat (lambda (o) (format "%s: %s" - (plist-get o :slug) - (format-time-string - "%b %-e %-I:%M %#p %Z" - (plist-get o :start-time) - emacsconf-timezone))) - (cdr group) "; ") - :draft-schedule - draft-schedule - :speakers-short - (plist-get (cadr group) :speakers-short) - :plural - (if (= (length (cdr group)) 1) "" "s") - :email - (plist-get (cadr group) :email) - :year - (or (plist-get (cadr group) :year) emacsconf-year) - :coordination-note - (if (seq-find (lambda (o) (member (plist-get o :slug) '("journalism" "rolodex" "orgsuperlinks" "buttons" "hyperorg" "science"))) - (cdr group)) - "I've changed the order slightly from the coordination e-mail I sent you. The sequence is now journalism - science - rolodex - orgsuperlinks - buttons - hyperorg. science is now second instead of last, and the first two talks are on Sat while the last four are on Sun. That probably means you don't have to coordinate as much, but you can still do so if you would like to build on other people's talks." - "") - :schedule - (mapconcat - (lambda (o) (format "\"%s\" (%s)\n%s track\n%s\nIn context: %s" - (plist-get o :title) - (plist-get o :slug) - (plist-get o :track) - (replace-regexp-in-string - "^\\(.*\\)\n\\(.*\\)" - "\\1\nIn other timezones:\n\\2" - (string-join - (let ((emacsconf-timezones - (if (plist-get o :timezone) - (seq-uniq (append (list emacsconf-timezone) - (split-string (plist-get o :timezone) " ") - (list "UTC"))) - emacsconf-timezones))) - (emacsconf-timezone-strings o)) - "\n")) - draft-schedule)) - (cdr group) - "\n----------------------------------------------------------------\n") - :reply-by - (format-time-string "%b %-e (%a)" reply-by-date emacsconf-timezone) - :timezone-note - (if (plist-get (cadr group) :timezone) - (format "I've included timezone conversion to %s. Let me know if you'd like me to use a different timezone in future e-mails." - (plist-get (cadr group) :timezone)) - "I can translate times into your local timezone. Let me know what timezone you'd like me to use.") - :availability-note - (cond - ((seq-find (lambda (o) (string-match "yes" (or (plist-get o :availability) ""))) (cdr group)) - (format "I think you've indicated that you're available during the conference.")) - ((seq-find (lambda (o) (string-match "not indicated" (or (plist-get o :availability) ""))) (cdr group)) - (format "I think you didn't indicate any particular availability constraints in your submission.")) - (t (format "I think it respects your indicated availability, which we've noted as %s." - (string-join - (seq-uniq - (mapcar - (lambda (o) (format "\"%s\"" (plist-get o :availability))) - (cdr group))) - " and ")))))))) +Nothing is urgent, blocking it, or being blocked by it, so you can +play around with ideas. + +We’re experimenting with two tracks this year, so we expect that some +people will join midway through a talk or Q&A session and +would like to reorient themselves. Some Q&A sessions may end +early, so we would like to reassure people that they’re in +the right spot for the next talk. Most Q&As will be done +live, but some Q&As will be done over IRC, so we need to +point people to the right place. +and if there’s room for a little extra info like public e-mail +addresses or pronouns, that can help people when they discuss +things. That info will be in the pad and IRC, though, so it’s +also okay to omit it -### Template +We can programmatically replace strings in +SVG from Emacs, so we can easily use that as an overlay. -Hi, ${speakers-short}! + …Or, if you just want to focus on the look of +things, we can think of the content on our own. -Here’s the tentative schedule for when your EmacsConf talk${plural} -will be streamed. Your talk${plural} will be streamed once, but I’ve -included a few timezone conversions for convenience. + oh yeah, totally, you can just focus on the design and use +placeholder text ---- +Overlay considerations: -${schedule} +- talk videos will likely have subtitles; no subtitles for Q&A +- zaeph doesn’t like vertical text ---- -${availability-note} You’ll also have time for Q&A afterwards, which -can be as short or as long as you like. We’ll send you more -information about how the Q&A will work as the conference gets closer. +### DONE Generate talk banners :sachac: -If you’d like to see the other talks for context, you can check out -the draft schedule at . -The times may move around a bit as we update the schedule, so I’ll -check in with you if things change a lot. ${coordination-note} +![img](https://gitlab.com/akshay196/emacsconf-artwork/-/blob/main/2022/talk-banner/sample.svg) -We’d like to publish the schedule this month, so we’d love to hear -from you by **${reply-by}** if the times don’t work for you. (We can -shuffle things around even after that date if something comes up.) -Also, if you think your talk${plural} would go better next to a -different talk, please let us know. ${timezone-note} Please keep -emacsconf-submit@gnu.org in To or Cc when replying. Thanks! -Sacha +## DONE Find volunteers for tech-checks :zaeph: -### Schedule change affecting dev +### DONE Add entry in 2022/volunteer.md -(Please ignore the previous update, I included the wrong times in the -e-mail. The web version’s been fine, though! Sorry about the extra -e-mails.) -I tweaked the schedule to put treesitter and lspbridge earlier, so -asmblox and wayland are a little later on Saturday morning. If you’d -like to see the latest schedule for your talk, you can go to - . Thanks for your -patience! +### DONE Write protocol for adding tech-checker volunteer ---- +- Invite volunteer to BBB (ask core organizers) +- Update with new tech-checker info +- Coach tech-checker on the protocol -${schedule} ---- +### DONE Write the tech-checking protocol (formerly referred to as “tech-checklist”) -(no need to reply to this to confirm, unless I broke the schedule for -you and you want me to fix it) +From previous years: -Sacha +> - Can you speak and be heard? Is there echo? +> - Can you hear the organizer? +> - Can you share your screen? Is the screen readable? +> - If you plan to show your keystrokes, is that display visible? +> - If you want to share your webcam (optional), can you enable it? Is it visible? Will there likely be distractions in the background? +> - Can you view the collaborative pad? Will you be comfortable reviewing questions on your own (perhaps by keeping it open beside your shared window), or will you need a volunteer to relay questions to you? +> - Can you share contact information (ex: phone number) so that we can get in touch with you in case of technical issues or scheduling changes? +> - Do you need help finding your way around IRC so that you can check into \`#emacsconf-org\`? What is your IRC nickname? -### Schedule change for buddy/meetup + -Hi ${speakers-short}! +## DONE Move conf.org management to orga@res.emacsconf.org :sachac: -I tweaked the schedule to allocate a little more time for the meetups -talk, and I moved the buddy talk earlier to make space. I think this -might improve the flow as well, since the meetups will refer to how -meeting up with a buddy is a good way to get a public Emacs meetup off -the ground. If you’d like to see the latest schedule for your talk, -you can go to . Thanks for your -patience! +so that more people can work with it during the conference +See the publish role in the ansible playbook ---- -${schedule} +## DONE Ask speakers for bios or support nudges to include on their talk pages :wiki: ---- +maybe after we get the prerecs +ex: liberapay, patreon, anyone looking for a job, etc. -(no need to reply to this to confirm, unless I broke the schedule for -you and you want me to fix it) -Sacha +## DONE Set up BBB rooms and update conf.org :sachac: +1. Log on to bbb.emacsverse.org as an admin. +2. Create a room. Enable **Mute users when they join**. + + The code below doesn’t quite work, but might be a good starting point for future automation. + + (setq list (seq-drop (emacsconf-bbb-room-title-list) 3)) ; skip some if needed + (progn + (setq name (pop list)) + (kill-new (format "name=\"%s\";$('#create-room-block').click();$('#create-room-name').val(name);$('#room_mute_on_join').click();$('.create-room-button').click();\n" + name)) + (sleep-for 1) + (shell-command "xdotool key alt+Tab sleep 3 key ctrl+v sleep 1 key Return")) - +console.log(JSON.stringify([…document.querySelectorAll(’.delete-room’)].map((o) => { return { name: o.getAttribute(’data-name’), path: o.getAttribute(’data-path’) }}).filter((o) => o.name.match(*^ec22*)))) -## DONE Volunteer communications: E-mail update for Oct 9, 2022 :email:volunteers: +see conf.org for the rest of the process -Add your news and requests to this. +### DONE Add volunteers to the BBB rooms -### Template so far +- vetrivln: sat-am-dev, sun-am-dev +- FlowyCoder: sat-pm-gen, sun-pm-gen +- jman: sun-pm-gen -Hello, EmacsConf volunteers! -We’re starting to gear up for EmacsConf 2022, and we would love to -figure out how to work with your skills, interests, and availability. - has some specific task ideas and -general roles. + - has an -overall prioritization matrix. If any of those options look like -something you want to learn or help with, or if you want to make -things even better than what’s in the table, let me know. +## DONE Coordinate and help volunteers :sachac: -Given the number of talks this year, we’re going to try to see if we -can pull off two tracks. I’ve posted a draft schedule at - and have e-mailed speakers -to confirm their availability. This schedule staggers live Q&A -sessions so that the person managing the streams can jump back and -forth as needed. We’ll figure out shifts once we’ve sorted out the -processes and training info, but if you want to call dibs on -something, feel free. - +- <../volunteer> +- Figure out what information volunteers need in order to feel + comfortable signing up for tasks. ex: + +- Encourage people to sign up for [Shifts](#shifts) -Please let me know what kinds of things you’d like to learn more about -or help out with! -Sacha Chua +### DONE Plan training session(s), Q&A availability, recordings -(You’re receiving this e-mail because you’re on the emacsconf-org -mailing list. Thanks for wanting to help out!) +### CANCELLED Hold Q&A session with volunteers -## DONE Delete all the EmacsConf BBB rooms from last year :chore:bbb:zaeph: -For the admins on BBB. The list is accessible here: [Organization Settings](https://bbb.emacsverse.org/b/admins/rooms). -Should take no more than ~20′. + +## DONE Investigate streaming options, maybe OBS in the cloud :sachac: -## DONE Write volunteer update +Current status: -Hello, folks! Here’s the weekly update on what’s happening backstage -for EmacsConf 2022 in case you notice something that you want to help -out with. =) +- res.emacsconf.org seems to be able to handle 2x (OBS + TigerVNC + MPV, should test with Firefox as well) +- corwin and jman will stream gen from OBS on res +- bandali will stream dev from his laptop +- let sachac know if you want manual control or more autopilot for the gen stream -- All the speakers have confirmed that they’ve gotten the acceptance - e-mails. Many speakers have confirmed that the schedule works for - them after I reshuffled a few talks for better availability. I’ve - posted the schedule at . We’ll - announce the schedule on the emacsconf-discuss mailing, Reddit, and - various places this week. +Goals: -- zaeph has been working on the ffmpeg incantations for preprocessing - the videos that will be submitted soon. bandali is working on - getting the FTP and web-based uploads sorted out so that speakers - can submit their videos. +- [X] Be able to start a VNC server with OBS, MPV, and Firefox, connect to it, and stream +- [X] Have another session with the sound isolated +- [-] Split the audio so that we can join the Q&A room before the MPV ends - handled by automatic scene switcher detecting mpv, but we can’t share just a window, so we might as well just wait +- [X] Control MPV from the commandline: track-mpv appears in the correct display, and it can also be controlled via the socket like this: echo ’{ “command”: [“loadfile”, “test2.webm”] }’ | socat - ~/mpv-socket-emacsconf-dev +- [ ] Share the window instead of the desktop? + +Prerequisites: + +- You need to be able to SSH out to res.emacsconf.org on port 46668 + and forward ports, so one of the main organizers needs to add your + SSH public key to the authorized\_keys file. Please e-mail your SSH + public key to sacha@sachachua.com and test that port 46668 is not + blocked. +- For streaming from OBS in VNC, you will need a VNC viewer like + tigervnc-viewer. +- For streaming from your local computer, you will need OBS and FFmpeg. + +During the conference, you will: + +- play the talk video (unless it’s automatically managed by the agenda) and update the overlays +- display intro/intermission information as needed +- open the Q&A windows, like the pad and the BBB room/IRC (unless it’s automatically managed by the agenda) +- adjust the volume if needed +- arrange windows and focus the BBB room on the speaker’s webcam if needed +- if you like, you can be responsible for managing the track from conf.org on orga@res.emacsconf.org + +Dry run checklist: + +- [ ] Connect to the server + ssh orga@res.emacsconf.org -p 46668 + emacsconf # runs emacsclient -c -a emacs +- [ ] Forward ports and connect via VNC +- [ ] Find the OBS or start it if it is not running +- [ ] Start recording +- [ ] Play a video +- [ ] Open two Firefox windows and arrange them +- [ ] Manage windows on the workspace +- [ ] Adjust the volume in OBS +- [ ] SSH to the server and play a video off-screen +- [ ] SSH to the server with X forwarding and adjust the volume off-screen + + +### Broadcasting from local OBS (option A) + +- You can copy the profile from your track or look inside it for the icecast mount point details: + - Gen: rsync -avze ’ssh -p 46668’ emacsconf-gen@res.emacsconf.org:~/.config/obs-studio/basic/profiles/ ~/.config/obs-studio/basic/profiles/ + - Dev: rsync -avze ’ssh -p 46668’ emacsconf-dev@res.emacsconf.org:~/.config/obs-studio/basic/profiles/ ~/.config/obs-studio/basic/profiles/ + +- Sacha will turn off the OBS recordings on res so that you can test streaming from your computer + - If you’re doing this independently, you can jump ahead to “Connecting to VNC” in order to stop the recording yourself + +- Verify with MPV: + + mpv https://live0.emacsconf.org/emacsconf/gen.webm + mpv https://live0.emacsconf.org/emacsconf/dev.webm + +- With luck, the 480p streams will be up automatically as well + + mpv https://live0.emacsconf.org/emacsconf/gen-480p.webm + mpv https://live0.emacsconf.org/emacsconf/dev-480p.webm + + +### Connecting to VNC (option B) + +1. Stop broadcasting locally if you were testing local OBS. + +2. Install a VNC viewer on your system (ex: tigervnc-viewer). + +3. Set up your local environment: + - gen: export TRACK=gen; export TRACK\_PORT=5905; export SSH\_PORT=46668 + - dev: export TRACK=dev; export TRACK\_PORT=5906; export SSH\_PORT=46668 + +4. Copy the password: + + scp emacsconf-$TRACK@res.emacsconf.org:~/.vnc/passwd vnc-passwd-$TRACK -p $SSH\_PORT + +5. Forward your local ports and connect via VNC viewer to the + appropriate forwarded port from your laptop: + + ssh emacsconf-$TRACK@res.emacsconf.org -N -L $TRACK_PORT:127.0.0.1:$TRACK_PORT -p $SSH_PORT & + sleep 5 # Give it time to establish the tunnels + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & + + (If this doesn’t find a VNC server to connect to, you can start it with `ssh emacsconf-$TRACK@res.emacsconf.org -p $SSH_PORT /home/emacsconf-$TRACK/bin/track-vnc`) + +6. Start **recording** (not streaming). If you don’t see OBS when you connect, it’s probably on workspace 2, so you can switch with Alt-2. If you still don’t see it there, you can open a terminal with Alt-Enter and then run `track-obs`. After you start recording, confirm that it is now broadcasting to the stream. + +7. Verify with MPV on your local system: + + mpv https://live0.emacsconf.org/emacsconf/$TRACK.webm & -- I created some watch pages to support viewing different tracks: - . The livestreams won’t work yet - and it would be nice to figure out something that can dynamically - display info for recent/current/upcoming talks, but it’s a start. +8. With luck, the 480p streams will be up automatically as well. On your local system: + + mpv https://live0.emacsconf.org/emacsconf/$TRACK-480p.webm & -- We set up a self-hosted Etherpad (ex: - ) with an easy way to - redirect to using Wikimedia in case we run into scaling issues. I’ve - added it to our Ansible playbook - (git@git.emacsconf.org:pub/emacsconf-ansible) and I’m looking - forward to incorporating Ry P.’s improvements. Karl Voit gave - feedback on the first draft of the template. +9. Play a video. It should display the video and update the overlays. If you need to update the overlays manually, you can copy files from `/data/emacsconf/overlays` onto `$HOME/other.png` and `$HOME/video.png`. + + You can play a video with `play video-id` (ex: `play meetups`), or you can specify the filename (ex: ~play ~/stream/emacsconf-2022-meetups\*.webm). + + termit: Ctrl-Shift-t makes a new tab + + i3 cheat sheet: + + - Alt-Enter creates a terminal + - Alt-d runs a command + - Alt-e toggles horizontal/vertical split + - Alt-f toggles full-screen + - Alt-w switches to tabbed view + - Alt-1 switches to workspace 1, Alt-2 switches to workspace 2 + - Alt-Shift-2 moves things to workspace 2 + - Alt-Shift-Left moves the current window to the left + - Alt-Shift-Right moves the current window to the right -- vetrivln volunteered for some of the dev hosting shifts, Karl Voit - volunteered for some of the gen pad shifts, and FlowyCoder - volunteered for some of the gen check-in shifts. Thanks! +10. Test Q&A. You can either wait for the video to finish or quit it with “q”. + You can paste in the URLs or use + `firefox /data/emacsconf/2022/index-$TRACK.html` -Next week, we hope to: +11. Test adjusting the audio + - `ssh emacsconf-$TRACK@res.emacsconf.org -p 46668` + - Then use `qa-louder`, `qa-quieter`, or `qa-vol vol%` (ex: `qa-vol 90%`) -- Announce the EmacsConf 2022 schedule in the usual places (got any wording/JS/CSS suggestions?) -- Finalize the upload instructions so that speakers can start submitting their files -- Put together volunteer training materials -- Set up per-speaker BBB rooms and friendly URLs +Other notes and tips: -Sacha +- You can use Emacs for emergency or ad-hoc announcements. +- Use OBS or `pavucontrol` to adjust the volume of BBB as needed. You might be able to manage `pavucontrol` off-screen with `ssh emacsconf-$TRACK@res.emacsconf.org -X -p $SSH_PORT pavucontrol`. +- You can also `ssh emacsconf-$TRACK@res.emasconf.org -p 46668` and start new processes from the command-line, such as using `track-mpv`. If you specify commands when you call SSH instead of using an interactive shell, you may need to also specify DISPLAY=:5 (for the gen track) or DISPLAY=:6 (for the dev track), since ssh won’t pick up the variables from `.bashrc`. +- If you have a Wayland-only desktop without any X11 compatibility layer (example: [Sway](https://swaywm.org) with `xwayland disable`) the suggested software (`tigervnc`) might no work. You can use instead for example `gnome-remote-desktop`. The password for the VNC connection can be retrieved from the file `vnc-passwd-$TRACK` (3DES encrypted). -## DONE Publish icals :sachac: +### Managing the stream from the agenda (option B2) -It would be nice to have track-specific icals as well. +ssh orga@res.emacsconf.org -p $SSH\_PORT +emacsconf # runs emacsclient -c -a emacs +You can then use - +- emacsconf-stream-play-video +- emacsconf-stream-open-qa-windows-on-change +- emacsconf-agenda-by-track +- emacsconf-agenda -## DONE Figure out web-based file upload :needsowner:sachac:ansible: +If things are going well, you can use C-c C-t on the agenda view to change a talk to PLAYING, CLOSED\_Q, or OPEN\_Q, and various things should happen in the background. If they don’t happen in the background, use emacsconf-add-org-after-todo-state-change-hook to add the todo state change hook, then try again. -zaeph: I can work on it, but I’m not experienced in this domain, so I’d prefer to be a back-up. -task is currently with bandali +Task state shortcuts for C-c C-t: -Lesson learned from last year: “Since people kept running into ftp -problems, we might want to set up a web-frontend next year to minimise -problems.” +- **m (mpv):** PLAYING - -stream-play-video, emacsconf-stream-set-talk-info, publish the files to the media directory +- **q (Q&A):** CLOSED\_Q +- **o (open):** update the BBB redirect URLs to let people into the room +- u (unstreamed) +- r (to archive) -Maybe we could ask some of the volunteers who wanted to help us with -the infra? It shouldn’t be complicated to deploy a ready-made -solution. +You can leave the emacsclient with `C-x 5 0` -“file drop” is a common keyword for looking for information. -Considerations: -- Probably run it on media.emacsconf.org -- Bonus features: - - password-protected or hidden behind some kind of authentication or hidden behind some kind of URL, so we don’t have to worry too much about spam - - extra points for sending speakers links to upload to specific folders so that we can separate resources by talk - - Resumable uploads would be good, since some speakers had a hard time with unreliable connections -- What other conferences do: - - LibrePlanet uses plain FTP and recommends FileZilla - - FOSSDEM uses Pentabarf to receive uploads - - DebConf uses SReview(?) - - FOSSGIS uses Seafile -- Some options: - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
ProjectDockerBusterBaseNotes
https://www.projectsend.org/  php+mysql 
https://github.com/pomf/pomf  php+mysql 
https://github.com/psi-4ward/psitransferofficial nodecan set upload password, resumable; data volume needs uid 1000
https://github.com/epoupon/fileshelterofficialppaC++ 
https://github.com/mickael-kerjean/filestashofficial  general FTP client
https://gitlab.com/moejo42/Jirafeauofficial php 
https://github.com/YouTransfer/YouTransferofficial nodelooking for maint
https://github.com/dutchcoders/transfer.sh/    
https://github.com/eikek/sharry    
- - - NextCloud - - anon FTP upload currently goes to *srv/ftp/anon* on media.emacsconf.org - - - - Maybe I’ll do psitransfer as a direct install +#### Do Q&A +From the emacsclient on orga@res.emacsconf.org, you can open various talk-related things: -### DONE Create 2022/upload.md with the same workflow as last year for a start +- emacsconf-stream-open-pad +- emacsconf-stream-join-qa +- emacsconf-stream-join-chat +Alternatively, you can switch to the VNC viewer and use the links in + or + . -### DONE Implement new workflow +For Q&A, you may want to have the Etherpad on the left, the BBB Q&A or +IRC chat on the right, and the terminal and OBS windows on +workspace 2. - +### Other tasks as needed -## DONE Update IRC instructions because of multiple tracks -Added to watch pages +#### Display emergency news / announcements +M-x emacsconf-stream-broadcast to send a message to both streams +or M-x emacsconf-stream-set-news to send a message to one stream. - +If that doesn’t work, edit the news file directly with: +`ssh emacsconf-$TRACK@res.emacsconf.org > ~/news.txt` -## DONE Move scheduling and publishing code to Emacs on a VPS so that other people can help out :sachac: +If that doesn’t work, use the VNC session to switch to an Emacs window +and type your message in. -Ideal: -- Update pages with watching information, additional resources, etc. as talks go live -- Update the schedule as needed (cancelled or reordered talks, etc.) +#### Kill the VNC server: -Where: +ssh emacsconf-$TRACK@res.emacsconf.org “vncserver -kill” -- front? my own VPS? - - Nice if there’s an Ansible playbook - - sachac’s notes: - -- probably good to set it up on front + -It’s now on front. +++ ++ + + + + + - -## DONE Prepare email for nudging speakers to send prerec, and inform on upload workflow :timesensitive:needsowner: + + + + + +
~/bin/track-obsstart OBS with the track’s profile and scene collection
~/bin/track-mpv file.webmplay the file using the track’s sink
-### Code +#### Making OBS scenes - (defun emacsconf-mail-upload (group &optional template) - "Send upload instructions and reminder. - GROUP is (email . (talk talk))" - (interactive (list (emacsconf-mail-complete-email-group))) - (let ((action-date (date-to-time "2022-11-04"))) - (emacsconf-mail-prepare - (or template (emacsconf-mail-merge-get-template "upload")) - (car group) - (list - :slugs (mapconcat (lambda (o) (plist-get o :slug)) (cdr group) " or ") - :speakers-short (plist-get (cadr group) :speakers-short) - :plural (if (= (length (cdr group)) 1) "" "s") - :email (plist-get (cadr group) :email) - :year (or (plist-get (cadr group) :year) emacsconf-year) - :prerec-note (emacsconf-surround - (make-string 64 ?-) - (string-join (seq-uniq (mapcar - (lambda (o) - (plist-get o :prerec-info)) - (cdr group))) - "\n") - (make-string 64 ?-) - ""))))) +Making OBS scenes is pretty straightforward as you can move the +different blocks on your scene in the preview window. However, it’s +important to make sure that your video-captures and your overlays are +snapping properly to the edges of the view-port. To do this, make sure +to right-click on the block inside the preview window, and try the +different fitting options (fit by width, height, etc.) until you find +one that works best. +We’ll probably be streaming at 720p, but since we’re also considering +a 1080p update, try to create your overlays in a format or a resolution +that would support resizing. -### Template -Hi, ${speakers-short}! +### Other notes -${prerec-note}Here are the instructions for uploading the -video${plural} for your talk${plural}. You can find the latest version -of the instructions at https://emacsconf.org/2022/upload/ . There are -two ways to upload your talk${plural} this year, so you can pick the -one that works best for you: +There are sockets in the home directory for MPV control if you want to keep that process. +echo ’{ “command”: [“loadfile”, “test2.webm”] }’ | socat - ~/mpv-socket-emacsconf-dev -- Web-based: , password emacsconf -- FTP: host: ftp-upload.emacsconf.org, port: 21, username: anonymous - folder: upload-here -If you upload slides and other resources, we can include them on the -talk page when your talk goes live. If you happen to have a script or -a transcript, please include them as well (it’ll speed up the -captioning for us). +### DONE Test and document command-line way of managing audio :sachac: -Please add a comment or start your filenames with the ID for the talk -that it’s for: ${slugs}. -If you’re still working on your talk, you might find the tips at - useful. In brief: +### DONE Move my conf.org setup to res so that we can control everything from there -- at least 1280x720 resolution -- we recommend dark text on a light background, with enough contrast - to make it easy to read -- if possible, use a headset or external microphone to record audio - in order to minimize computer noise -- upload a separate 5 second recording of quiet or leave 5 seconds - of quiet at the end of your talk video so that we can process your - video for noise reduction -Please plan to upload your talk by November 4 (next Friday) so that we -can get started preparing it for streaming. If you can’t make it by -then, we can accept later submissions, although it’s a bit more of a -scramble and our stress levels go up as the conference approaches. =) -We’d really appreciate the extra time for captioning and -double-checking. Thank you for your help in getting ready for a smooth -EmacsConf 2022! +### DONE Set timers for changing todo state -Sacha Chua + (defun emacsconf-schedule-test-buffer (info) + (mapcar (lambda (o) (plist-put o :buffer "1") o) info)) + (let ((emacsconf-schedule-strategies '(emacsconf-schedule-test-buffer))) + (emacsconf-stream-schedule-timers (emacsconf-schedule-prepare + (emacsconf-schedule-inflate-sexp + `(("Test gen" :start ,(format-time-string "%Y-%m-%d %H:%M" + (time-add (current-time) (seconds-to-time 60)))) + (journalism :time "1") + (school :time "2") + (handwritten :time "1") + ("Test dev" :start ,(format-time-string "%Y-%m-%d %H:%M" + (time-add (current-time) (seconds-to-time 60)))) + (treesitter :time "2") + (lspbridge :time "1") + (asmblox :time "1")))))) +the dev one worked, but the gen one gets +Couldn’t find local shell prompt for /bin/sh +Tramp: Opening connection **Async Shell Command** for emacsconf-gen@res.emacsconf.org using ssh…failed -## DONE Send backstage email +Maybe I need to stagger them, or maybe I need to use a shell command. +Changed to call ssh directly instead of using tramp. - (defun emacsconf-mail-backstage-info (group &optional template) - (interactive (list (emacsconf-complete-talk-info))) - (emacsconf-mail-prepare - (or template (emacsconf-mail-merge-get-template "backstage")) - (plist-get group :email) - (append group - (list - :backstage "https://media.emacsconf.org/2022/backstage/" - :backstage-user "emacsconf" - :backstage-password emacsconf-backstage-password - :conf-name emacsconf-name - :year emacsconf-year)))) - (defun emacsconf-mail-backstage-info-to-speakers-and-captioners () - (interactive) - (let ((template (emacsconf-mail-merge-get-template "backstage")) - (speaker-groups - (seq-uniq - (mapcar - (lambda (talk) - (list - :name (plist-get talk :speakers-short) - :email (plist-get talk :email) - :role "speaker" - :backstage-use - "As we add more talks, you can skim through any relevant ones to - see if there are any points you'd like to build on in your talk. - Also, you can get a sense of what we do behind the scenes to try - to get as many talks captioned for broadcast, and what you can do - to make it easier. (A text file with names and technical terms - can be helpful. No need to type out a manual transcript if you - don't start from a script.) After you upload your talk and we - process the files, you can use the backstage area to check the - quality of the reencoded video.")) - (seq-filter (lambda (o) (string= (plist-get o :status) "WAITING_FOR_PREREC")) - (emacsconf-filter-talks (emacsconf-get-talk-info)))))) - (volunteer-groups - (with-current-buffer (find-file-noselect emacsconf-org-file) - (org-map-entries (lambda () - (list :name (org-entry-get (point) "NAME_SHORT") - :email (org-entry-get (point) "EMAIL") - :role "captioning volunteer" - :backstage-use "If you see a talk that you'd like to caption, you can e-mail me at sacha@sachachua.com and I can reserve it for you.")) - "captions")))) - (mapcar (lambda (g) (emacsconf-mail-backstage-info g template)) - (append - speaker-groups - (seq-remove (lambda (v) (seq-find (lambda (s) (string= (plist-get s :email) - (plist-get v :email))) - speaker-groups)) - volunteer-groups))))) +### DONE Figure out how to work with the layout -### Template + -Hi ${name}! -You’re getting this e-mail because you are a ${role} for ${conf-name} -${year}. (Thanks!) +### DONE Allow per-track configuration of todo hooks :sachac: -I’m so excited! =) A number of speakers have uploaded their videos, -and OpenAI Whisper looks like a promising way to get automatically -generated captions that we can use as a starting point. +emacsconf-todo-hooks -We’ve set up ${backstage} as the backstage area where you can view the -videos and resources uploaded so far. You can access it with the -username "${backstage-user}“ and the password ”${backstage-password}“. -Please keep the backstage password and other speakers’ talk resources -secret. ${backstage-use} -Thank you! +### CANCELLED Use xdotool to automate joining BBB in Firefox (signing in, clicking on listen only) -Sacha Chua +### CANCELLED Experiment with sharing part of the screen so that there’s space for us to work a little off-screen -## DONE Write playbooks +We might just have to rely on xdotool to move windows the way we want them +Window fixes that didn’t work +- +- -### DONE Host :zaeph: - +### DONE Set up scenes and try them -### CANCELLED Streamer :zaeph: +### DONE Set up text source for URL -Blocked by [Investigate streaming options, maybe OBS in the cloud](#streaming) -bandali and corwin/zaeph will do the streaming, so writing the streaming playbook is a little lower priority for now +### DONE Create Ansible tasks for setting up sinks for MPV and Firefox for the streams, and adding the scenes appropriately -### DONE Check-in +### DONE See if I can even Ansible-up the rest of the tasks - +like starting up Firefox and mpv and everything -### DONE IRC +### CANCELLED obs-websocket control of OBS on the server - +so that the streamer can adjust volume offscreen? -### DONE Pad +### DONE document such that someone else could use/fix it - +### DONE recruit at least one more person to help operate the “video bouncer” -### DONE Captions - +### Other notes +- bandali doesn’t have much cognitive bandwidth at the moment, so we can keep things simple with OBS on laptops -## CANCELLED Figure out why ikiwiki is slow :infra:wiki: +- Issue: zaeph was dropping frames and couldn’t pay attention to as many things as he wanted +- Issue: corwin needs assistance to not be locked in his chair for the whole conf. Premptively, zaeph can do it by broadcasting OBS scenes via the rtmp (instead of just his webcam). +- With a long day, we may want to be able to schedule hosts/streamers/publishers in shifts +- Ideal: Easy reproducible setup to spin up an OBS VM with scenes set up, allowing multiple users to connect to it at the same time. Maybe x2go or vnc? VMs with 8 vCPUs and a vGPU cost more, so it would be good to figure out what’s needed, spin it down, and then spin it up maybe the day before or something like that. +- Plus points if we can control the OBS via password-protected websocket so we can tell it to switch scenes (and even more points if we do so from Emacs, maybe via that obs-websocket.el ;) ). MPV is also controllable via IPC, so we can use the same MPV player and then switch videos around. Maybe mpvc? +- Probably Linode’s Dedicated 32 GB + RTX6000 GPU x1 at $1.50 an hour for 2-3 days + dev time, since live.emacsconf.org is in Linode as well +- We should also look into normalization across the board, especially if we have BBB participants. pipewire + easyeffects on the box might be the easiest way to do it. -complex regular expression issues? -should the captions be outside the wiki? +- +- Live Streaming using low configuration vps +- +- +- [OBS Studio 26.0 | Hacker News](https://news.ycombinator.com/item?id=24633139) +- +- +- +- +- -## CANCELLED Add nice-to-have stuff to prepare.md :zaeph: + -- org-reveal config -- SIL fonts choice +## DONE Smoothen captioning workflow :sachac: +It looks like OpenAPI needs a little less editing in terms of +capitalization and punctuation, but it produces longer captions +(likely a 30-second sliding window). I’ll try to upload both YT and +OpenAPI captions so that people can decide what they like. - -## DONE Write volunteer update 2022-10-23 :update: +### DONE Figure out why it’s choking on SRV2 -Hello, folks! Here’s the weekly update on what’s happening backstage -for EmacsConf 2022 in case you notice something that you want to help -out with. =) +Can I use aeneas for alignment instead? -- We’ve e-mailed the speakers instructions for uploading their files through either a web browser or an FTP client, and three speakers have already done so! Those talks are now available in the backstage area (), along with the first set of edited captions (thanks Jai Vetrivelan!). If you don’t have the username and password for the backstage area and you would like to access it, please e-mail me and I’ll send you the details. -- We’ve created a BBB room for each speaker’s live Q&A session. The URLs are in conf.org in the private repository if you need them. -- We’ve drafted some documentation for different volunteer roles. If you’d like to volunteer as a captioner, check-in person (hmm, reception?), Etherpad scribe, IRC monitor, or host, please check out the appropriate link and let me know if I need to add anything to the docs: - - - - - - - - - - -- Thanks to David O’Toole for signing up for some IRC shifts! If you would like to volunteer for a shift, check out . -- We’ve updated our streaming configuration for the General and Development tracks, and have started testing them using mpv and the watch pages. Videos aren’t currently streaming, but you can check out the layout of the watch pages at: - - - - - - - - - - - These pages could probably be a lot prettier and easier to use. If you have some ideas for improving them or if you’d like to work on the HTML/CSS/JS, we’d love your help! -- There are now Q&A waiting rooms with friendly URLs so that it’s easier for people to join the live Q&A when the host decides it’s okay to let everyone in. They’re linked on the watch pages (along with the pads) and they’ll be linked from the talk pages once we’re ready to share them. -- zaeph has been busy tweaking the ffmpeg workflow for reencoding and normalizing videos. Thanks to Ry P. for sharing the res.emacsconf.org server with us - we’ve been using it for all the processing that our laptops can’t handle. -- We experimented with using the OpenAI Whisper speech-to-text toolkit to create the auto-generated captions that captioning volunteers can edit. Looks promising! If you’d like to compare the performance between small, medium, and large models, you can look at the VTT files for the sqlite talk in the backstage area. I’ve also added support for tab-separated values (like Audacity label exports) and a subed-convert command to subed.el, which might give us a more concise format to work with. I’ll work on getting word-level timing data so that our captioning workflow can be even easier. +Reflow the .txt file and reupload to res if needed +call ../run-aeneas.sh from the directory with the opus or ogg and the txt file -Next week, we hope to: +sachac@res-https://emacsconf.org/2022/talks/~/current/meetups$ python3 -m aeneas.tools.execute\_task emacsconf-2022-meetups–attending-and-organizing-emacs-meetups–bhavin-gandhi–main.opus reflowed.srt “task\_language=eng|os\_task\_file\_format=json|is\_text\_type=subtitles” output.json -- improve the prerec and captioning workflows -- get more captions underway +I might try out lhotse and torchaudio someday, but it’s low priority. aeneas seems to do a reasonable job of -Lots of good stuff happening! -Sacha Chua +### DONE Move publishing the backstage index to res so that we can trigger it after the files are uploaded -## DONE 2022-10-30 volunteer update +### DONE Compare large, medium, and small models -Hello, everyone! Here’s the weekly update on what’s happening backstage -for EmacsConf 2022 in case you notice something that you want to help -out with. =) +12 threads -- Help wanted - Captioning: There are three talks open for captioning - in , so feel free to - e-mail me if you’d like to reserve one. I’ve tweaked the captioning - process a little bit so that I can reflow the transcripts into - shorter subtitles before people edit the captions, so editing is - easier to do because you don’t have to split along the way. (If - you’re curious about the technical stuff, I switched to manually - splitting the text using emacsconf-reflow from emacsconf-el and then - the using aeneas for forced alignment, because I couldn’t figure out - how to get torchaudio unstuck sometimes.) - - If you don’t have the username and password for the backstage area - and you would like to access it, please e-mail me and I’ll send you - the details. +Original file: 21:16 21 minutes -- Help wanted - tech checks: For sessions with live Q&A, we’d like to - set up tech-checks with speakers to make sure that their setup works - well with BigBlueButton. A rough outline of the process is in the - tech-checking protocol heading at - . If you - would like to help with tech-checks, please e-mail us with your - general availability (including timezones) and preferred public - contact information so that we can include you on the list at - and in the e-mail to - speakers. + -- Help wanted - intro/intermission slides, OBS overlay, ??: It might - be interesting to design something to show right before and right - after a talk so that people can see the title, speaker name, talk - page URL, Q&A info, pad URL, pronouns, etc. Ideally we’d be able to - generate a whole bunch of these from the talk data, so maybe SVG or - a TikZ picture? If this is your jam, let us know. -- OBS in the cloud: We’ve been able to figure out how to stream both - streams using OBS, VNC, and PulseAudio on Ry P.’s virtual server, so - it’s even more likely that we’re going to pull off two tracks this - year. Yay! ++-- Tom Purl has joined as a captioning volunteer. Hi Tom! +-This week we hope to get lots of talks submitted, processed, and on -the way to being captioned. We’re also planning to make the captioning -workflow even better, and to improve the OBS streaming workflow. Whee! +-Sacha ++ + + + + + + + -## Volunteer update 2022-11-07 + + + + + + -Hi everyone! -Here’s what’s been happening backstage. + + + + + + -- Speakers have been submitting their videos, hooray! I added a - schedule to the backstage page at - so that people can see - how the schedule’s coming along. We expect more talks to come in the - next two weeks. Not panicking yet. =) -- Thanks to all the people who’ve been working on captions so far! - Bhavin, Andrea, and Ramin did the captions for their talks, and Jai - captioned Bala’s talk. Tom, Bhavin, and Hannah are currently working - on captions. There are three more talks backstage if anyone wants to - work on them. + + + + + + + +
 HoursMultNotes
Large2:498 
Medium2:035.9 
Small0:402More run-on sentences
-- I just posted some notes on how I reflow and edit subtitles in case - they’re helpful: - - It’s also linked from the backstage page under More info: editing - captions. +Large and medium might do better on a system with a GPU. I’ll default to the small model for now. -- We added the Emacs development updates talk from John Wiegley and - updated the times of other talks based on messages from the - speakers. -- We did a dry run of the OBS streaming setup with Leo, Amin, and - Corwin. I think we’re on track to being able to broadcast two - streams this year. +### DONE Commit subed-tsv so that people can try a cleaner output -- IRC announcements, BBB redirection, and media file publishing can - now all automatically happen when the talk status changes, - simplifying our work during the conference. Video playback and Q&A - browser windows can happen automatically if streaming from - res.emacsconf.org. I want to get the publishing workflow all - smoothed out too, so that talks and transcripts can be more easily - published to the wiki pages during the conference. -Plans for this week: +### DONE Investigate more granular timestamps for the output from OpenAPI Whisper -- More videos and captions! -- I plan to work on talk page publishing so that it happens smoothly during the conference -- Leo’s going to review the videos submitted so far and prepare intros for them -- Might be a good idea to reach out to speakers for tech checks and bios + -EmacsConf is a little less than four weeks away. Stuff is happening! -Sacha +### DONE Upload srv2 from YouTube for word-level -## DONE Send prerec reminder :sachac: +### CANCELLED Compare with Google Cloud Speech API +~/code/speech -### DONE Update logbook with notes from e-mails :sachac: +### DONE E-mail for bringing new captioning volunteers onboard -### DONE Follow up with speakers based on their availability + (defun emacsconf-mail-backstage-intro (volunteer &optional template) + (interactive (list (emacsconf-complete-volunteer))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "backstage-intro")) + (assoc-default "EMAIL" volunteer 'string=) + (list + :backstage "https://media.emacsconf.org/2022/backstage/" + :backstage-user "emacsconf" + :backstage-password emacsconf-backstage-password + :conf-name emacsconf-name + :year emacsconf-year + :name (assoc-default "NAME_SHORT" volunteer 'string=) + :email (assoc-default "EMAIL" volunteer 'string=)))) - +#### Template -## DONE Send schedule-published email for emacsconf-discuss :needsowner:timesensitive:email: +Hi ${name}! -Schedule is now available; post to emacsconf-discuss, emacs-tangents - +Thank you for volunteering for ${conf-name} ${year}! +We’ve set up ${backstage} as the backstage area where you can view the +videos and resources uploaded so far. You can access it with the +username "${backstage-user}“ and the password ”${backstage-password}“. +Please keep the backstage password and other speakers’ talk resources +secret. -### DONE Post it to r/emacs as well :reddit:zaeph: +For some ideas on ways to help, you can check out + . You can also suggest other +things you might be interested in. -Please let zaeph know when it’s live so that the post can be distinguished. +You can ask questions or chat with other volunteers by e-mailing the +mailing list at emacsconf-org@gnu.org or dropping by #emacsconf on the +libera.chat IRC network. You can also e-mail me or +emacsconf-org-private@gnu.org if you have private questions. +Thank you again for your help! =) -### Template +Sacha Chua -Greetings, fellow Emacsians! -On behalf of the EmacsConf 2022 organizers team, I’m very excited to -announce the schedule for EmacsConf 2022 (Dec 3 and 4), available at: +### DONE E-mail for bringing new captioning volunteers onboard - + (defun emacsconf-mail-captioning-intro (volunteer &optional template) + (interactive (list (emacsconf-complete-volunteer) + (emacsconf-mail-merge-get-template "captioning-intro"))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "captioning-intro")) + (assoc-default "EMAIL" volunteer 'string=) + (list + :backstage "https://media.emacsconf.org/2022/backstage/" + :backstage-user "emacsconf" + :backstage-password emacsconf-backstage-password + :conf-name emacsconf-name + :year emacsconf-year + :name (assoc-default "NAME_SHORT" volunteer 'string=) + :email (assoc-default "EMAIL" volunteer 'string=)))) -All of the times listed on the schedule are in EST (UTC-5). You can -click on each talk’s title to open its page for more information, -including its scheduled time in your local time. (Displaying local time -requires running a tiny bit of AGPLv3+-licensed free/libre JavaScript -code, included on the talk pages.) -For prerecorded talks, this time is also when the talk’s video will be -made available on the same page. Please note that the times are -approximations, and that the schedule may change leading up to the -conference. +#### Template -As the conference approaches, we’ll post more details on how to watch -and participate. +Hi ${name}! -You can subscribe to the emacsconf-discuss mailing list at - to -be sure you’ll get updates. +Thank you for volunteering to help with the captions for ${conf-name} +${year}! Last year, we were able to get almost all the talks captioned +in time for streaming. Participants found them very useful for +understanding different technical terms, names, accents, and so on. +We’d love to be able to pull that off again this year, and it would be +great to have you on board. -Want to help make EmacsConf even awesomer? Volunteer! - +We’ve set up ${backstage} as the backstage area where you can view the +videos and resources uploaded so far. You can access it with the +username "${backstage-user}“ and the password ”${backstage-password}“. +Please keep the backstage password and resources secret. If you see a +talk that you’d like to caption, you can e-mail me at +sacha@sachachua.com and I can reserve it for you. Then you can correct +any misrecognized words, fix capitalizations, remove filler words as +needed, and so on. -We hope to see you all around on Dec 3-4 for EmacsConf 2022! +You’ll probably want to work with either the VTT or the TXT versions +(VTT is WebVTT format and has timestamps), but you can check the other +talk resources in case the speaker has posted scripts or other useful +things. Both VTT and TXT are plain text, so feel free to use your +favourite text or subtitle editor. I’ve posted a brief demo of how I +edit captions at + , and +you can find more captioning tips at +. You can convert it to whatever format you like. If you prefer to +work with plain text, we can figure out the timestamps afterwards. -P.S. please direct all replies to this post either to myself or to the -emacsconf-discuss list, so as to help avoid generating extra off-topic -chatter in the other lists cc’d in this message; thank you. +Let me know if you want to reserve a talk for captioning or if you have +any questions or suggestions. We’re also in the #emacsconf-org channel +on the libera.chat IRC network, which you can connect to with your +favourite IRC client or through the web-based interface at + . +Sacha Chua -## DONE Flesh out prepare.md for audio-recording tips before the prerec-deadline :zaeph: + +### DONE Support cue IDs in subed-vtt.el + + +### CANCELLED jiwer · PyPI - measure error rate + + @@ -4967,7 +5170,8 @@ Sacha Chua (defun emacsconf-mail-captions-for-approval (talk) (interactive (list (emacsconf-complete-talk-info))) - (let ((captions (expand-file-name (concat (plist-get talk :video-slug) "--main.vtt") emacsconf-cache-dir)) + (let ((captions (expand-file-name (concat (plist-get talk :video-slug) "--main.vtt") + emacsconf-cache-dir)) (captioner-info (with-current-buffer (find-file-noselect emacsconf-org-file) (org-entry-properties (org-find-property "CUSTOM_ID" (plist-get talk :captioner)))))) @@ -4980,17 +5184,29 @@ Sacha Chua :email (plist-get talk :email) :title (plist-get talk :title) :captioner (assoc-default "NAME_SHORT" captioner-info) - :url (format "https://media.emacsconf.org/%s/backstage" emacsconf-year) + :url + (format "https://media.emacsconf.org/%s/backstage/#%s" emacsconf-year + (plist-get talk :slug)) :password emacsconf-backstage-password :captioner-email (assoc-default "EMAIL" captioner-info) :captioner-volunteered (if (string= (plist-get talk :captioner) "sachac") "" (format "%s volunteered to edit the captions for your video. " (assoc-default "NAME_SHORT" captioner-info))) + :chapters-note + (if (file-exists-p + (expand-file-name (concat (plist-get talk :video-slug) "--main--chapters.vtt") + emacsconf-cache-dir)) + "I've come up with some potential chapter headings which you can see as NOTE in the transcript or in the backstage entry for your video. Let me know if you want to tweak those.\n\n" + "") + :intro-note + (emacsconf-surround + "${wrap}Also, I drafted a quick intro for the host to read. Let me know if you want to tweak this: " (plist-get talk :intro-note) "\n\n" + "") :captioner-thanks (if (string= (plist-get talk :captioner) "sachac") - "It was fun working on your captions. Thanks!" - (format "%s: Thank you for editing the captions!" (assoc-default "NAME_SHORT" captioner-info))) + "" + (format "%s: Thank you for editing the captions!\n\n" (assoc-default "NAME_SHORT" captioner-info))) :captions (with-temp-buffer (insert-file-contents captions) (buffer-string)))) (mml-attach-file captions "text/vtt" "Subtitles" "attachment"))) @@ -5008,11 +5224,14 @@ you want to review it, suggest any corrections, or use the text in a blog post or elsewhere. You can look at the attached file or watch your video with closed captions at ${url} (username: emacsconf, password: ${password}). I’ve also included the captions at the end of -this e-mail for your convenience. Thanks again for your contribution! +this e-mail for your convenience.${wrap} -${captioner-thanks} +${chapters-note}${intro-note}Do you have a bio or social/donation links you’d like us +to add to the wiki page for your talk? -Sacha +Thanks again for your contribution! + +${captioner-thanks}Sacha ${captions} diff --git a/2022/organizers-notebook/emergency-back-to-one-sat-pm.svg b/2022/organizers-notebook/emergency-back-to-one-sat-pm.svg new file mode 100644 index 00000000..1d7b693d --- /dev/null +++ b/2022/organizers-notebook/emergency-back-to-one-sat-pm.svg @@ -0,0 +1 @@ + Saturday 1:00- 1:20 Attending and organizing Emacs meetups meetups 1:56- 2:11 Linking personal info with Hyperbole implicit buttons buttons 2:30- 2:55 Real estate and Org table formulas realestate 2:58- 3:23 Health data journaling and visualization with Org Mode and GNUplot health 3:26- 3:36 Edit live Jupyter notebook cells with Emacs jupyter 3:39- 3:49 Emacs development updates devel 4:15- 4:25 orgvm: a simple HTTP server for org orgvm 5:01- 5:06 Saturday closing remarks sat-close 1:23- 1:53 Revisiting the anatomy of Emacs mail user agents mail 2:14- 2:19 Bidirectional links with eev eev 2:22- 2:27 Short hyperlinks to Python docs python 3:52- 4:12 asm-blox: a game based on WebAssembly that no one asked for asmblox 4:28- 4:58 Haskell code exploration with Emacs haskell 1 2 3 4 5 \ No newline at end of file diff --git a/2022/organizers-notebook/emergency-back-to-one-sun-am.svg b/2022/organizers-notebook/emergency-back-to-one-sun-am.svg new file mode 100644 index 00000000..275467a1 --- /dev/null +++ b/2022/organizers-notebook/emergency-back-to-one-sun-am.svg @@ -0,0 +1 @@ + Sunday 9:00- 9:05 Sunday opening remarks sun-open 9:05- 9:25 Results of the 2022 Emacs Survey survey 9:28- 9:38 This Year in Org orgyear 10:04-10:29 Build a Zettelkasten with the Hyperbole Rolodex rolodex 10:50-11:00 Linking headings with org-super-links (poor-man's Zettelkasten) orgsuperlinks 9:41-10:01 lsp-bridge: complete asynchronous LSP client lspbridge 10:32-10:47 Tree-sitter beyond syntax highlighting treesitter 11:03-11:13 Emacs should become a Wayland compositor wayland 11:16-11:36 Message from RMS rms 9 10 11 12 \ No newline at end of file diff --git a/2022/organizers-notebook/emergency-back-to-one-sun-pm.svg b/2022/organizers-notebook/emergency-back-to-one-sun-pm.svg new file mode 100644 index 00000000..733b737e --- /dev/null +++ b/2022/organizers-notebook/emergency-back-to-one-sun-pm.svg @@ -0,0 +1 @@ + Sunday 1:00- 1:30 Powerful productivity with Hyperbole and Org Mode hyperorg 1:51- 2:16 Org workflows for developers workflows 2:37- 2:57 GRAIL---A Generalized Representation and Aggregation of Information Layers grail 3:23- 3:43 Putting Org Mode on the Indieweb indieweb 4:32- 4:42 Fanfare for the Common Emacs User fanfare 4:45- 4:55 Sunday closing remarks sun-close 1:33- 1:48 Getting detached from Emacs detached 2:19- 2:34 Top 10 reasons why you should be using Eshell eshell 3:00- 3:20 Emacs was async before async was cool async 3:46- 4:06 The Wheels on D-Bus dbus 4:09- 4:29 Pre-localizing Emacs localizing 1 2 3 4 5 \ No newline at end of file diff --git a/2022/organizers-notebook/index.org b/2022/organizers-notebook/index.org index 64ac6f92..a340cfba 100644 --- a/2022/organizers-notebook/index.org +++ b/2022/organizers-notebook/index.org @@ -158,29 +158,20 @@ CLOCK: [2022-11-17 Thu 21:15]--[2022-11-17 Thu 21:15] => 0:00 SCHEDULED: <2022-11-18 Fri> *** TODO Draft the code for mailing all the affected speakers *** Saturday afternoon -#+begin_src emacs-lisp :exports results :results replace :var filename="emergency-back-to-one.svg" :eval never-export +#+begin_src emacs-lisp :exports results :results replace :var filename="emergency-back-to-one-sat-pm.svg" :eval never-export (emacsconf-schedule-test filename - (emacsconf-time-constraints - '(("LUNCH" "11:30" "13:30") - ("saturday closing remarks" "16:30" "18:00") - ("sunday closing remarks" "16:30" "18:00"))) + (emacsconf-time-constraints nil) (arranged (emacsconf-schedule-inflate-sexp '(("Saturday, December 3" :start "2022-12-03 13:00") - meetups - community - buttons - realestate - health - jupyter - mail - eev python - haskell))) + meetups mail buttons eev python realestate health jupyter devel asmblox orgvm haskell sat-close))) (emacsconf-schedule-start-time "13:00") (emacsconf-schedule-svg-modify-functions '(;emacsconf-schedule-svg-color-by-status )) - (emacsconf-schedule-default-buffer-minutes-for-live-q-and-a 5) + (emacsconf-schedule-default-buffer-minutes 3) + (emacsconf-schedule-expected-talks '(meetups mail buttons eev python realestate health jupyter devel asmblox orgvm haskell sat-close)) + (emacsconf-schedule-default-buffer-minutes-for-live-q-and-a 3) (emacsconf-schedule-strategies '(emacsconf-schedule-override-breaks emacsconf-schedule-allocate-video-time-round-up-to-five emacsconf-schedule-allocate-buffer-time)) @@ -190,27 +181,25 @@ SCHEDULED: <2022-11-18 Fri> #+RESULTS: :results: -- LUNCH: Not found -- saturday closing remarks: Not found -- sunday closing remarks: Not found -- Missing talks: journalism, school, handwritten, science, buddy, survey, orgyear, rolodex, orgsuperlinks, hyperorg, workflows, grail, orgvm, indieweb, fanfare, localizing, treesitter, lspbridge, sqlite, maint, rde, justl, devel, detached, eshell, async, asmblox, dbus, wayland, sat-open, sat-close, sun-open, sun-close -- [[file:emergency-back-to-one.svg]] +- [[file:emergency-back-to-one-sat-pm.svg]] :end: *** Sunday morning -#+begin_src emacs-lisp :exports results :results replace :var filename="emergency-back-to-one.svg" :eval never-export +#+begin_src emacs-lisp :exports results :results replace :var filename="emergency-back-to-one-sun-am.svg" :eval never-export (emacsconf-schedule-test filename (emacsconf-time-constraints '()) (arranged (emacsconf-schedule-inflate-sexp '(("Sunday, December 4" :start "2022-12-04 9:00") - sun-open survey orgyear orgsuperlinks rolodex lspbridge treesitter asmblox wayland orgvm))) + ;; have to move orgvm + sun-open survey orgyear lspbridge rolodex treesitter orgsuperlinks wayland rms))) + (emacsconf-schedule-expected-talks '(sun-open survey orgyear lspbridge rolodex treesitter orgsuperlinks wayland rms)) (emacsconf-schedule-end-time "12:30") (emacsconf-schedule-svg-modify-functions '(;emacsconf-schedule-svg-color-by-status )) - (emacsconf-schedule-default-buffer-minutes 5) - (emacsconf-schedule-default-buffer-minutes-for-live-q-and-a 5) + (emacsconf-schedule-default-buffer-minutes 3) + (emacsconf-schedule-default-buffer-minutes-for-live-q-and-a 3) (emacsconf-schedule-strategies '(emacsconf-schedule-override-breaks emacsconf-schedule-allocate-video-time-round-up-to-five emacsconf-schedule-allocate-buffer-time))) @@ -218,25 +207,26 @@ SCHEDULED: <2022-11-18 Fri> #+RESULTS: :results: -- Missing talks: journalism, school, handwritten, science, meetups, buddy, community, realestate, health, jupyter, buttons, hyperorg, workflows, grail, indieweb, fanfare, localizing, sqlite, mail, eev, python, maint, haskell, rde, justl, devel, detached, eshell, async, dbus, sat-open, sat-close, sun-close -- [[file:emergency-back-to-one.svg]] +- [[file:emergency-back-to-one-sun-am.svg]] :end: *** Sunday afternoon -#+begin_src emacs-lisp :exports results :results replace :var filename="emergency-back-to-one.svg" :eval never-export +#+begin_src emacs-lisp :exports results :results replace :var filename="emergency-back-to-one-sun-pm.svg" :eval never-export (emacsconf-schedule-test filename emacsconf-time-constraints (arranged (emacsconf-schedule-inflate-sexp '(("Sunday, December 4" :start "2022-12-04 13:00") - hyperorg workflows grail indieweb devel detached eshell async dbus localizing fanfare sun-close))) + hyperorg detached workflows eshell grail async indieweb dbus localizing fanfare sun-close))) (emacsconf-schedule-start-time "13:00") + (emacsconf-schedule-end-time "18:00") + (emacsconf-schedule-expected-talks '(hyperorg detached workflows eshell grail async indieweb dbus localizing fanfare sun-close)) (emacsconf-schedule-svg-modify-functions '(;emacsconf-schedule-svg-color-by-status )) - (emacsconf-schedule-default-buffer-minutes 5) - (emacsconf-schedule-default-buffer-minutes-for-live-q-and-a 5) + (emacsconf-schedule-default-buffer-minutes 3) + (emacsconf-schedule-default-buffer-minutes-for-live-q-and-a 3) (emacsconf-schedule-strategies '(emacsconf-schedule-override-breaks emacsconf-schedule-allocate-video-time-round-up-to-five emacsconf-schedule-allocate-buffer-time))) @@ -244,8 +234,7 @@ SCHEDULED: <2022-11-18 Fri> #+RESULTS: :results: -- Missing talks: journalism, school, handwritten, science, meetups, buddy, community, realestate, health, jupyter, survey, orgyear, rolodex, orgsuperlinks, buttons, orgvm, treesitter, lspbridge, sqlite, mail, eev, python, maint, haskell, rde, justl, asmblox, wayland, sat-open, sat-close, sun-open -- [[file:emergency-back-to-one.svg]] +- [[file:emergency-back-to-one-sun-pm.svg]] :end: *** TODO Get the emergency schedule sorted out so that we can easily switch to it @@ -351,11 +340,16 @@ SCHEDULED: <2022-11-20 Sun> :QUANTIFIED: Emacs :END: :LOGBOOK: -CLOCK: [2022-11-19 Sat 11:30] +CLOCK: [2022-11-19 Sat 11:30]--[2022-11-19 Sat 18:50] => 7:20 :END: so that people on other platforms can come across EmacsConf *** TODO [#A] Write the restreaming shell scripts +**** TODO Restream-gen-youtube +:PROPERTIES: +:CREATED: [2022-11-19 Sat 13:32] +:END: + *** DONE Create the events and save the keys :sachac: CLOSED: [2022-11-19 Sat 11:58] [[file:~/proj/emacsconf/private/conf.org::*Other platforms][Other platforms]] @@ -624,6 +618,19 @@ CLOSED: [2022-11-14 Mon 14:14] SCHEDULED: <2022-11-19 Sat> :END: *** TODO [#B] Add intro notes and specific talk notes to the hyperlist *** TODO [#A] Make a hyperlist for checking people in for easier copying and pasting +*** TODO Send FlowyCoder hyperlist for checking people in +SCHEDULED: <2022-11-26 Sat> +:PROPERTIES: +:CREATED: [2022-11-19 Sat 09:26] +:END: + +[[file:~/proj/emacsconf/wiki/2022/organizers-notebook/index.org::*Use Mumble for backchannel coordination and also on-stage][Use Mumble for backchannel coordination and also on-stage]] + +*** TODO Make backstage redirects for pad and qa so that hosts and streamers can have an easier time +:PROPERTIES: +:CREATED: [2022-11-19 Sat 13:54] +:END: + ** TODO [#C] Record intro/outro for day-1 and day-2 :zaeph: :PROPERTIES: :CUSTOM_ID: rec-intro @@ -848,6 +855,7 @@ https://www.mail-archive.com/search?l=debconf-team@lists.debian.org&q=subject:%2 :END: #+TOC: headlines 1 local + ** How do we want to coordinate during the conference itself? :PROPERTIES: :CUSTOM_ID: coordination @@ -1145,6 +1153,20 @@ Options: - https://www.collabmagazine.com/organizing-a-multi-track-virtual-conference-with-microsoft-teams-live-events-a-technical-playbook-and-lessons-learned/ : 4-person team, post-prod, break commercials +** SOMEDAY Think about what to do with schedule gaps due to cancelled talks :thoughts: +:PROPERTIES: +:CREATED: [2022-11-19 Sat 17:30] +:CUSTOM_ID: schedule-gaps +:END: + +- just leave it on the in-between slide: no extra effort required +- host breakout rooms + +*** SOMEDAY Consider fillers covering conference stuff :thoughts: +:PROPERTIES: +:CREATED: [2022-11-19 Sat 17:43] +:END: + * Roles needed :PROPERTIES: :CUSTOM_ID: roles @@ -2284,7 +2306,8 @@ SCHEDULED: <2022-12-03 Sat> - Talk gone from the schedule? - Talk listed among the cancelled talks? - Talk page has cancelled info? - +6. Remove the talk from the [[#one-track][one-track emergency schedule]] + *** Last-minute prerecording submission :PROPERTIES: :CUSTOM_ID: last-minute-prerec -- cgit v1.2.3