diff options
Diffstat (limited to '')
| -rw-r--r-- | organizers-notebook.md | 1511 | ||||
| -rw-r--r-- | organizers-notebook/index.org | 1714 |
2 files changed, 3197 insertions, 28 deletions
diff --git a/organizers-notebook.md b/organizers-notebook.md index f5d6206b..3cdcda26 100644 --- a/organizers-notebook.md +++ b/organizers-notebook.md @@ -20,11 +20,56 @@ This document is the general organizers' notebook that can be used as a starting - [Create the public organizers’ notebook in the wiki](#starting-up-the-conference-planning-process-create-the-public-organizers-notebook-in-the-wiki) - [Phases and lessons learned](#phases-and-lessons-learned) - [Draft CFP](#phases-and-lessons-learned-draft-cfp) - - [Process proposals](#orge2fe34a) - - [Accept proposals](#orgac059dd) + - [Announce](#phases-and-lessons-learned-announce) + - [Process proposals](#phases-and-lessons-learned-process-proposals) + - [Accept proposals](#phases-and-lessons-learned-accept-proposals):email: - [Draft schedule](#draft-schedule) + - [Set up backstage and upload](#phases-and-lessons-learned-set-up-backstage-and-upload) + - [Post the schedule](#phases-and-lessons-learned-post-the-schedule) + - [Process uploaded files](#phases-and-lessons-learned-process-uploaded-files) + - [Generate assets](#phases-and-lessons-learned-generate-assets) + - [Record pronunciations](#phases-and-lessons-learned-record-pronunciations) + - [Prepare the infrastructure](#phases-and-lessons-learned-prepare-the-infrastructure) + - [Getting ready for captions](#phases-and-lessons-learned-getting-ready-for-captions) + - [Getting ready for the conference](#pre-conf) + - [During the conference](#conf) + - [After the conference](#phases-and-lessons-learned-after-the-conference) +- [Ideas for improvement](#ideas) +- [General infrastructure](#general-infrastructure) + - [Linode instance sizes](#general-infrastructure-linode-instance-sizes) + - [File uploads](#upload) + - [Media processing](#general-infrastructure-media-processing) + - [Wiki](#org7f83d48) + - [Icecast](#icecast) + - [Watching pages](#watch) + - [VNC](#vnc) + - [Streaming with OBS](#obs) + - [Mumble](#org09cd092) + - [Shell scripts](#general-infrastructure-shell-scripts) + - [Backstage](#backstage) + - [Thelounge IRC web client](#general-infrastructure-irc-web-client) + - [Etherpad](#general-infrastructure-etherpad) + - [Publishing media to the server and to the wiki](#media) + - [Automated publishing to the media server](#orgc40bf50) + - [Automated IRC announcements](#general-infrastructure-automated-irc-announcements) + - [BigBlueButton](#bbb) + - [Manual IRC announcements](#general-infrastructure-manual-irc-announcements) + - [Check test crontab](#orgc7d6d2a) + - [Confirm automated IRC announcements from res](#general-infrastructure-confirm-automated-irc-announcements-from-res) + - [Low-res stream](#general-infrastructure-low-res-stream) + - [Upload talks to YouTube](#general-infrastructure-upload-talks-to-youtube) + - [Restream to YouTube](#general-infrastructure-restream-to-youtube) + - [Restream to Toobnix](#orgdc911e7) + - [i3 window manager](#org692ea98) - [Other process notes](#other) - [Adding another user to BBB](#bbb-user) + - [Schedule changes](#org5f8f6b0) + - [When a talk Q&A changes method](#change-talk-qa) + - [To play the other stream](#other-process-notes-to-play-the-other-stream) + - [When a system is down](#other-process-notes-when-a-system-is-down) + - [When we need to bring on a last-minute volunteer](#other-process-notes-when-we-need-to-bring-on-a-last-minute-volunteer) + - [Checking people in](#other-process-notes-checking-people-in) + - [Ansible](#other-process-notes-ansible) <a id="starting-up-the-conference-planning-process"></a> @@ -42,24 +87,25 @@ This repository will store submissions, contact information, etc. 1. Create the repository on `front0`. Ex: + export YEAR=2025 sudo su - git cd repositories - mkdir emacsconf-2024-private.git - cd emacsconf-2024-private.git + mkdir emacsconf-$YEAR-private.git + cd emacsconf-$YEAR-private.git git init --bare -2. Edit `gitolite-admin/config/gitolite-conf`. Add lines for the group and the repo. Commit and push. Ex: +2. In the `gitolite-admin` repo, edit `conf/gitolite-conf`. Add lines for the group and the repo. Commit and push. Ex: @emacsconf-2024-org = bandali sachac ... repo emacsconf-2024-private - RW+ = @admins @emacsconf-2024-org orga -3. Clone the private repository into the appropriate location. `git clone git@git.emacsconf.org:emacsconf-2024-private private` + RW+ = @admins @emacsconf-2024-org orga +3. Clone the private repository into the appropriate location. `git clone git@git.emacsconf.org:emacsconf-2025-private private` <a id="starting-up-the-conference-planning-process-create-the-public-organizers-notebook-in-the-wiki"></a> ## Create the public organizers’ notebook in the wiki -Ex: 2024/organizers-notebook/index.org +Ex: <../2024/organizers-notebook/index.md> <a id="phases-and-lessons-learned"></a> @@ -73,14 +119,67 @@ Ex: 2024/organizers-notebook/index.org Create linked pages -- [ ] year index -- [ ] volunteer page -- [ ] submit page +- [ ] year index: ex: <../2024.md> +- [ ] volunteer page: ex: <../volunteer.md> +- [ ] submit page: ex: <../2024/submit.md> ### How to mark pages as drafts -Put inside double square brackets: `!template id=pagedraft` +Have a Markdown export block with the following contents. Replace { and } with [ and ]. + +\#+begin\_export md +{{!template id=pagedraft}} +\#+end\_export md + + +### Wiki template for year index + +Replace { and } with [ and ]. + + {{!meta copyright="Copyright © 2021-2022 Amin Bandali; 2023-2025 Sacha Chua"}} + + <p class="center">EmacsConf 2025 | Online Conference<br /> + <b>December 6 and 7, 2024 (Sat-Sun)</b></p> + + <p class="center">{{!img /i/emacsconf-logo1-256.png + alt="EmacsConf logo"}}</p> + + <p class="center">{{<b>Call for Participation</b>|cfp}} | {{Ideas}} | + {{Submit a Proposal|submit}} | {{Volunteer}} | {{Guidelines for Conduct|conduct}}</p> + + <p class="center">EmacsConf is the conference about the joy of + <a href="https://www.gnu.org/software/emacs/">GNU Emacs</a> and + Emacs Lisp.</p> + + We are busy putting things together for EmacsConf 2025, and we would + love to have *your* help to make EmacsConf 2025 amazing, much like the + previous EmacsConfs. See our {{**Call for Participation**|cfp}}, get + involved, and help spread the word! + + We are holding EmacsConf 2025 as an online conference again this year. + We remain fully committed to freedom, and we will continue using our + infrastructure and streaming setup consisting entirely of {free + software}{freesw}, much like previous EmacsConf conferences. + + For general EmacsConf discussions, join the + {emacsconf-discuss}(https://lists.gnu.org/mailman/listinfo/emacsconf-discuss) + mailing list. For discussions related to organizing EmacsConf, join + the + {emacsconf-org}(https://lists.gnu.org/mailman/listinfo/emacsconf-org) + mailing list. You can email us publicly at + <mailto:emacsconf-org@gnu.org> or privately at + <mailto:emacsconf-org-private@gnu.org>. + + Come hang out with us in the `#emacsconf` channel on `irc.libera.chat` + ({Libera.Chat}{libera} IRC network). You can join the chat using + {your favourite IRC client}{libera-emacsconf}, or by visiting + {chat.emacsconf.org}{chat} in your web browser. + + {freesw}: https://www.gnu.org/philosophy/free-sw.html + {libera}: https://libera.chat + {libera-emacsconf}: ircs://irc.libera.chat:6697/emacsconf + {chat}: https://chat.emacsconf.org ### Previous years @@ -88,6 +187,21 @@ Put inside double square brackets: `!template id=pagedraft` [2023](file:///home/sacha/proj/emacsconf/wiki/2023/cfp.md) +### Update dates + +<file:///home/sacha/proj/emacsconf/lisp/emacsconf.el> +<file:///home/sacha/proj/emacsconf/lisp/emacsconf-erc.el> + + +### Update the IRC topic + + (erc-cmd-OPALL) + (erc-cmd-CONFTOPIC (emacsconf-replace-plist-in-string + `(:year ,emacsconf-year :cfp-deadline ,emacsconf-cfp-deadline) + "Getting ready for EmacsConf ${year}! Call for proposals: https://emacsconf.org/${year}/cfp by ${cfp-deadline}, volunteer: https://emacsconf.org/volunteer/")) + (erc-cmd-DEOPALL) + + ### Lessons learned - Maybe incentivize proper timezone specification by saying we can translate times to their local time? @@ -125,7 +239,33 @@ Put inside double square brackets: `!template id=pagedraft` - Put the speaker introduction right after the talk description for easier web page copying. -<a id="orge2fe34a"></a> +<a id="phases-and-lessons-learned-announce"></a> + +## Announce + +- Post CFP to emacsconf-discuss, reddit.com/r/emacs, and in Emacs News +- Submit to <https://foss.events/> + + +### Promote the conference + +Submit to <https://foss.events/> + +Maybe it would be good to get in touch with podcasts like + +- [System Crafters](https://systemcrafters.net/) +- [This Week in Linux](https://www.youtube.com/playlist?list=PLbFVcOQ-YH_LRP687N0YeN78YZmBp5wqF) +- [Linux Unplugged](https://linuxunplugged.com/) +- [Ask Noah](http://asknoahshow.com/) +- [Linux After Dark](https://linuxafterdark.net/) +- [Lispy Gopher Show](https://anonradio.net/) + +etc to give a heads up on EmacsConf before it +happens and also mention to them when videos are +available to spark more interest. + + +<a id="phases-and-lessons-learned-process-proposals"></a> ## Process proposals @@ -154,9 +294,9 @@ When proposals come in: PUBLIC\_EMAIL -<a id="orgac059dd"></a> +<a id="phases-and-lessons-learned-accept-proposals"></a> -## Accept proposals +## Accept proposals :email: Setup: @@ -170,6 +310,18 @@ For each talk: 4. Use `emacsconf-publish-info-pages` and `emacsconf-publish-schedule` as needed. 5. Send acceptance e-mail with `emacsconf-mail-accept-talk` +After the CFP ends: + +1. Change the yyyy.md page to remove the CFP and submit links. +2. Update the yyyy/sidebar.md page to remove the CFP and submit links. +3. Update the yyyy/talks.md page to remove the CFP. +4. Change the IRC channel topics. + 1. `/opall`, + 2. ex: `/conftopic Getting ready for EmacsConf 2025! Volunteer: https://emacsconf.org/volunteer` + 3. `/deopall` + +[Example git commit](https://git.emacsconf.org/emacsconf-wiki/commit/?id=9b2c5a6f86d9e4c3faf4c7f028eabb758583fa97) + <a id="draft-schedule"></a> @@ -187,6 +339,1217 @@ For each talk: - Add missing items to plan +### TODO Send draft schedule to speakers :email: + +1. Evaluate the draft schedule we want to use. +2. `emacsconf-schedule-update-from-info` +3. `C-u M-x emacsconf-mail-template-to-all-groups RET emacsconf-mail-draft-schedule RET` +4. If that looks good, `M-x emacsconf-mail-template-to-all-groups`. You can use `M-x emacsconf-mail-merge-send-all` to send all the drafts, or send them one by one. + + +<a id="phases-and-lessons-learned-set-up-backstage-and-upload"></a> + +## Set up backstage and upload + +See <a href="https://git.emacsconf.org/emacsconf-ansible/tree/README.org">README.org</a>. + +Lessons learned: + +- Next year, let’s get upload.emacsconf.org in place as the domain name so that people don’t try to FTP files to it. + + +### DONE Send backstage and upload instructions :email: + + +<a id="phases-and-lessons-learned-post-the-schedule"></a> + +## Post the schedule + +- <elisp:(setq emacsconf-publishing-phase 'schedule)> +- <elisp:emacsconf-publish-info-pages> +- <elisp:emacsconf-publish-schedule-org-files> +- <elisp:emacsconf-ical-generate-all> +- Update talks.md to refer to watch.md as well + + +<a id="phases-and-lessons-learned-process-uploaded-files"></a> + +## Process uploaded files + +Basic setup: + +1. Set up the media server and symlinks: <a href="https://git.emacsconf.org/emacsconf-ansible/tree/README.org">README.org</a> (Media). +2. Set up the prerec processing areas on res: <a href="https://git.emacsconf.org/emacsconf-ansible/tree/README.org">README.org</a> (Processing prerecs). +3. Set up the caption processor on res: <a href="https://git.emacsconf.org/emacsconf-ansible/tree/README.org">README.org</a> (Captioning). + +Process: + +1. Review uploaded files with <elisp:emacsconf-upload-dired> +2. Open the JSON for the file you want to process and use <elisp:emacsconf-upload-copy-from-json> . + If more than one file uses the same extension, provide a suffix to disambiguate them. + If emacsconf-upload-copy-from-json might take a long time, you can also scp the file to your local +3. On res: + 1. Create a directory ~/current/files/$slug. + 2. Copy the uploaded file from ~/cache as `$video_slug--original.$extension`, or use `rename-original.sh $slug $file`. + 3. Call `process-prerec.sh $file`. +4. When the screens are finished, do locally: + 1. update-cache on my computer. + 2. <elisp:emacsconf-publish-cache-video-data> or <elisp:emacsconf-cache-all-video-data> + 3. <elisp:emacsconf-publish-backstage-index> + + +<a id="phases-and-lessons-learned-generate-assets"></a> + +## TODO Generate assets + + +### In-between pages + +- Make the $year/assets/in-between directory and copy the template.svg from the previous year. +- <elisp:emacsconf-stream-generate-in-between-pages> + + +### Intros + +- In an empty VTT file, <elisp:emacsconf-subed-intro-subtitles> +- Record the audio and get captions +- Splice together into a file that will be processed with subed-record-compile-video. + + +### TODO Test videos + +<elisp:emacsconf-stream-generate-test-videos> + + +<a id="phases-and-lessons-learned-record-pronunciations"></a> + +## Record pronunciations + + +### DONE Record pronunciations + +1. mkdir -p ~/proj/emacsconf/2025/assets/intros ~/proj/emacsconf/2025/assets/in-between +2. cp ~/proj/emacsconf/2024/assets/in-between/template.svg ~/proj/emacsconf/2025/assets/in-between/template.svg +3. <elisp:emacsconf-stream-generate-in-between-pages> +4. Create ~/proj/emacsconf/2025/assets/intros/intro.vtt +5. <elisp:emacsconf-subed-intro-subtitles> +6. Record the audio, possibly with subed-record, left, and right. +7. Split the lines for nicer subtitles. +8. Use <elisp:subed-record-compile> + + +### DONE E-mail speakers asking them to confirm the pronunciations + + +<a id="phases-and-lessons-learned-prepare-the-infrastructure"></a> + +## Prepare the infrastructure + +Checklist: + +- [ ] IRC + - [ ] Manual announcements + - [ ] Automated announcements +- [ ] Web conference +- [ ] Streaming assets + - [ ] Overlays + - [ ] Intros +- [ ] OBS +- [ ] VNC +- [ ] Publishing to the wiki +- [ ] Publishing to the media server +- [ ] Etherpad +- [ ] Mumble +- [ ] Icecast + + +<a id="phases-and-lessons-learned-getting-ready-for-captions"></a> + +## Getting ready for captions + +Onboarding: + +- Add captioner to conf.org with the `:caption:` tag, under a Volunteers heading with the `volunteer` tag. Make sure the `EMAIL` property is set. +- Add captioner to emacsconf-org mailing list. +- Send backstage information <elisp:emacsconf-mail-backstage-info-to-volunteer> . (Can be sent to all captioning volunteers with <elisp:emacsconf-mail-backstage-info-to-captioning-volunteers>) + + +<a id="pre-conf"></a> + +## Getting ready for the conference + +<elisp:emacsconf-pad-prepopulate-shift-hyperlists> + + +### DONE Check in with speakers for cancellations, adjustments + +emacsconf-mail-intro-to-all + + +### TODO Record opening remarks + + +### TODO Send check-in details, schedule update, etc. :email: + + +### One day before the conference + +- [X] Set `emacsconf-publishing-phase` to `conference`. +- [X] Set emacsconf-publish-include-pads to t. +- [X] Republish the schedule and the info pages. +- [X] Update the conf.org and the wiki on res. (~/emacsconf-2025-private, ~/emacsconf-wiki) +- [X] Resize the BBB server to production levels with bbb-prod: 16 GB $0.1440/hour 6 CPUs +- [X] Send check-in details and last-minute schedule updates. +- [X] Start thelounge on front0: systemctl start thelounge. +- [X] Confirm I can connect to Mumble. +- [X] Resize front0 to production: front0 shared Linode 32GB 8 CPUs 640GB $0.2880/hour +- [X] Resize live0 to production: shared Linode 64GB 16 CPUs $0.5760/hour +- [X] Start the VNC servers. + + #!/bin/bash + # SSH to both + cd ~/proj/emacsconf/emacsconf-ansible + + # Gen + export TRACK=gen; TRACK_PORT=5905; export SSH_PORT=46668 + ssh emacsconf-$TRACK@res.emacsconf.org -p $SSH_PORT /home/emacsconf-$TRACK/bin/track-vnc + sleep 5 + ssh emacsconf-$TRACK@res.emacsconf.org -N -L $TRACK_PORT:127.0.0.1:$TRACK_PORT -p $SSH_PORT & + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & + + # Dev + export TRACK=dev; export TRACK_PORT=5906; export SSH_PORT=46668 + ssh emacsconf-$TRACK@res.emacsconf.org -p $SSH_PORT /home/emacsconf-$TRACK/bin/track-vnc + sleep 5 + ssh emacsconf-$TRACK@res.emacsconf.org -N -L $TRACK_PORT:127.0.0.1:$TRACK_PORT -p $SSH_PORT & + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & +- [X] Confirm that we can use “Start Recording” to stream to gen. + - [X] play-with-intro sat-open + - [X] <https://live.emacsconf.org/2025/watch/gen/> + - [X] mpv <https://live0.emacsconf.org/gen.webm> + - [X] play-with-intro sun-open (to check the overlays) + - [X] <https://live.emacsconf.org/2025/watch/gen-480p/> + - [X] mpv <https://live0.emacsconf.org/gen-480p.webm> +- [X] Confirm that we can stream to dev. + - [X] play-with-intro sat-open + - [X] <https://live.emacsconf.org/2025/watch/dev/> + - [X] mpv <https://live0.emacsconf.org/dev.webm> + - [X] play-with-intro sun-open (to check the overlays) + - [X] <https://live.emacsconf.org/2025/watch/dev-480p/> + - [X] mpv <https://live0.emacsconf.org/dev-480p.webm> +- [X] Confirm that I can restream to YouTube. + - Settings - Stream, paste in the RTMP key for the relevant event, then Start Streaming. + - [X] gen + - [X] dev +- [X] Confirm that I can restream to Toobnix + - [X] live0: restream-gen-toobnix + - [X] live0: restream-dev-toobnix +- [X] Check automated announcements and publishing + - [X] orga@res: talk sat-open TO\_STREAM + - [X] <https://emacsconf.org/2025/talks/sat-open/> doesn’t have video + - [X] <https://media.emacsconf.org/2025> doesn’t have it + - orga@res: talk sat-open PLAYING + - [X] <https://emacsconf.org/2025/talks/sat-open/> has video and transcript + - [X] <https://media.emacsconf.org/2025> has talk files + - [X] IRC announcement in #emacsconf-gen +- [X] Confirm icecast stats are available: <http://live0.emacsconf.org/admin/stats> (username: admin, password is in prod-vars.yml) + + +<a id="conf"></a> + +## During the conference + +<elisp:emacsconf-pad-open-shift-hyperlist> + + +<a id="phases-and-lessons-learned-after-the-conference"></a> + +## After the conference + + +### Capture stats + +2024 stats + +Saturday: +gen: 177 peak + 14 peak lowres +dev: 226 peak + 79 peak lowres + +Sunday: +gen: 89 peak + 10 peak lowres + +<http://live0.emacsconf.org/admin/stats> (username: admin, password is in prod-vars.yml) + +meet peak 409% CPU (100% is 1 CPU), average 69.4% +front peak 70.66% CPU (100% is 1 CPU) +live peak 552% CPU (100% is 1 CPU) average 144% +res peak 81.54% total CPU (each OBS ~250%), mem 7GB used + +so far we have used 1.2TB of transfer this month + + +### Back up the data + + +#### Icecast + +rsync -avze ssh live:’/data/emacsconf-2024-\*’ media:~/2024 + +rsync -avze ssh live:’/data/emacsconf-2024-\*’ . + + +#### BigBlueButton + +rsync -avze ssh root@bbb:/var/bigbluebutton/ bigbluebutton/ + +ssh root@66.175.208.243 ’dd if=/dev/sda bs=5M ’ | dd of=bbb-img-2024-12-08.img status=progress + +The img can be loaded with +sudo losetup –find –show bbb-img-2024-12-08.img +sudo mount /dev/loop10 test +cd test + + +##### Reviewing all the Q&A durations and chat messages + + (let ((default-directory "/home/sacha/proj/emacsconf/2024/backups/bigbluebutton/published/video")) + (mapconcat + (lambda (dir) + (let ((chat (xml-parse-file + (expand-file-name "video.xml" dir))) + (metadata (xml-parse-file + (expand-file-name "metadata.xml" dir)))) + (concat + "- " + (dom-text (car (dom-by-tag metadata 'meetingName))) " (" + (format-seconds "%.2h:%z%.2m:%.2s" + (/ (string-to-number (dom-text (dom-by-tag metadata 'duration))) + 1000)) + ")" + "\n" + (if (dom-by-tag chat 'chattimeline) + (mapconcat (lambda (node) + (concat " - " (dom-attr node 'name) ": " + (dom-attr node 'message) "\n")) + (dom-by-tag chat 'chattimeline) + "") + "") + "") + ) + ) + (directory-files "." nil "-")) + ) + +- Copy IRC logs to cache and therefore to backstage: (ex: 2024-12-07-emacsconf-gen.txt) + + +### Combine the IRC logs and the pads, and add them to the wiki + +(did we e-mail the speakers before or after?) + + +### Process the Q&A recordings and live presentations + +- Save answers videos as –answers.webm. +- From the pad file: emacsconf-extract-copy-pad-to-wiki +- update cache +- Set `QA_PUBLIC` property to t as each Q&A gets processed. +- change status to `TO_INDEX_QA` +- emacsconf-publish-media-files-on-change +- emacsconf-publish-info-pages-for-talk + +Indexing + +- emacsconf-extract-insert-note-with-question-heading +- emacsconf-subed-make-chapter-file-based-on-comments +- change status to `TO_CAPTION_QA` + +Also copy the YouTube comments and IRC comments +emacsconf-extract-irc-anonymize-log + + +### Send thank-you emails to the speakers :email: + + +### Notify emacs-discuss that the Q&A is up + +<https://lists.gnu.org/archive/html/emacsconf-discuss/2024-12/msg00000.html> + + Hello, everyone! + + https://emacsconf.org/2024/talks and https://media.emacsconf.org/2024 + should have the talks and Q&A sessions now, hooray, including chapter + indices for the Q&A. I've also copied over notes from Etherpad and IRC + on the talk pages, and I've e-mailed them to the speakers so they can + update the wiki directly or send in additional answers. + + BigBlueButton audio mixing is kinda iffy, so I'm holding off on + uploading the Q&A videos (and the live talk for secrets) to + YouTube/Toobnix until Leo and other volunteers have a listen to see + whether the audio needs to be tweaked, and maybe even to do some kind of + normalization. Unfortunately, recordings with separate audio tracks per + participant aren't available--it would be cool to figure that out next + year--so some talks might need some manual processing. (Please feel free + to volunteer if that's up your alley!) In the meantime, you can check + out the Q&A videos from the talk pages on the wiki. Please let us know + if there's anything that needs tweaking. + + Enjoy! + + Sacha + + +### Write a report + +Sample: <https://emacsconf.org/2023/report/> + + +### Send thank-you emails to the volunteers :email: + +emacsconf-mail-template-ask-volunteer-for-mailing-address + + +### Process the lessons learned + + +<a id="ideas"></a> + +# Ideas for improvement + +How can we make EmacsConf better for participants? Speakers? Volunteers? People who come across the videos afterwards? + +- Emacs: + - view Etherpad (read-only): might be able to query something like <https://pad.emacsconf.org/2024/export/html> or <https://pad.emacsconf.org/2024/export/txt> + - view upcoming talks, countdown? + - resources, past talks + - ??: Collaborative real-time editing? Not sure crdt.el or collab-mode can scale up as far as we like; how would we test this? +- HTML/CSS/JS: + - general design improvements? + - [This is what the talks page looks like when there’s no schedule yet](https://web.archive.org/web/20240806134541/https://emacsconf.org/2024/talks/) + - [This is what the schedule page looks like before the conference](https://web.archive.org/web/20241108132608/https://emacsconf.org/2024/talks/) + - [This is what a talk page looks like before the conference](https://web.archive.org/web/20241208042046/https://emacsconf.org/2024/talks/literate/) + - [This is the watch page for the general track](https://web.archive.org/web/20241208034535/https://emacsconf.org/2024/watch/gen/) + - [This is the same talk page after the conference, with the videos, notes, and captions](https://web.archive.org/web/20241212145433/https://emacsconf.org/2024/talks/literate) + - [This is what the talks page looks like after the conference](https://emacsconf.org/2024/talks/) - list of resources + - timezone translations in the schedule SVG, on the schedule page, etc. + - countdown on talk pages? + - prettier viewers for videos, captions + - make it easier to see the talk/pad/IRC at the same time? + - easy timestamp jumping +- Volunteers: + - better documentation + - share to OBS from local? Maybe vdo.ninja? + - how do we manage the fallback/switchover in case we need to go back to shared VNC? + - meeting layout? + - countdown to switch over to the next talk, or easier manual control; web or command-line interface to control it? + - make it easier for people to join as hosts or check-in volunteers? + - improve backstage experience? + - automate or cross-train more people in what Sacha does (coordination, infrastructure) to reduce bus factor and increase awesomeness +- Processing: + - audio normalization: better workflow, more people helping + - noise removal (many speakers don’t have external mics) + - Makefile improvements + - captioning: + - simplify common edits + - reflowing? check out [sub-seg](https://gitlab.com/jun8git/sub-seg)? + - handle last-minute uploads + - validation: make sure audio, video, and caption times agree +- Infrastructure: + - document media processing pipeline + - make media processing pipeline more hands-off; ideally, just copy the video to the directory and that kicks off everything including eventually republishing the backstage index + - add read-only non-JS links to pads; make the pads viewable through the web instead of being downloaded (…/export/html) + - upgrade to latest versions + - front0 and live0: currently Debian 10.13 + - <span class="timestamp-wrapper"><time class="timestamp" datetime="2025-09-21">[2025-09-21 Sun]</time></span> bandali will look into upgrades, cleaning up + - <span class="timestamp-wrapper"><time class="timestamp" datetime="2025-09-19">[2025-09-19 Fri]</time></span> sachac: e-mailed bandali to ask if I can do the upgrades or if he wants to + - ffmpeg 6.0.1, latest is 8 + - 7 has demuxing, decoding, filtering, encoding, and muxing in the ffmpeg CLI now all run in parallel + - OBS on res? Currently 29.1.2 + - probably no must-haves up to version 32, okay to stay with current version + - Do we want to go back to having hosts stream from their local computers? + - local: better performance + - via VNC: + - easier to switch in a different host or manage multiple streams + - easier to move files around + - consistent setup for profiles, overlays + - DONE Etherpad (upgrade 1.9.7 to 2.5.0) + - DONE BigBlueButton (deployed 3.0.12, which is the latest as of 2025-08-02) + - Consider 3.1 beta? new interface, probably new bugs; see if it’s worth it? + - DONE Icecast (deployed 2.4.4-1) - decided to stick with current version + - <span class="timestamp-wrapper"><time class="timestamp" datetime="2025-09-21">[2025-09-21 Sun]</time></span> Decision: stick with Icecast + - Leaning towards sticking with [Icecast](https://icecast.org/) + - 2.5.0-rc1? health reporting, bugfixes; probably not essential + - [Ant Media Server](https://antmedia.io/) community edition, to enable adaptive bitrate streaming, lower latency, and HLS for wider support? + - [Owncast](https://owncast.online/)? Automatic downscaling, Fediverse support; might need two instances to support two tracks + - [SRS](https://github.com/ossrs/srs)? record, replay? more of a building block? + - Nginx RTMP? More of a building block + - customize BigBlueButton welcome, slides, title, branding + - change the default presentation (maybe someone can make a PDF?) <https://docs.bigbluebutton.org/administration/customize/#change-the-default-presentation> + - modify the default landing page <https://docs.bigbluebutton.org/administration/customize/#modify-the-default-landing-page> + - change the default welcome messages <https://docs.bigbluebutton.org/administration/customize/#change-the-default-welcome-message> + - change the favicon <https://docs.bigbluebutton.org/administration/customize/#change-favicon> + - change the default logo <https://docs.bigbluebutton.org/administration/customize/#changing-the-default-logo> + - check out BigBlueButton live captions? + - figure out if we can connect to or reuse the etherpad in BigBlueButton? + - figure out how to record separate audio streams in BigBlueButton because the audio mixing is sometimes terrible (some people’s audio streams end up much louder than others). Related: <https://github.com/bigbluebutton/bigbluebutton/issues/12302> , but not sure how to actually do it… + - replicate BBB setup in a virtual machine so that it’s easy to re-deploy + - replicate streaming setup (OBS+VNC) in a virtual machine so that it’s easy to re-deploy + - replicate video processing workflow on my computer and/or a virtual machine +- Other: + - panel? some thoughts: <https://pad.emacsconf.org/emacsconf-panel> + - unconference? + + +<a id="general-infrastructure"></a> + +# General infrastructure + + +<a id="general-infrastructure-linode-instance-sizes"></a> + +## Linode instance sizes + + +### Production + +- front0 shared Linode 32GB +- live0 shared Linode 64GB +- meet Dedicated CPU 16GB + + +### Dormant + +Resize disk to 25GB, copying large files to media if needed + +- nanode front0 +- nanode live0 +- delete meet after downloading all the recordings, or resize down to nanode + + +<a id="upload"></a> + +## File uploads + +[psi-4ward/psitransfer: Simple open source self-hosted file sharing solution](https://github.com/psi-4ward/psitransfer) + +Before the conference: + +1. Set `upload_enabled` to `true` in `prod-vars.yml` and run `ansible-playbook -i inventory.yml prod-playbook.yml --tags upload`. +2. Confirm that <https://upload.emacsconf.org> has the upload interface and works with the password. If it’s not up yet, use `sudo service upload start`. +3. Use `emacsconf-mail-template-to-all-groups` and `emacsconf-mail-upload-and-backstage-info` to e-mail the upload information to all speakers. + +After the conference: + +1. Set `upload_enabled` to `false` in `prod-vars.yml` and run `ansible-playbook -i inventory.yml prod-playbook.yml --tags upload`. +2. Confirm that <https://upload.emacsconf.org> shows the in-between page. + + +<a id="general-infrastructure-media-processing"></a> + +## Media processing + +1. Make sure `group_vars/all.yml` has the correct setting for `emacsconf_year`. +2. `ansible-playbook -i inventory.yml prod-playbook.yml --tags prerec` +3. Set up the `update-cache` script. + + #!/bin/bash + # export CONF_PUBLIC=1 + rsync -avu ~/proj/emacsconf/2025/assets/intros/*--intro.* ~/proj/emacsconf/2025/cache/ + rsync -avzue ssh --exclude ffmpeg2pass* --exclude .lock-\* --exclude 'partial--*' res:~/cache/ ~/proj/emacsconf/2025/cache/ --exclude .git + chmod ugo+r . -R + rsync -avzue ssh --exclude ffmpeg2pass* --exclude 'partial--*' ~/proj/emacsconf/2025/cache/ res:~/cache/ $* --exclude .git + rsync -avzue ssh --exclude ffmpeg2pass* --exclude 'partial--*' ~/proj/emacsconf/2025/cache/ orga@media:/var/www/media.emacsconf.org/2025/backstage/ $* --exclude .git + ssh orga@media "cd ~/backstage; chmod ugo+r -- *" + if [ ! -z "$CONF_PUBLIC" ]; then + echo "Updating public media" + rsync -avzue ssh --exclude \*--original\* --exclude ffmpeg2pass* --exclude \*--reencoded\* ~/proj/emacsconf/2025/cache/ orga@media:/var/www/media.emacsconf.org/2025/ 3--exclude .git + fi + rsync -avzue ssh ~/proj/emacsconf/2025/assets/ res:~/current/assets/ + +When a talk comes in: + +1. Update the talk status to `PROCESSING`. Re-evaluate the schedule draft. +2. Set the file prefix with `emacsconf-set-file-prefix-if-needed` or use `emacsconf-set-file-prefixes`. +3. Download the talk’s files to your local cache (as specified by `emacsconf-cache-dir`). +4. Rename the files with `emacsconf-rename-files`. +5. Use `../update-cache` to update res and backstage. +6. SSH to res. Go to the `~/cache` directory. + 1. Start or reuse a `screen` session. + 2. Use `make` to convert the file to WEBM and caption the file. +7. On your local computer, use `../update-cache` to move files around. +8. `emacsconf-publish-cache-video-data` to save the file size and length. +9. `emacsconf-publish-backstage-index` + + +<a id="org7f83d48"></a> + +## Wiki + +Stylesheet: <file://ssh:front|sudo:ikiwiki@front:/var/www/emacsconf.org/style.css> + +See also Ansible notes + + +<a id="icecast"></a> + +## DONE Icecast + +Success: You can send a stream to Icecast and the results can be viewed by mpv. + +- [X] Gen +- [X] Dev + +Also, recordings are available in /data. + +See also: [Use OBS+VNC to record](#obs-instructions) + +New year: + +1. Reprovision with + + ansible-playbook -i inventory.yml prod-playbook.yml --tags stream + + so that the year is updated in the configuration. +2. SSH to live0.emacsconf.org and run `/etc/init.d/emacsconf stop`. Confirm that icecast has stopped with `ps | grep emacsconf`; if not, kill the process. + Start it again with `/etc/init.d/emacsconf start` +3. To test, you can use FFmpeg like this for the gen stream: + + ffmpeg -y -f lavfi -i testsrc=size=1280x720:rate=10 -i background-music.opus \ + -c:v libvpx -b:v 500K -crf 25 -b:a 128k \ + -content_type video/webm "icecast://emacsconf:$EMACSCONF_ICECAST_SOURCE_PASSWORD@live0.emacsconf.org:8001/gen.webm" + + For dev: + + ffmpeg -y -f lavfi -i testsrc=size=1280x720:rate=10 -i background-music.opus \ + -c:v libvpx -b:v 500K -crf 25 -b:a 128k \ + -content_type video/webm "icecast://emacsconf:$EMACSCONF_ICECAST_SOURCE_PASSWORD@live0.emacsconf.org:8001/dev.webm" + + and then view it with + + mpv https://live0.emacsconf.org/gen.webm + mpv https://live0.emacsconf.org/dev.webm + + +### Cooldown + +ssh live0.emacsconf.org +sudo /etc/init.d/emacsconf stop + + +<a id="watch"></a> + +## DONE Watching pages + +Success: You can watch at <https://live.emacsconf.org>. + +- [X] <https://live.emacsconf.org> goes to the current year’s page. +- [X] gen stream works in the browser +- [X] dev stream works in the browser +- [X] Schedule is correct + +New year: + +1. `ansible-playbook -i inventory.yml prod-playbook.yml --tags live` +2. Republish with <elisp:emacsconf-publish-watch-pages>. +3. Update front:/var/www/live.emacsconf.org. + +Set up test streams (see ffmpeg instructions from [Icecast](#icecast)) and then: + + +<a id="vnc"></a> + +## DONE VNC + +We use VNC to connect to the X servers on res.emacsconf.org so that we can stream from it. + +Success: + +- [X] Confirm that you can connect to emacsconf-gen via VNC +- [X] Confirm that you can connect to emacsconf-dev via VNC + + +<a id="vnc-instructions"></a> + +### Instructions + +NOTE: VNC+OBS doesn’t work well if you have a window manager that +automatically resizes windows, like i3. Please configure your window +manager so that the VNC window is not resized. + +1. Install a VNC viewer on your system (ex: tigervnc-viewer). + +2. Set up your local environment: + - gen: `export TRACK=gen; export TRACK_PORT=5905; export SSH_PORT=46668` + - dev: `export TRACK=dev; export TRACK_PORT=5906; export SSH_PORT=46668` + +3. Copy the password: + + scp emacsconf-$TRACK@res.emacsconf.org:~/.vnc/passwd vnc-passwd-$TRACK -p $SSH\_PORT + +4. Forward your local ports and connect via VNC viewer to the + appropriate forwarded port from your laptop: + + ssh emacsconf-$TRACK@res.emacsconf.org -N -L $TRACK_PORT:127.0.0.1:$TRACK_PORT -p $SSH_PORT & + sleep 5 # Give it time to establish the tunnels + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & + +If you get the following error: + + channel 2: open failed: connect failed: Connection refused + CConn: End of stream + CConn: The connection was dropped by the server before the session could + be established. + +then the VNC server hasn’t started yet. You can start it with + + ssh emacsconf-$TRACK@res.emacsconf.org -p $SSH_PORT /home/emacsconf-$TRACK/bin/track-vnc + +and then connect with: + + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & + + +### Cooldown + +ssh sachac@res +sudo killall Xtigervnc + + +<a id="obs"></a> + +## DONE Streaming with OBS + +Success: You can use [OBS+VNC to record](#obs-instructions), and the results can be viewed by mpv. + +- [X] gen +- [X] dev + +New year: reprovision with + + ansible-playbook -i inventory.yml prod-playbook.yml --tags obs,stream + +so that the year is updated in the shell scripts. + +icecast is on live0.emacsconf.org and can be restarted with `/etc/init.d/emacsconf restart`. + + +<a id="obs-instructions"></a> + +### Instructions + +1. [Connect to the VNC session for the track.](#vnc-instructions) + +2. Start **recording** (not streaming). If you don’t see OBS when you connect, it’s probably on workspace 2, so you can switch with Alt-2. If you still don’t see it there, you can open a terminal with Alt-Enter and then run `track-obs`. After you start recording, confirm that it is now broadcasting to the stream. + +3. Verify with MPV on your local system: + + mpv https://live0.emacsconf.org/$TRACK.webm & + +so that the year is updated in the configuration. + + +<a id="org09cd092"></a> + +## DONE Mumble + +Success: + +- [X] You can connect to Mumble on your preferred device(s). +- [X] You can broadcast to the emacsconf-gen channel. +- [X] You can broadcast to the emacsconf-dev channel. + +mumble.emacsconf.org is hosted on front. Start it with: + + sudo /etc/init.d/mumble-server start + +It listens on port 64738 + +Logs are in `/var/log/mumble-server`. + +To add a new account: + +- After they log in, register their user. +- Right-click on the server name. Edit - Groups. Add them to the org group. + + +<a id="general-infrastructure-shell-scripts"></a> + +## Shell scripts + +Success: From the commandline, hosts can: + +- [X] play just the intro: intro $SLUG +- [X] play a file without an intro: play $SLUG +- [X] play a file with an intro: play-with-intro $SLUG (hmm, this didn’t show the subtitles) + ah, it’s because the intros need to be in the cache dir? +- [X] open the Q&A for a talk: handle-qa $SLUG + - [X] open the pad: pad $SLUG + - [X] open BBB: bbb $SLUG +- [ ] do the whole thing: handle-session $SLUG +- [ ] rebroadcast the other stream: + - rebroadcast gen + - rebroadcast dev +- [ ] control background music: music, stop-music + +Setup: + +- OBS must be streaming from the stream you’re testing. [Streaming with OBS](#obs) +- You may want to generate test assets and copy them over to the assets/stream directory. +- Generate all the overlays and copy them to assets/overlays +- Set up the assets/music directory + + +<a id="backstage"></a> + +## Backstage + +Update this with <elisp:emacsconf-publish-backstage-index> + +Explanation of files: + +<table> + + +<colgroup> +<col class="org-left"> + +<col class="org-left"> +</colgroup> +<tbody> +<tr> +<td class="org-left"><code>--original.mp4/mov/webm</code></td> +<td class="org-left">original file as uploaded by the speaker</td> +</tr> + +<tr> +<td class="org-left"><code>--silence.mp4/mov/webm</code></td> +<td class="org-left">silence sample if uploaded by speaker</td> +</tr> + +<tr> +<td class="org-left"><code>--reencoded.webm</code></td> +<td class="org-left">converted to .webm format and compressed</td> +</tr> + +<tr> +<td class="org-left"><code>--reencoded.opus</code></td> +<td class="org-left">audio only</td> +</tr> + +<tr> +<td class="org-left"><code>--normalized.opus</code></td> +<td class="org-left">normalized audio</td> +</tr> + +<tr> +<td class="org-left"><code>--reencoded.vtt</code></td> +<td class="org-left">WhisperX captions, WebVTT format</td> +</tr> + +<tr> +<td class="org-left"><code>--reencoded.json</code></td> +<td class="org-left">WhisperX word data</td> +</tr> + +<tr> +<td class="org-left"><code>--reencoded.srt</code></td> +<td class="org-left">WhisperX captions, SRT format</td> +</tr> + +<tr> +<td class="org-left"><code>--reencoded.txt</code></td> +<td class="org-left">WhisperX captions, plain text</td> +</tr> + +<tr> +<td class="org-left"><code>--main.vtt</code></td> +<td class="org-left">edited captions</td> +</tr> + +<tr> +<td class="org-left"><code>--main--chapters.vtt</code></td> +<td class="org-left">chapter markers</td> +</tr> + +<tr> +<td class="org-left"><code>--main.txt</code></td> +<td class="org-left">captions as text (optional)</td> +</tr> + +<tr> +<td class="org-left"><code>--main.webm</code></td> +<td class="org-left">version for streaming based on the most recent resources</td> +</tr> +</tbody> +</table> + +Other files might also have been uploaded by the speaker, such as slides or notes. + + +<a id="general-infrastructure-irc-web-client"></a> + +## Thelounge IRC web client + +Success: + +- [X] When the service is not running, the error page is displayed +- [X] You can join from <https://chat.emacsconf.org> +- [X] You can join from <https://live.emacsconf.org> and the channels end up as the latest ones + +ansible: lounge tag + +On front: + +- To start: sudo systemctl start thelounge +- To stop: sudo systemctl stop thelounge + + +### DONE Ask libera.chat to increase IRC limits + +Remember to schedule a task to ask libera.chat to increase the number of users it will accept from chat.emacsconf.org to avoid connection exhaustion errors. + +Message I’ve posted to support@libera.chat: + +Thank you for running libera.chat. We’re looking forward to using IRC (#emacsconf, #emacsconf-gen, #emacsconf-dev, #emacsconf-org) for the discussions for the upcoming EmacsConf (Dec 6-7, <https://emacsconf.org>). In the past, we’ve needed to coordinate with Libera staff to increase the number of connections allowed from chat.emacsconf.org during conference days in order to avoid connection exhaustion errors. Is that something we can plan now or would you like me to bring it up a few days before the conference? + + +<a id="general-infrastructure-etherpad"></a> + +## Etherpad + +Success: + +- [X] pad.emacsconf.org redirects to this year’s entry +- [X] Each talk has its own Etherpad + +Lessons learned: + +- After 2024: Added pronouns and pronunciation to the pad template since that’s what the hosts will be looking at + +The pad is at front0.emacsconf.org + +Non-JS way to get plain text or HTML of a pad: ex: + +- <https://pad.emacsconf.org/orgmeetup/export/txt> +- <https://pad.emacsconf.org/orgmeetup/export/html> + + +<a id="media"></a> + +## Publishing media to the server and to the wiki + +Start of year: + +1. Set `media_protect_root` to true in Ansible `group_vars/all.yml`. +2. `ansible-playbook -i inventory.yml prod-playbook.yml --tags media` +3. Generate the index with `emacsconf-publish-update-media` + +Confirm by using `talk sat-open PLAYING` on res. The public media +directory should have the files and the entry should be in the index. +Switching it back to `TO_STREAM` and calling +<elisp:emacsconf-publish-media-files-on-change> should remove it. + + +### DONE Switch public media to unprotected root before the conference :tminustwo: + +1. Clear public media directory. +2. Set `media_protect_root` to false in Ansible `group_vars/all.yml`. +3. `ansible-playbook -i inventory.yml prod-playbook.yml --tags media` + +You can generate the index with `emacsconf-publish-update-media`. + + +<a id="orgc40bf50"></a> + +## Automated publishing to the media server + +`ansible-playbook -i inventory.yml prod-playbook.yml --tags publish,edit` + +On orga@res, in the screen session with the emacs server, make sure emacsconf-year and emacsconf-cache-dir refer to the current ones. + + +<a id="general-infrastructure-automated-irc-announcements"></a> + +## DONE Automated IRC announcements + +Success: + +- [ ] When a talk starts playing, it is announced in the relevant channel + +How it works: On res: + +/usr/local/bin/handle-session sudos to the orga user and calls the `/usr/local/bin/talk` shell script, + +You will need the private repository checked out to `orga/emacsconf-2025-private`, which is set up by the ansible playbook `publish` tag. + +This is by `/usr/local/bin/talk` on res, which connects to a running Emacs with emacsclient. Make sure the emacs thing has the right year. + + +<a id="bbb"></a> + +## BigBlueButton + +ssh orga@media.emacsconf.org “~/bin/bbb-before sat-open” +<https://media.emacsconf.org/2024/current/bbb-sat-open.html> + +ssh orga@media.emacsconf.org “~/bin/bbb-open sat-open” + +After restarting, and in case of “Firefox can’t establish a connection to the server at wss://bbb.emacsverse.org/graphql.” + +ssh root@bbb +cd greenlight-v3 +docker compose restart + +Sizes: + +- dormant: 1 GB nanode +- testing: 4 core 8 GB shared CPU +- production: 8 core 16 GB dedicated CPU (roughly half CPU load for 107 simultaneous users, 2024) + - maybe 8 core 16 GB shared CPU next? + + +<a id="general-infrastructure-bigbluebutton-installing-bigbluebutton"></a> + +### Installing BigBlueButton + +1. Create the instance. + - Linode 4core 8GB shared CPU + - Image: Ubuntu 22.04 +2. Update the DNS for bbb.emacsverse.org with its IP address. +3. Download the BBB installer and make it executable. +4. ufw allow 16384:32768/udp +5. Run the BBB installer: `./bbb-install.sh -v jammy-300 -s bbb.emacsverse.org -e emacsconf@sachachua.com -g` +6. `sudo apt install bbb-playback-video` and then follow the instructions at [Server Customization | BigBlueButton](https://docs.bigbluebutton.org/3.0/administration/customize/#install-additional-recording-processing-formats) . + - /usr/local/bigbluebutton/core/scripts/bigbluebutton.yml: + + steps: + archive: 'sanity' + sanity: 'captions' + captions: + - 'process:presentation' + - 'process:video' + 'process:presentation': 'publish:presentation' + 'process:video': 'publish:video' + - systemctl restart bbb-rap-resque-worker.service +7. docker exec -it greenlight-v3 bundle exec rake admin:create[’name’,’email’,’password’] + + +### System audio limitations + +Sharing system audio by changing the audio device to “Built-in Audio Analog Stereo” is very choppy, only gets captured in the recording if I’m using Firefox (not Chrome) AND there’s at least one listener, and doesn’t allow simultaneous narration from the speaker. + +Using pulseaudio to change the app’s recording device to the audio monitor results in smoother audio (because it’s pretending to be the microphone), but still doesn’t allow simultaneous narration from the speaker. + +Combining microphone + system audio into a new virtual microphone source is probably more complicated than we want to walk speakers through. + +BBB says sharing system audio works only if you use Chrome on Mac OS X or Microsoft Windows (<https://support.bigbluebutton.org/hc/en-us/articles/1500005315642-Can-I-play-a-video-using-screen-sharing>). I tested it on Linux and sharing system audio is not an option. If you happen to know of any more elegant way to do this, I’d love to hear it. + +Related: <https://github.com/bigbluebutton/bigbluebutton/issues/8632> + + +### DONE Create meeting rooms for each speaker + + docker exec -it greenlight-v3 /bin/bash -c "bundle exec rails console" + + user_id = User.find_by_email("emacsconf@sachachua.com").id + +1. <elisp:emacsconf-bbb-create-rooms> +2. <elisp:emacsconf-bbb-load-rooms>: set the ROOM properties. +3. <elisp:emacsconf-publish-bbb-static-redirects> + +Print out the room IDs with: + + Room.all.each { |x| puts x.friendly_id + " " + x.name }; nil + +It’s possible to change the friendly\_id and then use `x.save!`. + + +### DONE Set up moderator access codes + +- <elisp:emacsconf-bbb-spookfox-set-moderator-codes> +- <elisp:emacsconf-bbb-spookfox-confirm-settings> + +Then you can use <elisp:emacsconf-mail-checkin-instructions-for-attending-speakers> +or <elisp:emacsconf-mail-checkin-instructions-to-all> to send the info. + + +### Processing BBB videos + +`bbb-record --list` shows all the recordings. You can use `bbb-record --rebuild` to regenerate the meeting, and `bbb-record --watch` to monitor progress. Presentation is a web-based interface, video is a single video file that contains the webcam, the screenshare, and the audio. + +If you don’t see the video format, doublecheck that [the video format is enabled](#general-infrastructure-bigbluebutton-installing-bigbluebutton). + +bbb-record seems to call `ruby /usr/local/bigbluebutton/core/scripts/process/video.rb -m ID`, which might be a useful backup. + + +### Backing up BBB :backup: + +rsync -avze ssh root@bbb:/var/bigbluebutton/ bigbluebutton/ + +ssh root@bbb ’tar zcvf - /var/bigbluebutton /etc/bigbluebutton /root/greenlight-v3 /usr/local/bigbluebutton /usr/share/bbb-web’ > bbb-backup-$(date “+%Y-%m-%d”).tar.gz + +ssh root@bbb ’dd if=/dev/sda bs=5M ’ | dd of=bbb-img-$(date “+%Y-%m-%d”).img status=progress + + +### Scaling BBB up and down + +[Scaling a BigBlueButton server down to a 1 GB node between uses](https://sachachua.com/blog/2025/01/scaling-a-bigbluebutton-server-down-to-a-1-gb-node-between-uses/) + +When the server is downscaled, `/etc/nginx/sites-backup` configures the Nginx. +The web root is `/var/www/bigbluebutton-default/assets`, and the page is `/var/www/bigbluebutton-default/assets/backup/index.html`. + + +### Spinning BBB up again from scratch + +Previous notes: + +1. Create a Nanode. +2. Update the DNS for bbb.emacsverse.org with its IP address. (dns.he.net) +3. Reboot into Rescue mode. In Lish: + + passwd # set interactively + sed -i -e 's/#PasswordAuthentication yes/PasswordAuthentication yes/g' /etc/ssh/sshd_config + echo 'PermitRootLogin yes' >> /etc/ssh/sshd_config + service ssh start +4. From the backup directory: + gunzip -c bbb-img-2024-12-08.img.gz | ssh root@bbb.emacsconf.org “dd of=/dev/sda bs=4M status=progress oflag=direct iflag=fullblock” +5. After I resized to 4core 8GB RAM, I couldn’t log in with SSH, so I used the Linode shell. `sshd -t` said no host keys available. Fix: + + ssh-keygen -A + service ssh --full-restart +6. ./bbb-install.sh -v jammy-300 -s bbb.emacsverse.org -e emacsconf@sachachua.com + +Resources: + +- <https://overto.eu/posts/gunzip-into-dd/> +- <https://www.linode.com/community/questions/20386/how-do-i-ssh-to-linode-from-the-finnix-boot-in-order-to-copy-my-local-vm-over-to> +- <https://github.com/bigbluebutton/bigbluebutton/issues/9485> + + +<a id="general-infrastructure-manual-irc-announcements"></a> + +## TODO Manual IRC announcements + +Success: + +- [X] You can /opall, /conftopic, and /broadcast + + +<a id="orgc7d6d2a"></a> + +## Check test crontab + + +<a id="general-infrastructure-confirm-automated-irc-announcements-from-res"></a> + +## TODO Confirm automated IRC announcements from res + +Success: + +- A test schedule can generate announcements. + + See C-u M-x emacsconf-stream-crontabs + + +<a id="general-infrastructure-low-res-stream"></a> + +## Low-res stream + +Should be automatic, handled by Icecast +backup on live: + +- /usr/local/bin/emacsconf-lowres-gen-on-connect +- /usr/local/bin/emacsconf-lowres-dev-on-connect + + +<a id="general-infrastructure-upload-talks-to-youtube"></a> + +## Upload talks to YouTube + +[Channel videos](https://studio.youtube.com/channel/UCwuyodzTl_KdEKNuJmeo99A/videos/upload?filter=%5B%5D&sort=%7B%22columnType%22%3A%22date%22%2C%22sortOrder%22%3A%22DESCENDING%22%7D) + + (seq-keep + (lambda (o) + (when (and (string= (plist-get o :status) "TO_STREAM") + (not (plist-get o :youtube))) + (list + (plist-get o :slug) + (org-link-make-string + (concat "copy:" + ) + "video file") + (org-link-make-string + (format "elisp:(emacsconf-publish-video-description \"%s\" t)" + (plist-get o :slug)) + "desc") + (if (emacsconf-talk-file o "--main.vtt") + (org-link-make-string + (concat "copy:" + (emacsconf-talk-file o "--main.vtt")) + "sub file") + "") + (org-link-make-string + (concat "elisp:(emacsconf-set-property-from-slug \"" + (plist-get o :slug) + "\" \"YOUTUBE\" (read-string \"YouTube URL: \"))" + ) + "save") + (plist-get o :scheduled)))) + (emacsconf-publish-prepare-for-display (emacsconf-get-talk-info))) + + +<a id="general-infrastructure-restream-to-youtube"></a> + +## Restream to YouTube + + +### TODO Set up YouTube restreaming events + +Need to have set up shifts first. + +1. Switch to the EmacsConf account. +2. Go to <https://studio.youtube.com/channel/UCwuyodzTl_KdEKNuJmeo99A> +3. Create > Go live > Schedule stream. + - [X] Gen - Sat AM + - [X] Gen - Sat PM + - [X] Dev - Sat AM + - [X] Dev - Sat PM + - [X] Gen - Sun AM + - [X] Gen - Sun PM + - [X] Test + + emacsconf-stream-copy-livestream-description + + Then set the emacsconf-rtmp-shifts variable. See the conf.org from 2025 for an example. + + This will be used in the shift hyperlists, which you can generate with emacsconf-pad-prepopulate-shift-hyperlists + + There’s also a note in the ansible README.org about restreaming. + Set up the `restreaming_platforms` variable in `prod-vars.yml` and + use `ansible-playbook -i inventory.yml prod-playbook.yml --tags restream` to set up + + +<a id="orgdc911e7"></a> + +## Restream to Toobnix + + +### DONE Set up Toobnix restreaming events + +1. <https://toobnix.org>, Publish, Permanent/recurring live +2. emacsconf-stream-toobnix-copy-livestream-description + + +<a id="org692ea98"></a> + +## i3 window manager + +termit is the terminal + +- M-d: launcher +- M-1, M-2: change workspace + + <a id="other"></a> # Other process notes @@ -199,3 +1562,121 @@ For each talk: ssh bbb.emacsverse.org docker exec -it greenlight-v2 bundle exec rake user:create["USERNAME","EMAIL","PASSWORD","user"] + +<a id="org5f8f6b0"></a> + +## Schedule changes + +In general: + + (emacsconf-schedule-update-from-info) + (emacsconf-update-schedule) + (emacsconf-publish-watch-pages) + (emacsconf-publish-talks-json-to-files) + (emacsconf-publish-info-pages) + + +### When a talk is added after the schedule has already been drafted + +- [X] Add the talk to conf.org +- [X] Add the talk ID to the draft schedule +- [X] Run the draft schedule block +- [X] <elisp:emacsconf-schedule-update-from-info> +- [X] <elisp:emacsconf-publish-talks-json-to-files> +- [X] Generate pads with `ansible-playbook -i inventory.yml prod-playbook.yml --tags pad` +- [X] <elisp:emacsconf-set-file-prefixes> +- [X] <elisp:emacsconf-update-schedule> +- [X] <elisp:emacsconf-stream-generate-overlays> +- [X] <elisp:emacsconf-stream-generate-test-videos> +- [X] `rsync -avze ssh ~/proj/emacsconf/2024/assets/ res:/data/emacsconf/shared/2024/assets/` +- [X] Send the upload instructions +- [X] Generate the intro text +- [ ] Record the intro + + +### When a talk is cancelled + +<elisp:emacsconf-cancel-talk> + +1. Update the status to CANCELLED. Update that specific talk with <elisp:emacsconf-publish-info-pages-for-talk>. +2. Rejig the schedule if needed, and update with <elisp:emacsconf-schedule-update-from-info> +3. Update the published schedule with <elisp:emacsconf-update-schedule>. + +Manual steps: + +1. Push the wiki. +2. Regenerate the intros (before, after). <elisp:emacsconf-stream-generate-in-between-pages>, then use <elisp:subed-record-compile-video> in the intros file. +3. Resync the cache directory. +4. Consider updating the screenshots for sat-open and sun-open. + + +### When a talk changes title + +1. Update the title in conf.org. +2. Delete the FILE\_PREFIX property. +3. Call <elisp:emacsconf-set-file-prefix-if-needed>. +4. Rename existing files with <elisp:emacsconf-update-file-prefixes>. +5. Update the intro VTT file with the new title. +6. Update the wiki page for the talk. +7. Regenerate the in-between images with <elisp:emacsconf-stream-generate-in-between-pages> +8. Rerecord and recompile the intro, and recompile the intro for the talk after it. +9. <elisp:emacsconf-update-schedule> +10. <elisp:emacsconf-pad-prepopulate-hyperlists> + + +<a id="change-talk-qa"></a> + +## When a talk Q&A changes method + +1. Update the talk property. +2. Update the schedule with <elisp:emacsconf-update-schedule> +3. Regenerate the intros (before, after). <elisp:emacsconf-stream-generate-in-between-pages>, then use <elisp:subed-record-compile-video> in the intros file. +4. Sync the new intros to the /data/emacsconf/shared/$YEAR/assets/intros directory. +5. Regenerate the pads: <elisp:emacsconf-pad-prepopulate-all-talks> +6. Regenerate talks.json: <elisp:emacsconf-publish-talks-json-to-files> + + +<a id="other-process-notes-to-play-the-other-stream"></a> + +## To play the other stream + +- `mpv --profile=full https://live0.emacsconf.org/gen.webm` +- Change the channel topic to note that discussion can be in the other channel + + +<a id="other-process-notes-when-a-system-is-down"></a> + +## When a system is down + +Let people know in #emacsconf and #emacsconf-org + +Update the status page: + +<file://ssh:orga@front0.emacsconf.org:/var/www/status.emacsconf.org/index.html> + +/broadcast <message> may also be helpful + + +<a id="other-process-notes-when-we-need-to-bring-on-a-last-minute-volunteer"></a> + +## When we need to bring on a last-minute volunteer + +/backstage nick + +will give them the backstage credentials and links to the index + + +<a id="other-process-notes-checking-people-in"></a> + +## Checking people in + +/checkin nick +/room nick (should be automatic if live, but there just in case) + + +<a id="other-process-notes-ansible"></a> + +## Ansible + + git clone git@git.emacsconf.org:pub/emacsconf-ansible + diff --git a/organizers-notebook/index.org b/organizers-notebook/index.org index 47c45691..14f3648d 100644 --- a/organizers-notebook/index.org +++ b/organizers-notebook/index.org @@ -41,26 +41,28 @@ Check in with core organizers from the previous year to see who's in. This repository will store submissions, contact information, etc. 1. Create the repository on ~front0~. Ex: - #+begin_src sh :eval no + + #+begin_src sh + export YEAR=2025 sudo su - git cd repositories - mkdir emacsconf-2024-private.git - cd emacsconf-2024-private.git + mkdir emacsconf-$YEAR-private.git + cd emacsconf-$YEAR-private.git git init --bare #+end_src - 2. Edit ~gitolite-admin/config/gitolite-conf~. Add lines for the group and the repo. Commit and push. Ex: + 2. In the ~gitolite-admin~ repo, edit ~conf/gitolite-conf~. Add lines for the group and the repo. Commit and push. Ex: #+begin_example @emacsconf-2024-org = bandali sachac ... repo emacsconf-2024-private - RW+ = @admins @emacsconf-2024-org orga + RW+ = @admins @emacsconf-2024-org orga #+end_example - 3. Clone the private repository into the appropriate location. ~git clone git@git.emacsconf.org:emacsconf-2024-private private~ + 3. Clone the private repository into the appropriate location. ~git clone git@git.emacsconf.org:emacsconf-2025-private private~ ** Create the public organizers' notebook in the wiki :PROPERTIES: :CUSTOM_ID: starting-up-the-conference-planning-process-create-the-public-organizers-notebook-in-the-wiki :END: -Ex: 2024/organizers-notebook/index.org +Ex: file:../2024/organizers-notebook/index.org * Phases and lessons learned :PROPERTIES: :CUSTOM_ID: phases-and-lessons-learned @@ -71,16 +73,100 @@ Ex: 2024/organizers-notebook/index.org :END: Create linked pages -- [ ] year index -- [ ] volunteer page -- [ ] submit page +- [ ] year index: ex: [[file:../2024.md]] +- [ ] volunteer page: ex: [[file:../volunteer.md]] +- [ ] submit page: ex: [[file:../2024/submit.md]] *** How to mark pages as drafts +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-draft-cfp-how-to-mark-pages-as-drafts +:END: + +Have a Markdown export block with the following contents. Replace { and } with [ and ]. + +#+begin_export md +{{!template id=pagedraft}} +#+end_export md + +*** Wiki template for year index +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-draft-cfp-wiki-template-for-year-index +:END: + +Replace { and } with [ and ]. + +#+begin_example +{{!meta copyright="Copyright © 2021-2022 Amin Bandali; 2023-2025 Sacha Chua"}} + +<p class="center">EmacsConf 2025 | Online Conference<br /> +<b>December 6 and 7, 2024 (Sat-Sun)</b></p> + +<p class="center">{{!img /i/emacsconf-logo1-256.png +alt="EmacsConf logo"}}</p> + +<p class="center">{{<b>Call for Participation</b>|cfp}} | {{Ideas}} | +{{Submit a Proposal|submit}} | {{Volunteer}} | {{Guidelines for Conduct|conduct}}</p> + +<p class="center">EmacsConf is the conference about the joy of +<a href="https://www.gnu.org/software/emacs/">GNU Emacs</a> and +Emacs Lisp.</p> + +We are busy putting things together for EmacsConf 2025, and we would +love to have *your* help to make EmacsConf 2025 amazing, much like the +previous EmacsConfs. See our {{**Call for Participation**|cfp}}, get +involved, and help spread the word! + +We are holding EmacsConf 2025 as an online conference again this year. +We remain fully committed to freedom, and we will continue using our +infrastructure and streaming setup consisting entirely of {free +software}{freesw}, much like previous EmacsConf conferences. + +For general EmacsConf discussions, join the +{emacsconf-discuss}(https://lists.gnu.org/mailman/listinfo/emacsconf-discuss) +mailing list. For discussions related to organizing EmacsConf, join +the +{emacsconf-org}(https://lists.gnu.org/mailman/listinfo/emacsconf-org) +mailing list. You can email us publicly at +<mailto:emacsconf-org@gnu.org> or privately at +<mailto:emacsconf-org-private@gnu.org>. + +Come hang out with us in the `#emacsconf` channel on `irc.libera.chat` +({Libera.Chat}{libera} IRC network). You can join the chat using +{your favourite IRC client}{libera-emacsconf}, or by visiting +{chat.emacsconf.org}{chat} in your web browser. + +{freesw}: https://www.gnu.org/philosophy/free-sw.html +{libera}: https://libera.chat +{libera-emacsconf}: ircs://irc.libera.chat:6697/emacsconf +{chat}: https://chat.emacsconf.org +#+end_example -Put inside double square brackets: =!template id=pagedraft= *** Previous years +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-draft-cfp-previous-years +:END: [[file:~/proj/emacsconf/wiki/2023/cfp.org][2023]] +*** Update dates +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-draft-cfp-update-dates +:END: + +[[file:~/proj/emacsconf/lisp/emacsconf.el]] +[[file:~/proj/emacsconf/lisp/emacsconf-erc.el]] + +*** Update the IRC topic +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-draft-cfp-update-the-irc-topic +:END: + +#+begin_src emacs-lisp +(erc-cmd-OPALL) +(erc-cmd-CONFTOPIC (emacsconf-replace-plist-in-string + `(:year ,emacsconf-year :cfp-deadline ,emacsconf-cfp-deadline) + "Getting ready for EmacsConf ${year}! Call for proposals: https://emacsconf.org/${year}/cfp by ${cfp-deadline}, volunteer: https://emacsconf.org/volunteer/")) +(erc-cmd-DEOPALL) +#+end_src *** Lessons learned :PROPERTIES: @@ -120,7 +206,38 @@ Put inside double square brackets: =!template id=pagedraft= (especially for Pacific time). Extending beyond 5pm puts strain on European organizers and volunteers, though. - Put the speaker introduction right after the talk description for easier web page copying. +** Announce +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-announce +:END: + +- Post CFP to emacsconf-discuss, reddit.com/r/emacs, and in Emacs News +- Submit to https://foss.events/ + +*** Promote the conference +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-announce-promote-the-conference +:END: + +Submit to https://foss.events/ + +Maybe it would be good to get in touch with podcasts like + +- [[https://systemcrafters.net/][System Crafters]] +- [[https://www.youtube.com/playlist?list=PLbFVcOQ-YH_LRP687N0YeN78YZmBp5wqF][This Week in Linux]] +- [[https://linuxunplugged.com/][Linux Unplugged]] +- [[http://asknoahshow.com/][Ask Noah]] +- [[https://linuxafterdark.net/][Linux After Dark]] +- [[https://anonradio.net/][Lispy Gopher Show]] + +etc to give a heads up on EmacsConf before it +happens and also mention to them when videos are +available to spark more interest. + ** Process proposals +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-process-proposals +:END: 1. In the private repository, create a conf.org. 2. Set ~emacsconf-org-file~ to its location. @@ -147,7 +264,10 @@ When proposals come in: SLUG, EMAIL, NAME_SHORT, CUSTOM_ID, TRACK, TIMEZONE, CATEGORY, DATE_SUBMITTED, PUBLIC_EMAIL -** Accept proposals +** Accept proposals :email: +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-accept-proposals +:END: Setup: @@ -160,6 +280,19 @@ For each talk: 3. Create wiki page with ~emacsconf-publish-add-talk~. 4. Use ~emacsconf-publish-info-pages~ and ~emacsconf-publish-schedule~ as needed. 5. Send acceptance e-mail with ~emacsconf-mail-accept-talk~ + +After the CFP ends: + +1. Change the yyyy.md page to remove the CFP and submit links. +2. Update the yyyy/sidebar.md page to remove the CFP and submit links. +3. Update the yyyy/talks.md page to remove the CFP. +4. Change the IRC channel topics. + 1. ~/opall~, + 2. ex: ~/conftopic Getting ready for EmacsConf 2025! Volunteer: https://emacsconf.org/volunteer~ + 3. ~/deopall~ + +[[https://git.emacsconf.org/emacsconf-wiki/commit/?id=9b2c5a6f86d9e4c3faf4c7f028eabb758583fa97][Example git commit]] + ** Draft schedule :PROPERTIES: :CUSTOM_ID: draft-schedule @@ -174,6 +307,1437 @@ For each talk: - Q_AND_A: pad - Create draft-schedule section in the public organizers notebook for the year - Add missing items to plan +*** TODO Send draft schedule to speakers :email: +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-draft-schedule-send-draft-schedule-to-speakers +:END: + +1. Evaluate the draft schedule we want to use. +2. ~emacsconf-schedule-update-from-info~ +3. ~C-u M-x emacsconf-mail-template-to-all-groups RET emacsconf-mail-draft-schedule RET~ +4. If that looks good, ~M-x emacsconf-mail-template-to-all-groups~. You can use ~M-x emacsconf-mail-merge-send-all~ to send all the drafts, or send them one by one. + +** Set up backstage and upload +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-set-up-backstage-and-upload +:END: + +See [[emacsconf-ansible:README.org]]. + +Lessons learned: + +- Next year, let's get upload.emacsconf.org in place as the domain name so that people don't try to FTP files to it. +*** DONE Send backstage and upload instructions :email: +CLOSED: [2025-11-12 Wed 13:48] +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-set-up-backstage-and-upload-send-backstage-and-upload-instructions +:END: +** Post the schedule +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-post-the-schedule +:END: + +- [[elisp:(setq emacsconf-publishing-phase 'schedule)]] +- elisp:emacsconf-publish-info-pages +- elisp:emacsconf-publish-schedule-org-files +- elisp:emacsconf-ical-generate-all +- Update talks.md to refer to watch.md as well +** Process uploaded files +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-process-uploaded-files +:END: + +Basic setup: + +1. Set up the media server and symlinks: [[emacsconf-ansible:README.org]] (Media). +2. Set up the prerec processing areas on res: [[emacsconf-ansible:README.org]] (Processing prerecs). +2. Set up the caption processor on res: [[emacsconf-ansible:README.org]] (Captioning). + +Process: + +1. Review uploaded files with elisp:emacsconf-upload-dired +2. Open the JSON for the file you want to process and use elisp:emacsconf-upload-copy-from-json . + If more than one file uses the same extension, provide a suffix to disambiguate them. + If emacsconf-upload-copy-from-json might take a long time, you can also scp the file to your local +3. On res: + 1. Create a directory ~/current/files/$slug. + 2. Copy the uploaded file from ~/cache as =$video_slug--original.$extension=, or use =rename-original.sh $slug $file=. + 3. Call =process-prerec.sh $file=. +4. When the screens are finished, do locally: + 1. update-cache on my computer. + 2. elisp:emacsconf-publish-cache-video-data or elisp:emacsconf-cache-all-video-data + 3. elisp:emacsconf-publish-backstage-index +** TODO Generate assets +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-generate-assets +:END: +*** In-between pages +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-generate-assets-in-between-pages +:END: +- Make the $year/assets/in-between directory and copy the template.svg from the previous year. +- elisp:emacsconf-stream-generate-in-between-pages +*** Intros +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-generate-assets-intros +:END: +- In an empty VTT file, elisp:emacsconf-subed-intro-subtitles +- Record the audio and get captions +- Splice together into a file that will be processed with subed-record-compile-video. +*** TODO Test videos +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-generate-assets-test-videos +:END: +elisp:emacsconf-stream-generate-test-videos +** Record pronunciations +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-record-pronunciations +:END: +*** DONE Record pronunciations +CLOSED: [2025-11-22 Sat 17:41] +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-record-pronunciations-record-pronunciations +:Effort: 2:00 +:END: +:LOGBOOK: +CLOCK: [2025-11-21 Fri 12:58]--[2025-11-21 Fri 15:10] => 2:12 +:END: + +1. mkdir -p ~/proj/emacsconf/2025/assets/intros ~/proj/emacsconf/2025/assets/in-between +2. cp ~/proj/emacsconf/2024/assets/in-between/template.svg ~/proj/emacsconf/2025/assets/in-between/template.svg +3. elisp:emacsconf-stream-generate-in-between-pages +4. Create ~/proj/emacsconf/2025/assets/intros/intro.vtt +5. elisp:emacsconf-subed-intro-subtitles +6. Record the audio, possibly with subed-record, left, and right. +7. Split the lines for nicer subtitles. +8. Use elisp:subed-record-compile + +*** DONE E-mail speakers asking them to confirm the pronunciations +CLOSED: [2025-11-22 Sat 17:41] +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-record-pronunciations-e-mail-speakers-asking-them-to-confirm-the-pronunciations +:END: +** Prepare the infrastructure +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-prepare-the-infrastructure +:END: + +Checklist: + +- [ ] IRC + - [ ] Manual announcements + - [ ] Automated announcements +- [ ] Web conference +- [ ] Streaming assets + - [ ] Overlays + - [ ] Intros +- [ ] OBS +- [ ] VNC +- [ ] Publishing to the wiki +- [ ] Publishing to the media server +- [ ] Etherpad +- [ ] Mumble +- [ ] Icecast + +** Getting ready for captions +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-getting-ready-for-captions +:END: + +Onboarding: + +- Add captioner to conf.org with the ~:caption:~ tag, under a Volunteers heading with the ~volunteer~ tag. Make sure the ~EMAIL~ property is set. +- Add captioner to emacsconf-org mailing list. +- Send backstage information elisp:emacsconf-mail-backstage-info-to-volunteer . (Can be sent to all captioning volunteers with elisp:emacsconf-mail-backstage-info-to-captioning-volunteers) +** Getting ready for the conference +:PROPERTIES: +:CUSTOM_ID: pre-conf +:END: + +elisp:emacsconf-pad-prepopulate-shift-hyperlists +*** DONE Check in with speakers for cancellations, adjustments +CLOSED: [2025-11-28 Fri 21:32] +:PROPERTIES: +:Effort: 1:00 +:END: +:LOGBOOK: +CLOCK: [2025-11-21 Fri 11:12]--[2025-11-21 Fri 11:14] => 0:02 +:END: + +emacsconf-mail-intro-to-all +*** DONE Record opening remarks +CLOSED: [2025-12-08 Mon 21:37] SCHEDULED: <2025-12-02 Tue> +:PROPERTIES: +:CREATED: [2025-11-28 Fri 21:32] +:END: +*** TODO Send check-in details, schedule update, etc. :email: +:PROPERTIES: +:CREATED: [2024-11-27 Wed 17:34] +:CUSTOM_ID: phases-and-lessons-learned-getting-ready-for-the-conference-send-check-in-details-schedule-update-etc +:END: + +*** One day before the conference +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-getting-ready-for-the-conference-one-day-before-the-conference +:END: + +- [X] Set ~emacsconf-publishing-phase~ to ~conference~. +- [X] Set emacsconf-publish-include-pads to t. +- [X] Republish the schedule and the info pages. +- [X] Update the conf.org and the wiki on res. (~/emacsconf-2025-private, ~/emacsconf-wiki) +- [X] Resize the BBB server to production levels with bbb-prod: 16 GB $0.1440/hour 6 CPUs +- [X] Send check-in details and last-minute schedule updates. +- [X] Start thelounge on front0: systemctl start thelounge. +- [X] Confirm I can connect to Mumble. +- [X] Resize front0 to production: front0 shared Linode 32GB 8 CPUs 640GB $0.2880/hour +- [X] Resize live0 to production: shared Linode 64GB 16 CPUs $0.5760/hour + - [X] CONFIRM DISK SIZE +- [X] Resize BBB to production + - [X] CONFIRM DISK SIZE +- [X] Start the VNC servers. + #+begin_src sh :tangle emacsconf-set-up-tracks.sh + #!/bin/bash + # SSH to both + cd ~/proj/emacsconf/emacsconf-ansible + + # Gen + export TRACK=gen; TRACK_PORT=5905; export SSH_PORT=46668 + ssh emacsconf-$TRACK@res.emacsconf.org -p $SSH_PORT /home/emacsconf-$TRACK/bin/track-vnc + sleep 5 + ssh emacsconf-$TRACK@res.emacsconf.org -N -L $TRACK_PORT:127.0.0.1:$TRACK_PORT -p $SSH_PORT & + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & + + # Dev + export TRACK=dev; export TRACK_PORT=5906; export SSH_PORT=46668 + ssh emacsconf-$TRACK@res.emacsconf.org -p $SSH_PORT /home/emacsconf-$TRACK/bin/track-vnc + sleep 5 + ssh emacsconf-$TRACK@res.emacsconf.org -N -L $TRACK_PORT:127.0.0.1:$TRACK_PORT -p $SSH_PORT & + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & + #+end_src +- [X] Confirm that we can use "Start Recording" to stream to gen. + - [X] play-with-intro sat-open + - [X] https://live.emacsconf.org/2025/watch/gen/ + - [X] mpv https://live0.emacsconf.org/gen.webm + - [X] play-with-intro sun-open (to check the overlays) + - [X] https://live.emacsconf.org/2025/watch/gen-480p/ + - [X] mpv https://live0.emacsconf.org/gen-480p.webm +- [X] Confirm that we can stream to dev. + - [X] play-with-intro sat-open + - [X] https://live.emacsconf.org/2025/watch/dev/ + - [X] mpv https://live0.emacsconf.org/dev.webm + - [X] play-with-intro sun-open (to check the overlays) + - [X] https://live.emacsconf.org/2025/watch/dev-480p/ + - [X] mpv https://live0.emacsconf.org/dev-480p.webm +- [X] Confirm that I can restream to YouTube. + - Settings - Stream, paste in the RTMP key for the relevant event, then Start Streaming. + - [X] gen + - [X] dev +- [X] Confirm that I can restream to Toobnix + - [X] live0: restream-gen-toobnix + - [X] live0: restream-dev-toobnix +- [X] Check automated announcements and publishing + - [X] orga@res: talk sat-open TO_STREAM + - [X] https://emacsconf.org/2025/talks/sat-open/ doesn't have video + - [X] https://media.emacsconf.org/2025 doesn't have it + - orga@res: talk sat-open PLAYING + - [X] https://emacsconf.org/2025/talks/sat-open/ has video and transcript + - [X] https://media.emacsconf.org/2025 has talk files + - [X] IRC announcement in #emacsconf-gen +- [X] Confirm icecast stats are available: http://live0.emacsconf.org/admin/stats (username: admin, password is in prod-vars.yml) +- [X] Generate and check all the crontabs elisp:emacsconf-stream-crontabs +- [X] Generate all the hyperlists + +** During the conference +:PROPERTIES: +:CUSTOM_ID: conf +:END: +elisp:emacsconf-pad-open-shift-hyperlist + + + VNC connection + + See https://emacsconf.org/organizers-notebook/#vnc + + DO NOT RESIZE THE WINDOW + + Manual control + + emacsconf-stream-display-clock-and-countdown + + Shell scripts: + + music + + handle-session <talk-id> (ex: handle-session sat-open) + + plays the intro, the video (if any), and opens the Q&A + + keep an eye on it + + play <talk-id> + + play-with-intro <talk-id> + + handle-qa <talk-id> + + bbb <talk-id> + +** After the conference +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference +:END: +*** DONE Capture stats +CLOSED: [2025-12-07 Sun 17:26] +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-capture-stats +:END: + http://live0.emacsconf.org:8001/status.xsl +**** 2025 stats + +Saturday: +gen: 107 + 7 lowres +dev: 97 peak + 7 peak lowres + +Sunday: I forgot to copy icecast stats; maybe 70 peak on gen? + +Sunday: + +- res: + - %Cpu(s): 60.0 us, 6.7 sy, 0.0 ni, 33.3 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st + - MiB Mem : 48118.6 total, 15679.4 free, 7338.2 used, 26465.2 buff/cache +- bbb: + - CPU%: 3.0 us, 4.0 sy, 3.0 ni, 89.1 id, 0.0 wa, 0.0 hi, 1.0 si, 0.0 st + - Mem: 15988.8 total, 1450.0 free, 3552.0 used, 10986.9 buff/cache +- front: + - %Cpu(s): 2.4 us, 1.6 sy, 0.0 ni, 96.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st + - MiB Mem : 32169.5 total, 28072.2 free, 1257.1 used, 2840.2 buff/cache +- live: + - %Cpu(s): 7.5 us, 8.7 sy, 0.0 ni, 83.3 id, 0.0 wa, 0.0 hi, 0.4 si, 0.0 st + - MiB Mem : 64423.9 total, 56727.6 free, 797.6 used, 6898.8 buff/cache + +**** 2024 stats + +Saturday: +gen: 177 peak + 14 peak lowres +dev: 226 peak + 79 peak lowres + +Sunday: +gen: 89 peak + 10 peak lowres + +http://live0.emacsconf.org/admin/stats (username: admin, password is in prod-vars.yml) + +meet peak 409% CPU (100% is 1 CPU), average 69.4% +front peak 70.66% CPU (100% is 1 CPU) +live peak 552% CPU (100% is 1 CPU) average 144% +res peak 81.54% total CPU (each OBS ~250%), mem 7GB used + +so far we have used 1.2TB of transfer this month +*** DONE Back up the data +CLOSED: [2025-12-07 Sun 17:26] +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-back-up-the-data +:END: +**** Etherpad +elisp:emacsconf-pad-backup-talks + +This creates --pad.html and --pad.md in the cache. + +**** Icecast +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-back-up-the-data-icecast +:END: + +rsync -avzue ssh live:'/data/emacsconf-2025-*' ~/proj/emacsconf/2025/backups + +**** BigBlueButton +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-back-up-the-data-bigbluebutton +:END: + +rsync -avze ssh root@bbb:/var/bigbluebutton/ bbb/ + +ssh root@66.175.208.243 'dd if=/dev/sda bs=5M ' | dd of=bbb-img-2024-12-08.img status=progress + +The img can be loaded with +sudo losetup --find --show bbb-img-2024-12-08.img +sudo mount /dev/loop10 test +cd test +***** Reviewing all the Q&A durations and chat messages +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-back-up-the-data-bigbluebutton-reviewing-all-the-q-a-durations-and-chat-messages +:END: +#+begin_src emacs-lisp :eval no +(let ((default-directory "/home/sacha/proj/emacsconf/2024/backups/bigbluebutton/published/video")) + (mapconcat + (lambda (dir) + (let ((chat (xml-parse-file + (expand-file-name "video.xml" dir))) + (metadata (xml-parse-file + (expand-file-name "metadata.xml" dir)))) + (concat + "- " + (dom-text (car (dom-by-tag metadata 'meetingName))) " (" + (format-seconds "%.2h:%z%.2m:%.2s" + (/ (string-to-number (dom-text (dom-by-tag metadata 'duration))) + 1000)) + ")" + "\n" + (if (dom-by-tag chat 'chattimeline) + (mapconcat (lambda (node) + (concat " - " (dom-attr node 'name) ": " + (dom-attr node 'message) "\n")) + (dom-by-tag chat 'chattimeline) + "") + "") + "") + ) + ) + (directory-files "." nil "-")) + ) +#+end_src + +- Copy IRC logs to cache and therefore to backstage: (ex: 2024-12-07-emacsconf-gen.txt) +*** DONE Resize the server disks +CLOSED: [2025-12-07 Sun 17:26] +SSH and use df to check first. Needs to fit under these limits: + +- [X] front0: 25 GB + - [X] disk + - [X] server resized to Nanode 1 GB +- [X] live0: 25 GB + - [X] disk + - [X] server resized to Nanode 1 GB +- [X] bbb: 25 GB + - [X] disk + - [X] server resized to Nanode 1 GB +Shut down the servers after backing up. + +1. In the Linode console, click on the linode. +2. Go to Storage. +3. Use the 3-dot menu on Debian 10 disk to reisze. +*** DONE Process the Q&A recordings and live presentations; upload to YouTube +CLOSED: [2025-12-30 Tue 12:33] +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-process-the-q-a-recordings-and-live-presentations +:END: + +- Save answers videos as --answers.webm. +- From the pad file: emacsconf-extract-copy-pad-to-wiki +- update cache +- Set ~QA_PUBLIC~ property to t as each Q&A gets processed. +- change status to ~TO_INDEX_QA~ +- emacsconf-publish-media-files-on-change +- emacsconf-publish-info-pages-for-talk + +Indexing + +- emacsconf-extract-insert-note-with-question-heading +- emacsconf-subed-make-chapter-file-based-on-comments +- change status to ~TO_CAPTION_QA~ + +Also copy the YouTube comments and IRC comments +emacsconf-extract-irc-anonymize-log + + +answers--backstage--split.txt +answers--backstage--split.vtt + +subed-shift-subtitles-to-start-at-timestamp + +ffmpeg -i --answers--backstage--reencoded.webm -ss START-TIME -to END-TIME --answers--backstage--trimmed.webm +ffmpeg -i --answers--backstage--trimmed.opus + +Open --answers--backstage--trimmed.opus in Audacity. Select all the audio with Ctrl+A. Use Filter - Effect - Volume and Compression to normalize it to -16 LUFS. Export to --answers--backstage--normalized.opus + +Use https://studio.youtube.com to upload the video. +Use emacsconf-publish-answers-description to get the answer description, and move the title (and possibly the speaker name) to the video title. +Add the video to the playlist. +Set the ~QA_YOUTUBE_URL~ property. + +Play the preview and jump around to different points in the video to check if there are encoding errors. +*** DONE Upload videos and Q&A sessions to Toobnix +CLOSED: [2025-12-28 Sun 21:27] + +Install peertube-cli. + +emacsconf-extract-toobnix-api-setup + +emacsconf-publish-toobnix-upload-all +emacsconf-publish-toobnix-upload-all-captions + +Manually add to and reorganize the playlist as needed. (Automate this someday?) + +*** DONE Copy the Q&A from the pad and add them to the wiki +CLOSED: [2025-12-28 Sun 19:34] +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-combine-the-irc-logs-and-the-pads-and-add-them-to-the-wiki +:END: +*** DONE Copy interesting questions and remarks from IRC to the wiki +CLOSED: [2025-12-28 Sun 19:34] + +Our goal is to copy the discussions from IRC to +the wiki pages so that speakers can see any +questions or feedback they've missed. + +To copy the logs: + +1. Use M-x flush-lines to remove any lines with ~***~. +2. Copy the IRC logs to the cache directory with a filename like yyyy-mm-dd-channel.txt (ex: 2025-12-07-emacsconf-gen.txt). + +Then review each log. For each talk: + +1. Select the region for the talk. Figure out the speaker's nick. Use emacsconf-extract-irc-anonymize-log and give it the nick. +2. Use emacsconf-extract-irc: + + - t: open the talk in the other window + - UP and DOWN navigate by line. + - q: add the line to the other window as a question. + - a: add the line to the other window as an answer + - c: add the line to the other window + + +*** DONE Index the Q&A +CLOSED: [2025-12-28 Sun 19:34] + +For each talk with a live Q&A session: + +1. Open the pad and the VTT file. +2. Use ~C-u M-x subed-word-data-load-from-file~ to load the word data JSON with an offset depending on the start time that the video was trimmed to. +3. Use ~M-x subed-set-subtitle-comment~ or manually add ~NOTE~ comments. Correct recognition errors along the way. +4. Use ~emacsconf-subed-make-chapter-file-based-on-comments~ to create the chapter file. +5. Republish with elisp:emacsconf-publish-public-index to make sure the chapters show up. +6. Upload the corrected subtitles to the Q&A video on YouTube. +7. Use ~emacsconf-publish-answers-description~ to get the updated description. Paste it into the YouTube description. +8. Use ~emacsconf-publish-info-pages-for-talk~ to update the wiki pages for that talk. + +*** DONE Send thank-you emails to the speakers :email: +CLOSED: [2025-12-30 Tue 12:33] SCHEDULED: <2025-12-29 Mon> +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-send-thank-you-emails-to-the-speakers +:CREATED: [2025-12-28 Sun 21:27] +:END: + + + +*** CANCELLED Copy the Youtube comments to the wiki pages? +CLOSED: [2025-12-28 Sun 21:27] + +emacsconf-extract-youtube-api-setup +emacsconf-extract-youtube-comments-by-talk + +Better to direct the speakers to the YouTube videos so that they can discuss things directly. + +*** Write a report +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-write-a-report +:END: +Start with a longer blog post: +- https://sachachua.com/blog/2024/12/emacsconf-2024-notes/ + +A shorter version goes on the wiki: + +- https://emacsconf.org/2024/report/ +- https://emacsconf.org/2023/report/ + +*** Notify emacsconf-discuss@gnu.org that the Q&A is up +SCHEDULED: <2025-12-29 Mon> +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-notify-emacs-discuss-that-the-q-a-is-up +:CREATED: [2025-12-28 Sun 21:27] +:END: + +https://lists.gnu.org/archive/html/emacsconf-discuss/2024-12/msg00000.html + +#+begin_example +Hello, everyone! + +https://emacsconf.org/2024/talks and https://media.emacsconf.org/2024 +should have the talks and Q&A sessions now, hooray, including chapter +indices for the Q&A. I've also copied over notes from Etherpad and IRC +on the talk pages, and I've e-mailed them to the speakers so they can +update the wiki directly or send in additional answers. + +BigBlueButton audio mixing is kinda iffy, so I'm holding off on +uploading the Q&A videos (and the live talk for secrets) to +YouTube/Toobnix until Leo and other volunteers have a listen to see +whether the audio needs to be tweaked, and maybe even to do some kind of +normalization. Unfortunately, recordings with separate audio tracks per +participant aren't available--it would be cool to figure that out next +year--so some talks might need some manual processing. (Please feel free +to volunteer if that's up your alley!) In the meantime, you can check +out the Q&A videos from the talk pages on the wiki. Please let us know +if there's anything that needs tweaking. + +Enjoy! + +Sacha +#+end_example + +*** Send thank-you emails to the volunteers :email: +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-send-thank-you-emails-to-the-volunteers +:END: + +emacsconf-mail-template-ask-volunteer-for-mailing-address + +*** Process the lessons learned +:PROPERTIES: +:CUSTOM_ID: phases-and-lessons-learned-after-the-conference-process-the-lessons-learned +:END: +* Ideas for improvement +:PROPERTIES: +:CUSTOM_ID: ideas +:END: + +How can we make EmacsConf better for participants? Speakers? Volunteers? People who come across the videos afterwards? + +- Emacs: + - view Etherpad (read-only): might be able to query something like https://pad.emacsconf.org/2024/export/html or https://pad.emacsconf.org/2024/export/txt + - view upcoming talks, countdown? + - resources, past talks + - ??: Collaborative real-time editing? Not sure crdt.el or collab-mode can scale up as far as we like; how would we test this? +- HTML/CSS/JS: + - general design improvements? + - [[https://web.archive.org/web/20240806134541/https://emacsconf.org/2024/talks/][This is what the talks page looks like when there's no schedule yet]] + - [[https://web.archive.org/web/20241108132608/https://emacsconf.org/2024/talks/][This is what the schedule page looks like before the conference]] + - [[https://web.archive.org/web/20241208042046/https://emacsconf.org/2024/talks/literate/][This is what a talk page looks like before the conference]] + - [[https://web.archive.org/web/20241208034535/https://emacsconf.org/2024/watch/gen/][This is the watch page for the general track]] + - [[https://web.archive.org/web/20241212145433/https://emacsconf.org/2024/talks/literate][This is the same talk page after the conference, with the videos, notes, and captions]] + - [[https://emacsconf.org/2024/talks/][This is what the talks page looks like after the conference]] - list of resources + - timezone translations in the schedule SVG, on the schedule page, etc. + - countdown on talk pages? + - prettier viewers for videos, captions + - make it easier to see the talk/pad/IRC at the same time? + - easy timestamp jumping +- Volunteers: + - better documentation + - share to OBS from local? Maybe vdo.ninja? + - how do we manage the fallback/switchover in case we need to go back to shared VNC? + - meeting layout? + - countdown to switch over to the next talk, or easier manual control; web or command-line interface to control it? + - make it easier for people to join as hosts or check-in volunteers? + - improve backstage experience? + - automate or cross-train more people in what Sacha does (coordination, infrastructure) to reduce bus factor and increase awesomeness +- Processing: + - audio normalization: better workflow, more people helping + - noise removal (many speakers don't have external mics) + - Makefile improvements + - captioning: + - simplify common edits + - reflowing? check out [[https://gitlab.com/jun8git/sub-seg][sub-seg]]? + - handle last-minute uploads + - validation: make sure audio, video, and caption times agree +- Infrastructure: + - document media processing pipeline + - make media processing pipeline more hands-off; ideally, just copy the video to the directory and that kicks off everything including eventually republishing the backstage index + - add read-only non-JS links to pads; make the pads viewable through the web instead of being downloaded (.../export/html) + - upgrade to latest versions + - front0 and live0: currently Debian 10.13 + - [2025-09-21 Sun] bandali will look into upgrades, cleaning up + - [2025-09-19 Fri] sachac: e-mailed bandali to ask if I can do the upgrades or if he wants to + - ffmpeg 6.0.1, latest is 8 + - 7 has demuxing, decoding, filtering, encoding, and muxing in the ffmpeg CLI now all run in parallel + - OBS on res? Currently 29.1.2 + - probably no must-haves up to version 32, okay to stay with current version + - Do we want to go back to having hosts stream from their local computers? + - local: better performance + - via VNC: + - easier to switch in a different host or manage multiple streams + - easier to move files around + - consistent setup for profiles, overlays + - DONE Etherpad (upgrade 1.9.7 to 2.5.0) + - DONE BigBlueButton (deployed 3.0.12, which is the latest as of 2025-08-02) + - Consider 3.1 beta? new interface, probably new bugs; see if it's worth it? + - DONE Icecast (deployed 2.4.4-1) - decided to stick with current version + - [2025-09-21 Sun] Decision: stick with Icecast + - Leaning towards sticking with [[https://icecast.org/][Icecast]] + - 2.5.0-rc1? health reporting, bugfixes; probably not essential + - [[https://antmedia.io/][Ant Media Server]] community edition, to enable adaptive bitrate streaming, lower latency, and HLS for wider support? + - [[https://owncast.online/][Owncast]]? Automatic downscaling, Fediverse support; might need two instances to support two tracks + - [[https://github.com/ossrs/srs][SRS]]? record, replay? more of a building block? + - Nginx RTMP? More of a building block + - customize BigBlueButton welcome, slides, title, branding + - change the default presentation (maybe someone can make a PDF?) https://docs.bigbluebutton.org/administration/customize/#change-the-default-presentation + - modify the default landing page https://docs.bigbluebutton.org/administration/customize/#modify-the-default-landing-page + - change the default welcome messages https://docs.bigbluebutton.org/administration/customize/#change-the-default-welcome-message + - change the favicon https://docs.bigbluebutton.org/administration/customize/#change-favicon + - change the default logo https://docs.bigbluebutton.org/administration/customize/#changing-the-default-logo + - check out BigBlueButton live captions? + - figure out if we can connect to or reuse the etherpad in BigBlueButton? + - figure out how to record separate audio streams in BigBlueButton because the audio mixing is sometimes terrible (some people's audio streams end up much louder than others). Related: https://github.com/bigbluebutton/bigbluebutton/issues/12302 , but not sure how to actually do it... + - replicate BBB setup in a virtual machine so that it's easy to re-deploy + - replicate streaming setup (OBS+VNC) in a virtual machine so that it's easy to re-deploy + - replicate video processing workflow on my computer and/or a virtual machine +- Other: + - panel? some thoughts: https://pad.emacsconf.org/emacsconf-panel + - unconference? + +* General infrastructure +:PROPERTIES: +:CUSTOM_ID: general-infrastructure +:END: +** Linode instance sizes +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-linode-instance-sizes +:END: +*** Production +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-linode-instance-sizes-production +:END: +- front0 shared Linode 32GB +- live0 shared Linode 64GB +- meet Dedicated CPU 16GB +*** Dormant +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-linode-instance-sizes-dormant +:END: +Resize disk to 25GB, copying large files to media if needed + +- nanode front0 +- nanode live0 +- delete meet after downloading all the recordings, or resize down to nanode +** File uploads +:PROPERTIES: +:CUSTOM_ID: upload +:END: + +[[https://github.com/psi-4ward/psitransfer][psi-4ward/psitransfer: Simple open source self-hosted file sharing solution]] + +Before the conference: + +1. Set ~upload_enabled~ to ~true~ in ~prod-vars.yml~ and run ~ansible-playbook -i inventory.yml prod-playbook.yml --tags upload~. +2. Confirm that https://upload.emacsconf.org has the upload interface and works with the password. If it's not up yet, use ~sudo service upload start~. +3. Use ~emacsconf-mail-template-to-all-groups~ and ~emacsconf-mail-upload-and-backstage-info~ to e-mail the upload information to all speakers. + +After the conference: + +1. Set ~upload_enabled~ to ~false~ in ~prod-vars.yml~ and run ~ansible-playbook -i inventory.yml prod-playbook.yml --tags upload~. +2. Confirm that https://upload.emacsconf.org shows the in-between page. +** Media processing +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-media-processing +:END: + +1. Make sure ~group_vars/all.yml~ has the correct setting for ~emacsconf_year~. +2. ~ansible-playbook -i inventory.yml prod-playbook.yml --tags prerec~ +3. Set up the ~update-cache~ script. + +#+begin_src sh :eval no :tangle ~/proj/emacsconf/2025/update-cache +#!/bin/bash +# export CONF_PUBLIC=1 +rsync -avu ~/proj/emacsconf/2025/assets/intros/*--intro.* ~/proj/emacsconf/2025/cache/ +rsync -avzue ssh --exclude ffmpeg2pass* --exclude .lock-\* --exclude 'partial--*' res:~/cache/ ~/proj/emacsconf/2025/cache/ --exclude .git +chmod ugo+r . -R +rsync -avzue ssh --exclude ffmpeg2pass* --exclude 'partial--*' ~/proj/emacsconf/2025/cache/ res:~/cache/ $* --exclude .git +rsync -avzue ssh --exclude ffmpeg2pass* --exclude 'partial--*' ~/proj/emacsconf/2025/cache/ orga@media:/var/www/media.emacsconf.org/2025/backstage/ $* --exclude .git +ssh orga@media "cd ~/backstage; chmod ugo+r -- *" +if [ ! -z "$CONF_PUBLIC" ]; then + echo "Updating public media" + rsync -avzue ssh --exclude \*--original\* --exclude ffmpeg2pass* --exclude \*--reencoded\* ~/proj/emacsconf/2025/cache/ orga@media:/var/www/media.emacsconf.org/2025/ 3--exclude .git +fi +rsync -avzue ssh ~/proj/emacsconf/2025/assets/ res:~/current/assets/ +#+end_src + +When a talk comes in: + +1. Update the talk status to ~PROCESSING~. Re-evaluate the schedule draft. +2. Set the file prefix with ~emacsconf-set-file-prefix-if-needed~ or use ~emacsconf-set-file-prefixes~. +3. Download the talk's files to your local cache (as specified by ~emacsconf-cache-dir~). +4. Rename the files with ~emacsconf-rename-files~. +5. Use ~../update-cache~ to update res and backstage. +6. SSH to res. Go to the ~~/cache~ directory. + 1. Start or reuse a ~screen~ session. + 2. Use ~make~ to convert the file to WEBM and caption the file. +7. On your local computer, use ~../update-cache~ to move files around. +8. ~emacsconf-publish-cache-video-data~ to save the file size and length. +9. ~emacsconf-publish-backstage-index~ +** Wiki + +Stylesheet: file:/ssh:front|sudo:ikiwiki@front:/var/www/emacsconf.org/style.css + +See also Ansible notes + +If the wiki is stuck and needs regenerating: + +#+begin_example +ssh front0.emacsconf.org +sudo -iu ikiwiki -- ikiwiki --setup ~ikiwiki/emacsconf.setup +#+end_example + +** DONE Icecast +CLOSED: [2025-11-15 Sat 15:05] +:PROPERTIES: +:CUSTOM_ID: icecast +:Effort: 0:30 +:END: +:LOGBOOK: +- Note taken on [2025-11-15 Sat 15:05] \\ + okay for 2025 +CLOCK: [2025-11-15 Sat 14:43]--[2025-11-15 Sat 15:05] => 0:22 +:END: + +Success: You can send a stream to Icecast and the results can be viewed by mpv. +- [X] Gen +- [X] Dev +Also, recordings are available in /data. + +See also: [[#obs-instructions][Use OBS+VNC to record]] + +New year: + +1. Reprovision with + #+begin_src sh :eval no + ansible-playbook -i inventory.yml prod-playbook.yml --tags stream + #+end_src + so that the year is updated in the configuration. +2. SSH to live0.emacsconf.org and run ~/etc/init.d/emacsconf stop~. Confirm that icecast has stopped with ~ps | grep emacsconf~; if not, kill the process. + Start it again with ~/etc/init.d/emacsconf start~ +3. To test, you can use FFmpeg like this for the gen stream: + #+begin_src sh +ffmpeg -y -f lavfi -i testsrc=size=1280x720:rate=10 -i background-music.opus \ + -c:v libvpx -b:v 500K -crf 25 -b:a 128k \ + -content_type video/webm "icecast://emacsconf:$EMACSCONF_ICECAST_SOURCE_PASSWORD@live0.emacsconf.org:8001/gen.webm" + #+end_src + For dev: + #+begin_src sh + ffmpeg -y -f lavfi -i testsrc=size=1280x720:rate=10 -i background-music.opus \ + -c:v libvpx -b:v 500K -crf 25 -b:a 128k \ + -content_type video/webm "icecast://emacsconf:$EMACSCONF_ICECAST_SOURCE_PASSWORD@live0.emacsconf.org:8001/dev.webm" + #+end_src + and then view it with + #+begin_src sh + mpv https://live0.emacsconf.org/gen.webm + mpv https://live0.emacsconf.org/dev.webm + #+end_src +*** Cooldown +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-icecast-cooldown +:END: + +ssh live0.emacsconf.org +sudo /etc/init.d/emacsconf stop + +** DONE Watching pages +CLOSED: [2025-11-15 Sat 14:57] +:PROPERTIES: +:CUSTOM_ID: watch +:END: + +Success: You can watch at https://live.emacsconf.org. +- [X] https://live.emacsconf.org goes to the current year's page. +- [X] gen stream works in the browser +- [X] dev stream works in the browser +- [X] Schedule is correct + +New year: +1. ~ansible-playbook -i inventory.yml prod-playbook.yml --tags live~ +2. Republish with elisp:emacsconf-publish-watch-pages. +3. Update front:/var/www/live.emacsconf.org. + +Set up test streams (see ffmpeg instructions from [[#icecast][Icecast]]) and then: + +** DONE VNC +CLOSED: [2025-11-15 Sat 15:02] +:PROPERTIES: +:CUSTOM_ID: vnc +:END: +:LOGBOOK: +- Note taken on [2025-11-15 Sat 15:02] \\ + Okay for 2025 +:END: + +We use VNC to connect to the X servers on res.emacsconf.org so that we can stream from it. + +Success: +- [X] Confirm that you can connect to emacsconf-gen via VNC +- [X] Confirm that you can connect to emacsconf-dev via VNC + +*** Instructions +:PROPERTIES: +:CUSTOM_ID: vnc-instructions +:END: + +NOTE: VNC+OBS doesn't work well if you have a window manager that +automatically resizes windows, like i3. Please configure your window +manager so that the VNC window is not resized. + + 1. Install a VNC viewer on your system (ex: tigervnc-viewer). + + 2. Set up your local environment: + + - gen: ~export TRACK=gen; export TRACK_PORT=5905; export SSH_PORT=46668~ + - dev: ~export TRACK=dev; export TRACK_PORT=5906; export SSH_PORT=46668~ + + 3. Copy the password: + + scp emacsconf-$TRACK@res.emacsconf.org:~/.vnc/passwd vnc-passwd-$TRACK -p $SSH_PORT + + 4. Forward your local ports and connect via VNC viewer to the + appropriate forwarded port from your laptop: + + #+begin_example + ssh emacsconf-$TRACK@res.emacsconf.org -N -L $TRACK_PORT:127.0.0.1:$TRACK_PORT -p $SSH_PORT & + sleep 5 # Give it time to establish the tunnels + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & + #+end_example + +If you get the following error: + +#+begin_example +channel 2: open failed: connect failed: Connection refused +CConn: End of stream +CConn: The connection was dropped by the server before the session could + be established. +#+end_example + +then the VNC server hasn't started yet. You can start it with + +#+begin_src sh :eval no +ssh emacsconf-$TRACK@res.emacsconf.org -p $SSH_PORT /home/emacsconf-$TRACK/bin/track-vnc +#+end_src + +and then connect with: + +#+begin_src sh :eval no +xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & +#+end_src +*** Cooldown +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-vnc-cooldown +:END: + +ssh sachac@res +sudo killall Xtigervnc + +** DONE Streaming with OBS +CLOSED: [2025-11-15 Sat 15:04] +:PROPERTIES: +:CUSTOM_ID: obs +:END: +:LOGBOOK: +- Note taken on [2025-11-15 Sat 15:04] \\ + Okay for 2025 +:END: + +Success: You can use [[#obs-instructions][OBS+VNC to record]], and the results can be viewed by mpv. +- [X] gen +- [X] dev + +New year: reprovision with + +#+begin_src sh :eval no +ansible-playbook -i inventory.yml prod-playbook.yml --tags obs,stream +#+end_src + +so that the year is updated in the shell scripts. + +icecast is on live0.emacsconf.org and can be restarted with =/etc/init.d/emacsconf restart=. + +*** Instructions +:PROPERTIES: +:CUSTOM_ID: obs-instructions +:END: + +1. [[#vnc-instructions][Connect to the VNC session for the track.]] + +2. Start *recording* (not streaming). If you don't see OBS when you connect, it's probably on workspace 2, so you can switch with Alt-2. If you still don't see it there, you can open a terminal with Alt-Enter and then run ~track-obs~. After you start recording, confirm that it is now broadcasting to the stream. + +3. Verify with MPV on your local system: + + #+begin_example + mpv https://live0.emacsconf.org/$TRACK.webm & + #+end_example + +so that the year is updated in the configuration. +** DONE Mumble +CLOSED: [2025-12-01 Mon 12:49] +:PROPERTIES: +:Effort: 1:00 +:END: +:LOGBOOK: +CLOCK: [2025-12-01 Mon 11:25]--[2025-12-01 Mon 12:49] => 1:24 +:END: + +Success: +- [X] You can connect to Mumble on your preferred device(s). +- [X] You can broadcast to the emacsconf-gen channel. +- [X] You can broadcast to the emacsconf-dev channel. + +mumble.emacsconf.org is hosted on front. Start it with: + +#+begin_src sh :eval no +sudo /etc/init.d/mumble-server start +#+end_src + +It listens on port 64738 + +Logs are in ~/var/log/mumble-server~. + +To add a new account: + +- After they log in, register their user. +- Right-click on the server name. Edit - Groups. Add them to the org group. + +** Shell scripts +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-shell-scripts +:END: + +Success: From the commandline, hosts can: +- [X] play just the intro: intro $SLUG +- [X] play a file without an intro: play $SLUG +- [X] play a file with an intro: play-with-intro $SLUG (hmm, this didn't show the subtitles) + ah, it's because the intros need to be in the cache dir? +- [X] open the Q&A for a talk: handle-qa $SLUG + - [X] open the pad: pad $SLUG + - [X] open BBB: bbb $SLUG +- [ ] do the whole thing: handle-session $SLUG +- [ ] rebroadcast the other stream: + - rebroadcast gen + - rebroadcast dev +- [ ] control background music: music, stop-music + +Setup: +- OBS must be streaming from the stream you're testing. [[#obs][Streaming with OBS]] +- You may want to generate test assets and copy them over to the assets/stream directory. +- Generate all the overlays and copy them to assets/overlays +- Set up the assets/music directory +** Backstage +:PROPERTIES: +:CUSTOM_ID: backstage +:END: + +Update this with elisp:emacsconf-publish-backstage-index + +Explanation of files: + +| ~--original.mp4/mov/webm~ | original file as uploaded by the speaker | +| ~--silence.mp4/mov/webm~ | silence sample if uploaded by speaker | +| ~--reencoded.webm~ | converted to .webm format and compressed | +| ~--reencoded.opus~ | audio only | +| ~--normalized.opus~ | normalized audio | +| ~--reencoded.vtt~ | WhisperX captions, WebVTT format | +| ~--reencoded.json~ | WhisperX word data | +| ~--reencoded.srt~ | WhisperX captions, SRT format | +| ~--reencoded.txt~ | WhisperX captions, plain text | +| ~--main.vtt~ | edited captions | +| ~--main--chapters.vtt~ | chapter markers | +| ~--main.txt~ | captions as text (optional) | +| ~--main.webm~ | version for streaming based on the most recent resources | + +Other files might also have been uploaded by the speaker, such as slides or notes. + +** Thelounge IRC web client +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-irc-web-client +:END: + +Success: +- [X] When the service is not running, the error page is displayed +- [X] You can join from https://chat.emacsconf.org +- [X] You can join from https://live.emacsconf.org and the channels end up as the latest ones + +ansible: lounge tag + +On front: +- To start: sudo systemctl start thelounge +- To stop: sudo systemctl stop thelounge + +backup: +sudo -u thelounge /usr/bin/thelounge start + +*** DONE Ask libera.chat to increase IRC limits +CLOSED: [2025-11-12 Wed 13:50] +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-irc-web-client-ask-libera-chat-to-increase-irc-limits +:END: + +Remember to schedule a task to ask libera.chat to increase the number of users it will accept from chat.emacsconf.org to avoid connection exhaustion errors. + +Message I've posted to support@libera.chat: + +Thank you for running libera.chat. We're looking forward to using IRC (#emacsconf, #emacsconf-gen, #emacsconf-dev, #emacsconf-org) for the discussions for the upcoming EmacsConf (Dec 6-7, https://emacsconf.org). In the past, we've needed to coordinate with Libera staff to increase the number of connections allowed from chat.emacsconf.org during conference days in order to avoid connection exhaustion errors. Is that something we can plan now or would you like me to bring it up a few days before the conference? +** Etherpad +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-etherpad +:END: + +Success: + +- [X] pad.emacsconf.org redirects to this year's entry +- [X] Each talk has its own Etherpad + +Lessons learned: + +- After 2024: Added pronouns and pronunciation to the pad template since that's what the hosts will be looking at + +The pad is at front0.emacsconf.org + +Non-JS way to get plain text or HTML of a pad: ex: +- https://pad.emacsconf.org/orgmeetup/export/txt +- https://pad.emacsconf.org/orgmeetup/export/html +** Publishing media to the server and to the wiki +:PROPERTIES: +:CUSTOM_ID: media +:END: + +Start of year: + +1. Set =media_protect_root= to true in Ansible =group_vars/all.yml=. +2. =ansible-playbook -i inventory.yml prod-playbook.yml --tags media= +3. Generate the index with =emacsconf-publish-update-media= + +Confirm by using ~talk sat-open PLAYING~ on res. The public media +directory should have the files and the entry should be in the index. +Switching it back to =TO_STREAM= and calling +elisp:emacsconf-publish-media-files-on-change should remove it. + +*** DONE Switch public media to unprotected root before the conference :tminustwo: +CLOSED: [2025-11-30 Sun 16:52] +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-publishing-media-to-the-server-and-to-the-wiki-switch-public-media-to-unprotected-root-before-the-conference +:END: + +1. Clear public media directory. +2. Set =media_protect_root= to false in Ansible =group_vars/all.yml=. +3. =ansible-playbook -i inventory.yml prod-playbook.yml --tags media= + +You can generate the index with =emacsconf-publish-update-media=. +** Automated publishing to the media server + +=ansible-playbook -i inventory.yml prod-playbook.yml --tags publish,edit= + +On orga@res, in the screen session with the emacs server, make sure emacsconf-year and emacsconf-cache-dir refer to the current ones. + +** DONE Automated IRC announcements +CLOSED: [2025-11-30 Sun 16:52] +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-automated-irc-announcements +:Effort: 1:00 +:END: +:LOGBOOK: +CLOCK: [2025-11-27 Thu 14:31]--[2025-11-28 Fri 15:10] => 24:39 +:END: + +Success: + +- [ ] When a talk starts playing, it is announced in the relevant channel + +How it works: On res: + +/usr/local/bin/handle-session sudos to the orga user and calls the ~/usr/local/bin/talk~ shell script, + +You will need the private repository checked out to ~orga/emacsconf-2025-private~, which is set up by the ansible playbook ~publish~ tag. + +This is by ~/usr/local/bin/talk~ on res, which connects to a running Emacs with emacsclient. Make sure the emacs thing has the right year. + +** BigBlueButton +:PROPERTIES: +:CUSTOM_ID: bbb +:END: + +ssh orga@media.emacsconf.org "~/bin/bbb-before sat-open" +https://media.emacsconf.org/2024/current/bbb-sat-open.html + +ssh orga@media.emacsconf.org "~/bin/bbb-open sat-open" + +After restarting, and in case of "Firefox can’t establish a connection to the server at wss://bbb.emacsverse.org/graphql." + +ssh root@bbb +cd greenlight-v3 +docker compose restart + +Sizes: + +- dormant: 1 GB nanode +- testing: 4 core 8 GB shared CPU +- production: 8 core 16 GB dedicated CPU (roughly half CPU load for 107 simultaneous users, 2024) + - maybe 8 core 16 GB shared CPU next? + +*** Installing BigBlueButton +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-bigbluebutton-installing-bigbluebutton +:END: + +1. Create the instance. + - Linode 4core 8GB shared CPU + - Image: Ubuntu 22.04 +2. Update the DNS for bbb.emacsverse.org with its IP address. +3. Download the BBB installer and make it executable. +4. ufw allow 16384:32768/udp +5. Run the BBB installer: ~./bbb-install.sh -v jammy-300 -s bbb.emacsverse.org -e emacsconf@sachachua.com -g~ +6. ~sudo apt install bbb-playback-video~ and then follow the instructions at [[https://docs.bigbluebutton.org/3.0/administration/customize/#install-additional-recording-processing-formats][Server Customization | BigBlueButton]] . + - /usr/local/bigbluebutton/core/scripts/bigbluebutton.yml: + #+begin_example + steps: + archive: 'sanity' + sanity: 'captions' + captions: + - 'process:presentation' + - 'process:video' + 'process:presentation': 'publish:presentation' + 'process:video': 'publish:video' + #+end_example + - systemctl restart bbb-rap-resque-worker.service +7. docker exec -it greenlight-v3 bundle exec rake admin:create['name','email','password'] + + + +*** System audio limitations +:PROPERTIES: +:CUSTOM_ID: bbb-audio-limitations +:END: + +Sharing system audio by changing the audio device to "Built-in Audio Analog Stereo" is very choppy, only gets captured in the recording if I'm using Firefox (not Chrome) AND there's at least one listener, and doesn't allow simultaneous narration from the speaker. + +Using pulseaudio to change the app's recording device to the audio monitor results in smoother audio (because it's pretending to be the microphone), but still doesn't allow simultaneous narration from the speaker. + +Combining microphone + system audio into a new virtual microphone source is probably more complicated than we want to walk speakers through. + +BBB says sharing system audio works only if you use Chrome on Mac OS X or Microsoft Windows (https://support.bigbluebutton.org/hc/en-us/articles/1500005315642-Can-I-play-a-video-using-screen-sharing). I tested it on Linux and sharing system audio is not an option. If you happen to know of any more elegant way to do this, I'd love to hear it. + +Related: https://github.com/bigbluebutton/bigbluebutton/issues/8632 + +*** DONE Create meeting rooms for each speaker +CLOSED: [2025-11-12 Wed 13:51] +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-bigbluebutton-creating-talk-bbb-rooms +:END: + +#+begin_src sh :eval no +docker exec -it greenlight-v3 /bin/bash -c "bundle exec rails console" +#+end_src + +#+begin_src ruby :eval no +user_id = User.find_by_email("emacsconf@sachachua.com").id +#+end_src + +1. elisp:emacsconf-bbb-create-rooms +2. elisp:emacsconf-bbb-load-rooms: set the ROOM properties. +3. elisp:emacsconf-publish-bbb-static-redirects + +Print out the room IDs with: + +#+begin_src ruby :eval no +Room.all.each { |x| puts x.friendly_id + " " + x.name }; nil +#+end_src + +It's possible to change the friendly_id and then use ~x.save!~. + +*** DONE Set up moderator access codes +CLOSED: [2025-11-12 Wed 13:51] +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-bigbluebutton-setting-up-moderator-access-codes +:END: + +- elisp:emacsconf-bbb-spookfox-set-moderator-codes +- elisp:emacsconf-bbb-spookfox-confirm-settings + +Then you can use elisp:emacsconf-mail-checkin-instructions-for-attending-speakers +or elisp:emacsconf-mail-checkin-instructions-to-all to send the info. + +*** Processing BBB videos +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-bigbluebutton-processing-bbb-videos +:END: + +~bbb-record --list~ shows all the recordings. You can use ~bbb-record --rebuild~ to regenerate the meeting, and ~bbb-record --watch~ to monitor progress. Presentation is a web-based interface, video is a single video file that contains the webcam, the screenshare, and the audio. + +If you don't see the video format, doublecheck that [[#general-infrastructure-bigbluebutton-installing-bigbluebutton][the video format is enabled]]. + +bbb-record seems to call ~ruby /usr/local/bigbluebutton/core/scripts/process/video.rb -m ID~, which might be a useful backup. + +bbb-record --rebuild 4dc2c4e5ac5222bc416b7e31d76e22a5627aed5b-1765135929727 +bbb-record --rebuild e5fceca22f037945fb7183e118599cf37598936c-1765131855663 + +derp, no space left on the device, that's why, adding to checklist + + +*** DONE Backing up BBB :backup: +CLOSED: [2025-12-07 Sun 16:48] +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-bigbluebutton-backing-up-bbb +:END: + +rsync -avze ssh root@bbb:/var/bigbluebutton/ ~/proj/emacsconf/2025/backups/bbb/ + +ssh root@bbb 'tar zcvf - /var/bigbluebutton /etc/bigbluebutton /root/greenlight-v3 /usr/local/bigbluebutton /usr/share/bbb-web' > bbb-backup-$(date "+%Y-%m-%d").tar.gz + +ssh root@bbb 'dd if=/dev/sda bs=5M ' | dd of=bbb-img-$(date "+%Y-%m-%d").img status=progress +*** Scaling BBB up and down +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-bigbluebutton-scaling-bbb-up-and-down +:END: + +[[https://sachachua.com/blog/2025/01/scaling-a-bigbluebutton-server-down-to-a-1-gb-node-between-uses/][Scaling a BigBlueButton server down to a 1 GB node between uses]] + +When the server is downscaled, ~/etc/nginx/sites-backup~ configures the Nginx. +The web root is ~/var/www/bigbluebutton-default/assets~, and the page is ~/var/www/bigbluebutton-default/assets/backup/index.html~. + +*** Spinning BBB up again from scratch +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-bigbluebutton-spinning-bbb-up-again +:END: + +Previous notes: + +1. Create a Nanode. +2. Update the DNS for bbb.emacsverse.org with its IP address. (dns.he.net) +3. Reboot into Rescue mode. In Lish: + #+begin_src sh :eval no + passwd # set interactively + sed -i -e 's/#PasswordAuthentication yes/PasswordAuthentication yes/g' /etc/ssh/sshd_config + echo 'PermitRootLogin yes' >> /etc/ssh/sshd_config + service ssh start + #+end_src +4. From the backup directory: + gunzip -c bbb-img-2024-12-08.img.gz | ssh root@bbb.emacsconf.org "dd of=/dev/sda bs=4M status=progress oflag=direct iflag=fullblock" +5. After I resized to 4core 8GB RAM, I couldn't log in with SSH, so I used the Linode shell. ~sshd -t~ said no host keys available. Fix: + #+begin_src sh :eval no + ssh-keygen -A + service ssh --full-restart + #+end_src +6. ./bbb-install.sh -v jammy-300 -s bbb.emacsverse.org -e emacsconf@sachachua.com + +Resources: + +- https://overto.eu/posts/gunzip-into-dd/ +- https://www.linode.com/community/questions/20386/how-do-i-ssh-to-linode-from-the-finnix-boot-in-order-to-copy-my-local-vm-over-to +- https://github.com/bigbluebutton/bigbluebutton/issues/9485 +** TODO Manual IRC announcements +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-manual-irc-announcements +:END: + +Success: + +- [X] You can /opall, /conftopic, and /broadcast +** Check test crontab +** DONE Confirm automated IRC announcements from res +CLOSED: [2025-12-08 Mon 21:36] SCHEDULED: <2025-11-27 Thu> +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-confirm-automated-irc-announcements-from-res +:CREATED: [2025-11-26 Wed 15:04] +:END: + +Success: + +- A test schedule can generate announcements. + + See C-u M-x emacsconf-stream-crontabs + + +** Low-res stream +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-low-res-stream +:END: +Should be automatic, handled by Icecast +backup on live: +- /usr/local/bin/emacsconf-lowres-gen-on-connect +- /usr/local/bin/emacsconf-lowres-dev-on-connect +** DONE Upload talks to YouTube +CLOSED: [2025-12-20 Sat 16:10] SCHEDULED: <2025-12-16 Tue> +:PROPERTIES: +:CREATED: [2024-11-27 Wed 17:33] +:CUSTOM_ID: general-infrastructure-upload-talks-to-youtube +:END: + +[[https://studio.youtube.com/channel/UCwuyodzTl_KdEKNuJmeo99A/videos/upload?filter=%5B%5D&sort=%7B%22columnType%22%3A%22date%22%2C%22sortOrder%22%3A%22DESCENDING%22%7D][Channel videos]] + +#+begin_src emacs-lisp :results table replace +(seq-keep + (lambda (o) + (when (and (string= (plist-get o :status) "TO_STREAM") + (not (plist-get o :youtube))) + (list + (plist-get o :slug) + (org-link-make-string + (concat "copy:" + ) + "video file") + (org-link-make-string + (format "elisp:(emacsconf-publish-video-description \"%s\" t)" + (plist-get o :slug)) + "desc") + (if (emacsconf-talk-file o "--main.vtt") + (org-link-make-string + (concat "copy:" + (emacsconf-talk-file o "--main.vtt")) + "sub file") + "") + (org-link-make-string + (concat "elisp:(emacsconf-set-property-from-slug \"" + (plist-get o :slug) + "\" \"YOUTUBE\" (read-string \"YouTube URL: \"))" + ) + "save") + (plist-get o :scheduled)))) + (emacsconf-publish-prepare-for-display (emacsconf-get-talk-info))) +#+end_src + +#+RESULTS: +:results: +| shell | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-shell--emacs-as-a-shell--christopher-howard--main.webm][video file]] | [[elisp:(emacsconf-publish-video-description "shell" t)][desc]] | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-shell--emacs-as-a-shell--christopher-howard--main.vtt][sub file]] | [[elisp:(emacsconf-set-property-from-slug "shell" "YOUTUBE" (read-string "YouTube URL: "))][save]] | <2024-12-07 Sat 13:55-14:35> | +| writing | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-writing--emacs-writing-studio--peter-prevos--main.webm][video file]] | [[elisp:(emacsconf-publish-video-description "writing" t)][desc]] | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-writing--emacs-writing-studio--peter-prevos--main.vtt][sub file]] | [[elisp:(emacsconf-set-property-from-slug "writing" "YOUTUBE" (read-string "YouTube URL: "))][save]] | <2024-12-07 Sat 16:05-16:15> | +| sat-close | [[copy:][video file]] | [[elisp:(emacsconf-publish-video-description "sat-close" t)][desc]] | | [[elisp:(emacsconf-set-property-from-slug "sat-close" "YOUTUBE" (read-string "YouTube URL: "))][save]] | <2024-12-07 Sat 17:00-17:10> | +| links | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-links--unlocking-linked-data-replacing-specialized-apps-with-an-orgbased-semantic-wiki--abhinav-tushar--main.webm][video file]] | [[elisp:(emacsconf-publish-video-description "links" t)][desc]] | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-links--unlocking-linked-data-replacing-specialized-apps-with-an-orgbased-semantic-wiki--abhinav-tushar--main.vtt][sub file]] | [[elisp:(emacsconf-set-property-from-slug "links" "YOUTUBE" (read-string "YouTube URL: "))][save]] | <2024-12-08 Sun 09:10-09:20> | +| blee | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-blee--about-blee-towards-an-integrated-emacs-environment-for-enveloping-our-own-autonomy-directed-digital-ecosystem--mohsen-banan--main.webm][video file]] | [[elisp:(emacsconf-publish-video-description "blee" t)][desc]] | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-blee--about-blee-towards-an-integrated-emacs-environment-for-enveloping-our-own-autonomy-directed-digital-ecosystem--mohsen-banan--main.vtt][sub file]] | [[elisp:(emacsconf-set-property-from-slug "blee" "YOUTUBE" (read-string "YouTube URL: "))][save]] | <2024-12-08 Sun 10:30-11:15> | +| hyperbole | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-hyperbole--fun-things-with-gnu-hyperbole--mats-lidell--main.webm][video file]] | [[elisp:(emacsconf-publish-video-description "hyperbole" t)][desc]] | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-hyperbole--fun-things-with-gnu-hyperbole--mats-lidell--main.vtt][sub file]] | [[elisp:(emacsconf-set-property-from-slug "hyperbole" "YOUTUBE" (read-string "YouTube URL: "))][save]] | <2024-12-08 Sun 11:30-11:45> | +| pgmacs | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-pgmacs--pgmacs-browsing-and-editing-postgresql-databases-from-emacs--eric-marsden--main.webm][video file]] | [[elisp:(emacsconf-publish-video-description "pgmacs" t)][desc]] | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-pgmacs--pgmacs-browsing-and-editing-postgresql-databases-from-emacs--eric-marsden--main.vtt][sub file]] | [[elisp:(emacsconf-set-property-from-slug "pgmacs" "YOUTUBE" (read-string "YouTube URL: "))][save]] | <2024-12-08 Sun 13:40-13:55> | +| literate | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-literate--literate-programming-for-the-21st-century--howard-abrams--main.webm][video file]] | [[elisp:(emacsconf-publish-video-description "literate" t)][desc]] | [[copy:/home/sacha/proj/emacsconf/2024/cache/emacsconf-2024-literate--literate-programming-for-the-21st-century--howard-abrams--main.vtt][sub file]] | [[elisp:(emacsconf-set-property-from-slug "literate" "YOUTUBE" (read-string "YouTube URL: "))][save]] | <2024-12-08 Sun 14:15-14:35> | +| sun-close | [[copy:][video file]] | [[elisp:(emacsconf-publish-video-description "sun-close" t)][desc]] | | [[elisp:(emacsconf-set-property-from-slug "sun-close" "YOUTUBE" (read-string "YouTube URL: "))][save]] | <2024-12-08 Sun 16:50-17:00> | +:end: + +** Restream to YouTube +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-restream-to-youtube +:END: +*** TODO Set up YouTube restreaming events +:PROPERTIES: +:CUSTOM_ID: general-infrastructure-restream-to-youtube-set-up-youtube-restreaming-events +:END: + +Need to have set up shifts first. + +1. Switch to the EmacsConf account. +2. Go to https://studio.youtube.com/channel/UCwuyodzTl_KdEKNuJmeo99A +3. Create > Go live > Schedule stream. + - [X] Gen - Sat AM + - [X] Gen - Sat PM + - [X] Dev - Sat AM + - [X] Dev - Sat PM + - [X] Gen - Sun AM + - [X] Gen - Sun PM + - [X] Test + + emacsconf-stream-copy-livestream-description + + Then set the emacsconf-rtmp-shifts variable. See the conf.org from 2025 for an example. + + This will be used in the shift hyperlists, which you can generate with emacsconf-pad-prepopulate-shift-hyperlists + + There's also a note in the ansible README.org about restreaming. + Set up the =restreaming_platforms= variable in =prod-vars.yml= and + use =ansible-playbook -i inventory.yml prod-playbook.yml --tags restream= to set up + +** Restream to Toobnix +*** DONE Set up Toobnix restreaming events +CLOSED: [2025-12-05 Fri 18:54] +:PROPERTIES: +:Effort: 0:30 +:END: +:LOGBOOK: +CLOCK: [2025-11-22 Sat 17:42]--[2025-11-23 Sun 12:15] => 18:33 +:END: + +1. https://toobnix.org, Publish, Permanent/recurring live +2. emacsconf-stream-toobnix-copy-livestream-description +** i3 window manager + +termit is the terminal + +- M-d: launcher +- M-1, M-2: change workspace * Other process notes :PROPERTIES: :CUSTOM_ID: other @@ -183,7 +1747,131 @@ For each talk: :CUSTOM_ID: bbb-user :END: -#+begin_src ssh :eval no +#+begin_src ssh :eval no :tangle no ssh bbb.emacsverse.org docker exec -it greenlight-v2 bundle exec rake user:create["USERNAME","EMAIL","PASSWORD","user"] #+end_src +** Schedule changes + +In general: + +#+begin_src emacs-lisp + (emacsconf-schedule-update-from-info) + (emacsconf-update-schedule) + (emacsconf-publish-watch-pages) + (emacsconf-publish-talks-json-to-files) + (emacsconf-publish-info-pages) +#+end_src + +*** When a talk is added after the schedule has already been drafted +:PROPERTIES: +:CUSTOM_ID: other-process-notes-when-a-talk-is-added-after-the-schedule-has-already-been-drafted +:END: +- [X] Add the talk to conf.org +- [X] Add the talk ID to the draft schedule +- [X] Run the draft schedule block +- [X] elisp:emacsconf-schedule-update-from-info +- [X] elisp:emacsconf-publish-talks-json-to-files +- [X] Generate pads with ~ansible-playbook -i inventory.yml prod-playbook.yml --tags pad~ +- [X] elisp:emacsconf-set-file-prefixes +- [X] elisp:emacsconf-update-schedule +- [X] elisp:emacsconf-stream-generate-overlays +- [X] elisp:emacsconf-stream-generate-test-videos +- [X] ~rsync -avze ssh ~/proj/emacsconf/2024/assets/ res:/data/emacsconf/shared/2024/assets/~ +- [X] Send the upload instructions +- [X] Generate the intro text +- [ ] Record the intro + +*** When a talk is cancelled +:PROPERTIES: +:CUSTOM_ID: cancel-talk +:END: + +elisp:emacsconf-cancel-talk + +1. Update the status to CANCELLED. Update that specific talk with elisp:emacsconf-publish-info-pages-for-talk. +2. Rejig the schedule if needed, and update with elisp:emacsconf-schedule-update-from-info +3. Update the published schedule with [[elisp:emacsconf-update-schedule]]. + +Manual steps: + +1. Push the wiki. +2. Regenerate the intros (before, after). elisp:emacsconf-stream-generate-in-between-pages, then use elisp:subed-record-compile-video in the intros file. +3. Resync the cache directory. +4. Consider updating the screenshots for sat-open and sun-open. + +*** When a talk changes title +:PROPERTIES: +:CUSTOM_ID: other-process-notes-when-a-talk-changes-title +:END: + +1. Update the title in conf.org. +2. Delete the FILE_PREFIX property. +3. Call elisp:emacsconf-set-file-prefix-if-needed. +4. Rename existing files with elisp:emacsconf-update-file-prefixes. +5. Update the intro VTT file with the new title. +6. Update the wiki page for the talk. +7. Regenerate the in-between images with elisp:emacsconf-stream-generate-in-between-pages +8. Rerecord and recompile the intro, and recompile the intro for the talk after it. +9. elisp:emacsconf-update-schedule +10. elisp:emacsconf-pad-prepopulate-hyperlists +** When a talk Q&A changes method +:PROPERTIES: +:CUSTOM_ID: change-talk-qa +:END: + +1. Update the talk property. +2. Update the schedule with [[elisp:emacsconf-update-schedule]] +3. Regenerate the intros (before, after). elisp:emacsconf-stream-generate-in-between-pages, then use elisp:subed-record-compile-video in the intros file. +4. Sync the new intros to the /data/emacsconf/shared/$YEAR/assets/intros directory. +5. Regenerate the pads: elisp:emacsconf-pad-prepopulate-all-talks +6. Regenerate talks.json: elisp:emacsconf-publish-talks-json-to-files +** To play the other stream +:PROPERTIES: +:CUSTOM_ID: other-process-notes-to-play-the-other-stream +:END: + +- ~mpv --profile=full https://live0.emacsconf.org/gen.webm~ +- Change the channel topic to note that discussion can be in the other channel + +** When a system is down - status page +:PROPERTIES: +:CUSTOM_ID: other-process-notes-when-a-system-is-down +:END: + + +Let people know in #emacsconf and #emacsconf-org + +Update the status page: + +[[file:/ssh:orga@front0.emacsconf.org:/var/www/status.emacsconf.org/index.html]] + +/broadcast <message> may also be helpful +** When we need to bring on a last-minute volunteer +:PROPERTIES: +:CUSTOM_ID: other-process-notes-when-we-need-to-bring-on-a-last-minute-volunteer +:END: + +/backstage nick + +will give them the backstage credentials and links to the index + +** Checking people in +:PROPERTIES: +:CUSTOM_ID: other-process-notes-checking-people-in +:END: + +/checkin nick +/room nick (should be automatic if live, but there just in case) + +** Ansible +:PROPERTIES: +:CUSTOM_ID: other-process-notes-ansible +:END: + +#+begin_src sh :eval no +git clone git@git.emacsconf.org:pub/emacsconf-ansible +#+end_src +** Updating a transcript + +emacsconf-publish-update-transcript |