diff options
Diffstat (limited to '2022/organizers-notebook.md')
| -rw-r--r-- | 2022/organizers-notebook.md | 7702 |
1 files changed, 7087 insertions, 615 deletions
diff --git a/2022/organizers-notebook.md b/2022/organizers-notebook.md index 92ea88ef..44837dee 100644 --- a/2022/organizers-notebook.md +++ b/2022/organizers-notebook.md @@ -1,258 +1,2959 @@ -<!-- organizers-notebook.md is exported from organizers-notebook.org, please modify that instead. --> +<!-- organizers-notebook.md is exported from organizers-notebook/index.org, please modify that instead. --> [[!sidebar content=""]] +This file is automatically exported from [/2022/organizers-notebook/index.org](/2022/organizers-notebook/index.org). You might prefer to navigate this as an Org file instead. To do so, [clone the wiki repository](https://emacsconf.org/edit/). + # Table of Contents -1. [Current tasks / status](#current) -2. [Things to figure out / decisions to make](#decisions) -3. [Roles needed](#roles) -4. [Other tasks and processes](#other) -5. [Communications](#comms) -6. [Supporting code](#code) -7. [Lessons learned](#lessons) +- [Overall priorities](#overall) +- [Next comms update](#update) +- [Projects and other long-running tasks](#projects) +- [Ideas for next year](#maybe-projects):nextyear: +- [Things to figure out / decisions to make](#decisions) +- [Roles needed](#roles) +- [Infrastructure notes](#infra) +- [Other tasks and processes](#other) +- [In case of](#exceptions) +- [Task archive](#archive) +- [Communications](#comms) +- [Supporting code](#code) +- [Lessons learned](#lessons) + +Projects and tasks: + +- [Harvest live talks and Q&A](#harvest) +- [Send thanks](#thanks) +- [Finalize the files to be used for streaming](#files) +- [Look for ways to reduce risk](#derisk):derisk: +- [Make checkin and Q&A process slide](#qa):sachac: +- [Caption talks and make chapter headings](#caption) +- [Prepare intros for the hosts to read](#host-intros) +- [Set up talks on Toobnix and YouTube](#video-platforms):sachac:yt:toobnix: +- [Do another run](#dry-run) +- [Turn off file upload service on media.emacsconf.org](#upload-off):sachac:infra: +- [Review notebook for tasks, priorities, and scheduling](#review) +- [Use Mumble for backchannel coordination and also on-stage](#mumble) +- [Satellite events](#satellite) +- [Volunteer update](#volunteer-2022-11-14) +- [Make a linear hyperlist for managing EmacsConf](#hyperlist):sachac: +- [Record intro/outro for day-1 and day-2](#rec-intro):zaeph: +- [Add category tags and possibly links between talks across 2022 and all previous years](#link-pages):quiliro:wiki: +- [JS/CSS enhancement](#watch-css):emacsconf: +- [Build up the ansible playbook](#ansible):sachac:opal: +- [Consider breakout rooms for lunch break](#breakouts) +- [Work on the OBS scenes](#obs-scenes):zaeph:corwin:sachac: +- [Plan Etherpad use and hosting](#etherpad):sachac:ansible: +- [Write about EmacsConf behind the scenes](#writing):sachac: + +Schedule by status: (gray: waiting, light yellow: processing, yellow: to assign, light green: captioning, green: captioned and ready) - Updated by conf.org and the wiki repository + + + + +<a id="overall"></a> + +# Overall priorities + +This table makes it easier to move the slider depending on who wants +to volunteer and how much we can get done. At some point, we’ll figure +out how to track our current status so we know what we need to +scramble to do in order to get the conference off the ground. **bold** +is our current goal. Feel free to volunteer for anything that +interests you! + +<table> + +<colgroup> +<col class="org-left"> -<a id="current"></a> +<col class="org-left"> -# Current tasks / status +<col class="org-left"> -Planned dates and phases: +<col class="org-left"> +</colgroup> +<thead> +<tr> +<th scope="col" class="org-left"> </th> +<th scope="col" class="org-left">Good</th> +<th scope="col" class="org-left">Better</th> +<th scope="col" class="org-left">Best</th> +</tr> +</thead> -<table border="2" cellspacing="0" cellpadding="6" rules="groups" frame="hsides"> +<tbody> +<tr> +<td class="org-left"><a href="#harvest">harvesting talks & Q&A</a></td> +<td class="org-left"><b>recordings trimmed if needed, published</b></td> +<td class="org-left">chapter markers</td> +<td class="org-left">edited transcripts</td> +</tr> +</tbody> +</table> + +Previous priorities; + +<table> <colgroup> -<col class="org-left" /> +<col class="org-left"> + +<col class="org-left"> -<col class="org-left" /> +<col class="org-left"> + +<col class="org-left"> </colgroup> <tbody> <tr> -<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-09-26 Mon]</span></span></td> -<td class="org-left">Yes/no comments for original submissions</td> +<td class="org-left"><a href="#conforg">conf.org management</a></td> +<td class="org-left">on sachac’s laptop</td> +<td class="org-left">S: on res.emacsconf.org</td> +<td class="org-left"><b>DONE S/Z: other people know how to work with it</b></td> </tr> <tr> -<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-09-30 Fri]</span></span></td> -<td class="org-left">Original speaker notification date</td> +<td class="org-left"><a href="#prepare-prerec-process">prerec</a></td> +<td class="org-left">convert to webm</td> +<td class="org-left">normalize audio</td> +<td class="org-left"><b><a href="#mastering">DONE Z: reduce noise</a></b></td> </tr> <tr> -<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-10-07 Fri]</span></span></td> -<td class="org-left">Yes/no comments for late submissions</td> +<td class="org-left"> </td> +<td class="org-left">DONE S: link to stream, pad, IRC</td> +<td class="org-left"><b>S: link to prerec when live</b></td> +<td class="org-left">embed stream, pad, IRC, prerec</td> </tr> <tr> -<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-10-15 Sat]</span></span></td> -<td class="org-left">New speaker notification date (possibly only for late submissions)</td> +<td class="org-left"><a href="#sched-decision">schedule</a></td> +<td class="org-left">one track</td> +<td class="org-left"><b>DONE S: two tracks</b></td> +<td class="org-left">aligned times, full roster</td> </tr> <tr> -<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-10-22 Sat]</span></span></td> -<td class="org-left">E-mail confirmation expected (collect public contact info for posting in program)</td> +<td class="org-left"><a href="#upload">upload</a></td> +<td class="org-left">FTP</td> +<td class="org-left"><b>DONE S: web-based</b></td> +<td class="org-left">auto-encoded, preview (SReview?)</td> </tr> <tr> -<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-10-22 Sat]</span></span></td> -<td class="org-left">Strongly encourage early submitters to target this date for prerecs</td> +<td class="org-left"><a href="#streaming">streaming</a></td> +<td class="org-left">ffmpeg from computer</td> +<td class="org-left">OBS</td> +<td class="org-left"><b>DONE: OBS in cloud, switchable hosts</b></td> </tr> <tr> -<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-10-31 Mon]</span></span></td> -<td class="org-left">Schedule published</td> +<td class="org-left"><a href="#other-streams">other streams</a></td> +<td class="org-left">480p</td> +<td class="org-left">+ Toobnix</td> +<td class="org-left"><b>S: + YouTube</b></td> </tr> <tr> -<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-11-05 Sat]</span></span></td> -<td class="org-left">Target date to receive prerecs; earlier is better</td> +<td class="org-left"><a href="#coordinate-volunteers">volunteer coordination</a></td> +<td class="org-left">ad-hoc</td> +<td class="org-left"><b>DONE playbook</b></td> +<td class="org-left">training meetings + recordings</td> </tr> <tr> +<td class="org-left">BBB rooms</td> +<td class="org-left">about 5 rooms that we cycle through</td> <td class="org-left"> </td> -<td class="org-left">zaeph: reencode videos</td> +<td class="org-left"><b>DONE S: one room per speaker</b></td> +</tr> + + +<tr> +<td class="org-left">host</td> +<td class="org-left">no host, speaker reads pad</td> +<td class="org-left"><b>host reads pad</b></td> +<td class="org-left">host monitors IRC and helps with BBB as well</td> +</tr> + + +<tr> +<td class="org-left">BBB Q&A</td> +<td class="org-left">none</td> +<td class="org-left"><b>DONE open to community</b></td> +<td class="org-left">moderated by speaker and host</td> +</tr> + + +<tr> +<td class="org-left">BBB Q&A start</td> +<td class="org-left">awkward silence while waiting</td> +<td class="org-left"><b>speaker can demo a little</b></td> +<td class="org-left">host has prepared questions just in case no one shows up</td> +</tr> + + +<tr> +<td class="org-left"> </td> +<td class="org-left">tracks</td> +<td class="org-left">+ IRC</td> +<td class="org-left"><b>DONE S: + talk info</b>, maybe even current/recent/next</td> +</tr> + + +<tr> +<td class="org-left"><a href="#etherpad">pad</a></td> +<td class="org-left">one pad for conf</td> +<td class="org-left">one pad per talk, wikimedia</td> +<td class="org-left"><b>DONE S: one pad per talk, self-hosted</b> so we can access API</td> +</tr> + + +<tr> +<td class="org-left"><a href="#irc">IRC</a></td> +<td class="org-left">#emacsconf, -org</td> +<td class="org-left"><b>DONE #emacsconf, -gen, -dev, -org</b></td> +<td class="org-left">IRC volunteer copying to pads; maybe even IRC bots</td> </tr> <tr> <td class="org-left"> </td> -<td class="org-left">sachac: prepare talks for captioning</td> +<td class="org-left">ERC commands</td> +<td class="org-left"><b>DONE S: hook-based</b></td> +<td class="org-left">timer-based</td> </tr> <tr> +<td class="org-left"><a href="#publishing-sched">sched update</a></td> +<td class="org-left"><b>DONE S: publish at start</b></td> +<td class="org-left">update main sched</td> +<td class="org-left">update talk pages</td> +</tr> + + +<tr> +<td class="org-left"><a href="#video-platforms">other platforms</a></td> +<td class="org-left"><b>S: Toobnix & YT after event</b></td> <td class="org-left"> </td> -<td class="org-left">volunteers: tech checks, captions</td> +<td class="org-left">S: Toobnix + YT when live</td> </tr> <tr> -<td class="org-left">2022-12-03, 2022-12-04</td> -<td class="org-left">Conference</td> +<td class="org-left">schedule view</td> +<td class="org-left">text table</td> +<td class="org-left">imagemap fallback</td> +<td class="org-left"><b>DONE S: interactive SVG</b></td> +</tr> + + +<tr> +<td class="org-left"><a href="#caption-workflow">caption workflow</a></td> +<td class="org-left">YT autosubs</td> +<td class="org-left">Whisper autosubs</td> +<td class="org-left"><b>DONE: Whisper + more granular timestamps</b></td> +</tr> + + +<tr> +<td class="org-left"><a href="#wiki-design">wiki</a></td> +<td class="org-left">plain text, markdown</td> +<td class="org-left"><b>DONE S: some JS and CSS enrichment</b></td> +<td class="org-left">more JS and CSS, embeds, videoplayer</td> +</tr> + + +<tr> +<td class="org-left"><a href="#ansible">ansible</a></td> +<td class="org-left">none</td> +<td class="org-left"><b>DONE S: some automation</b></td> +<td class="org-left">comprehensive, can also work against containers</td> +</tr> + + +<tr> +<td class="org-left"><a href="#intro">intro and exit</a></td> +<td class="org-left"><b>DONE: slide on screen, host on Mumble</b></td> +<td class="org-left">per-talk video, recorded voiceover</td> +<td class="org-left">Emacs thing so we can display info, countdowns, IRC</td> </tr> </tbody> </table> -Current phase: No prerecs to process yet, so it's a good time to focus on infrastructure +<a id="update"></a> -## TODO Review the submissions in the pad (see emacsconf-org-private or conf.org for the link) and add any objections or comments by Sept 26 for possible [early speaker notification](#org28f349d), Oct 7 for everything :organizers: +# Next comms update -- zaeph: will start reviewing on Sep 21 +- all the Q&A videos are available +- updated GRAIL talk, uploaded orgvm talk +- volunteers: next step is to make chapter markers, large model VTTs are now available +- <span class="timestamp-wrapper"><span class="timestamp">[2022-12-15 Thu] </span></span> all Q&A videos posted, large model VTTs available +- <span class="timestamp-wrapper"><span class="timestamp">[2022-12-12 Mon] </span></span> Updated grail, updated backstage view +- <span class="timestamp-wrapper"><span class="timestamp">[2022-12-11 Sun] </span></span> Thank-you notes sent to all the speakers with Toobnix and YouTube URLs, BBB playback info -## TODO Write preparation instructions and decide on deadline for prerecs :zaeph: +<a id="projects"></a> -2021/prepare.md can be reused. +# Projects and other long-running tasks -We need time after the prerecs get submitted to: +- [Harvest live talks and Q&A](#harvest) +- [Send thanks](#thanks) +- [Finalize the files to be used for streaming](#files) +- [Look for ways to reduce risk](#derisk):derisk: +- [Make checkin and Q&A process slide](#qa):sachac: +- [Caption talks and make chapter headings](#caption) +- [Prepare intros for the hosts to read](#host-intros) +- [Set up talks on Toobnix and YouTube](#video-platforms):sachac:yt:toobnix: +- [Do another run](#dry-run) +- [Turn off file upload service on media.emacsconf.org](#upload-off):sachac:infra: +- [Review notebook for tasks, priorities, and scheduling](#review) +- [Use Mumble for backchannel coordination and also on-stage](#mumble) +- [Satellite events](#satellite) +- [Volunteer update](#volunteer-2022-11-14) +- [Make a linear hyperlist for managing EmacsConf](#hyperlist):sachac: +- [Record intro/outro for day-1 and day-2](#rec-intro):zaeph: +- [Add category tags and possibly links between talks across 2022 and all previous years](#link-pages):quiliro:wiki: +- [JS/CSS enhancement](#watch-css):emacsconf: +- [Build up the ansible playbook](#ansible):sachac:opal: +- [Consider breakout rooms for lunch break](#breakouts) +- [Work on the OBS scenes](#obs-scenes):zaeph:corwin:sachac: +- [Plan Etherpad use and hosting](#etherpad):sachac:ansible: +- [Write about EmacsConf behind the scenes](#writing):sachac: + + +<a id="harvest"></a> + +## Harvest live talks and Q&A + + +### DONE Add audio-only options to the publishing process + + +### Learn from how other conferences harvest their talks and Q&A + +- DebConf posts the talk video (prerecorded + in person Q&A), no transcripts or index + Ex: <https://debconf22.debconf.org/talks/71-sequoia-pgp-v5-openpgp-authentication-and-debian/> . They link to the video and the Etherpad. +- FOSSDEM has directory listings by track: <https://video.fosdem.org/2022/D.conference/> + also embedded video and links to slides, video recording, chat room (but not logs) <https://archive.fosdem.org/2022/schedule/event/community_contributions/> +- LibrePlanet has thumbnails: + <https://media.libreplanet.org/u/libreplanet/tag/libreplanet-2022-video/> . Talk page has video and links to slides, download. + <https://media.libreplanet.org/u/libreplanet/m/taking-back-the-web-with-haketilo/> +- NeovimConf: YouTube playlist, lots of comments on YouTube, key moments +- VS Code Day: link to YouTube video, edited CC captions in YouTube, links and a hashtag in the video description, key moments +- TED: transcript button, shows transcript in a scrollable area on the right + + +### DONE Publish more Q&A recordings -- convert the videos and check that they've been reencoded properly by watching the re-encoded ones all the way to the end -- caption videos -- capture any extra info -- follow up with missing prerecs -zaeph will also figure out the ffmpeg incantation for converting videos and the process for handling submitted prerecs +#### DONE Check status + + (emacsconf-collect-prop :slug + (seq-remove + (lambda (o) + (or (null (string-match "live" (or (plist-get o :q-and-a) ""))) + (null (emacsconf-talk-file o "--bbb-webcams.webm")) + (and (emacsconf-talk-file o "--answers.webm") + (plist-get o :qa-public)))) + (emacsconf-prepare-for-display (emacsconf-get-talk-info)))) + + +#### DONE Write code to make it easy to do so + +emacsconf-extract-publish-qa + + +#### DONE Fetch the reencoded maint answers and post it to backstage + + +### DONE Document this phase of the conference + +We’re now in the harvesting phase of the conference, where we work on +collecting the ideas that people shared in the Q&A sessions as well as +any talks that were not available as pre-recorded videos. It’s a great +way to help speakers get stuff out of their heads and into a form we +can all learn from. =) + +Status of talks and Q&A sessions: + +- All talks except for the new version of grail should now be + available at <https://media.emacsconf.org/2022/> and on talk pages +- Links to the BBB playbacks and to the various BBB resources (–bbb-\* + for each talk) are now in the backstage area for speakers and/or + volunteers to review +- RMS Q&A audio has been uploaded (–questions.ogg) +- grail talk will be reuploaded by the speaker +- IRC logs have been copied to the backstage area; see the links at + the top of the backstage area +- Etherpads have been converted to Markdown and included on the talk pages +- BBB chats have been converted to Markdown and included on the talk pages + +Here’s a good/better/best scale for stuff we can do during this phase: -Extra stuff to consider adding: +- Good: + - Look at IRC log at the top of the backstage area and copy + anonymized questions/answers/feedback to the wiki pages as well, + if they weren’t already on the page + - Somewhat manual because of overlapping conversations; might be + easier to have one volunteer do all the talks in one shift + (Saturday morning gen, Saturday morning dev, Saturday afternoon + gen, etc.), so you can e-mail to call dibs if you like. We + usually remove names from the public log as well. Most of the + conversations should be in the track-specific channels, but some + might have ended up in #emacsconf as well. You can check the + talk page to see if the questions are already there. If you’re + already set up to edit the wiki or you can figure out the + slightly complicated setup for editing, feel free to edit the + page directly. If not, you can email a Markdown or Org Mode + snippet to emacsconf-submit@gnu.org and let me know what page to + put it on. +- Better: + - Review the BBB recording to check if there’s anything that needs + to be deleted from the recording before we publish it so that + people can listen to things themselves; publish the recording or + excerpts of it + - Might be easier with the transcript, but can also be done + without one. asmblox, async, buttons, dbus, detached, and eshell + have –bbb-webcams.vtt as the autogenerated Whisper transcripts. +- Even better than that: + - Make chapter markers for the Q&A recording so that people can jump + to the question they’re particularly interested in. You can write + them in the form: + mm:ss text goes here + mm:ss more text + and I can turn those into chapter headings. +- Totally awesome: + - Edited captions/transcripts for the Q&A + - Answers copied into the Q&A section, possibly with linked timestamps -- Suggestions for org-reveal, fonts and themes (especially wrt colourscape) -- “Please don’t squeeze your talk by fast-forwarding your speech. Trimming silences and filler words can help, though. Sometimes it's easier to write, record, and edit your voiceover, and then record the video to go along with it." -- Allowing speakers to plant questions, esp. to cover tangential stuff that couldn’t fit in the prerec +#### Process for reviewing and trimming the videos -## TODO Write viewing instructions :zaeph: +Helper function: -Extra stuff to consider adding: +- emacsconf-extract-publish-qa (call with C-u in order to specify a time for truncating the video) -- Suggestions for mpv-filter to invert colourscape. +Skim the transcript and the videos to see if anything needs to be removed, and which video to use +BigBlueButton gives us the webcams and audio as one video +(\`–bbb-webcams.webm\`) and the screenshare (if any) as another video +(\`–bbb-deskshare.webm\`). If the speaker shared their screen, we can +focus on that instead of their webcam. The following ffmpeg command +combines the audio from the webcams (which has been previously +extracted into a separate file, \`–bbb-webcams.opus\`) with the video +from the screenshare. -## WAITING Add more submissions (CFP deadline Sept 30) :sachac: +ffmpeg -i example–bbb-webcams.opus -i example–bbb-deskshare.webm -c copy example–answers.webm -- Sacha: Add submissions to emacsconf-2022-private, draft 2-day schedule by Oct 10 +We also want to check if people accidentally shared sensitive +information on their screen, or if anyone said something that they +might not have said if they remembered that thethe Q&A videos will be +shared after the talk. Sometimes there’s some time before we get +around to closing the meeting at the end of the Q&A. Usually, a quick +read of the transcript will show anything that needs to be trimmed. +Here’s how to stop the recording at a specified time: +ffmpeg -i input.webm -to hh:mm:ss -c copy output.webm -## DONE Copy things over from previous notebooks :sachac: +Cutting out stuff from the middle of a recording is slightly more +complicated. It might be easier to use a nonlinear video editor such +as kdenlive to edit the video. If you want to use ffmpeg, using +filters to select the frames and reencode the video will probably work +out better than splitting the file into multiple parts and then +concatenating them without reencoding, as the latter tends to need to +be split on keyframes. Here’s a sample command based on this +[StackOverflow](<https://stackoverflow.com/questions/64866231/remove-a-section-from-the-middle-of-a-video-without-concat>) answer that removes the section between 15 seconds and +45 seconds: +ffmpeg -i input.webm \\ + -vf “select=’not(between(t,15,45))’, setpts=N/FRAME\_RATE/TB” \\ + -af “aselect=’not(between(t,15,45))’, asetpts=N/SR/TB” \\ + output.webm + +Alternatively, you can let us know what parts needs to be trimmed, and +we can figure that part out. -## TODO Double-check sachac’s timezone conversions for availability :corwin: +### TODO Prepare groundwork for volunteers to help -## TODO Investigate streaming options, maybe OBS in the cloud :corwin: -- Issue: zaeph was dropping frames and couldn’t pay attention to as many things as he wanted -- Issue: corwin needs assistance to not be locked in his chair for the whole conf. Premptively, zaeph can do it by broadcasting OBS scenes via the rmtp (instead of just his webcam). - **\*** TODO corwin: plan an approach to use a centralized OBS/nginix "bouncer" :corwin: +#### CANCELLED Document IRC/pad/BBB chat extraction tasks + +Experience level: no technical background needed; slightly easier if you’ve set up your computer for editing the wiki, which needs ssh and git + +There were lots of interesting notes and Q&A on IRC and the pad. If we can copy them to the talk page on the wiki, then we can catch any questions that hadn’t been answered and forward feedback to the speaker. It’s a little challenging because the IRC conversation might get mixed up when another talk starts, so it helps to read the IRC log and decide what lines to include. We usually remove names from the public log as well. Most of the conversations should be in the track-specific channels, but some might have ended up in #emacsconf as well. + +I’ve added IRC chat logs to the top of the backstage page. Each talk also links to the HTML (–pad.html) and Markdown (–pad.md) version of the pad. + +You can see the 2021 talks (ex: <https://emacsconf.org/2021/talks/frownies/> , <https://emacsconf.org/2021/talks/pattern/> ) for an example of how the discussions were archived on the talk pages. Sometimes we organize them by type of comment, so it’s easy to see Q&A vs. notes vs. feedback about the talk itself. + +To avoid duplicating work, maybe we can use this Etherpad to call dibs on talks to process. You can write your name or nick next to the talk(s) you’re archiving. + +If you’re already set up to edit the wiki or you can figure out the slightly complicated setup for editing, feel free to edit the page directly. If not, you can email a Markdown or Org Mode snippet to emacsconf-submit@gnu.org and let me know what page to put it on. + + +### TODO Split up relevant sections from IRC logs so that volunteers can go through them + + +### DONE Check duration of Q&A BBB recordings + +About 15 hours total + + (format-seconds "%h:%.2m:%.2s" + (/ (apply '+ + (seq-keep (lambda (o) + (and (file-exists-p (expand-file-name (concat (plist-get o :video-slug) "--bbb-webcams.opus") emacsconf-cache-dir)) + (compile-media-get-file-duration-ms + (expand-file-name (concat (plist-get o :video-slug) "--bbb-webcams.opus") emacsconf-cache-dir)))) + (emacsconf-get-talk-info))) + 1000)) ;; "14:52:28" + +around 4 hours to process asmblox: 14 minutes (/ (\* 4 60) 14.0) ~17x recorded time +(/ (\* 17 15) 24.0) 10.625 + + +### DONE Get the playback links for the BBB talks + +Added as BBB\_PLAYBACK properties (:bbb-playback in the plist). +on orga@res: + +- /data/emacsconf/2022/bbb-playbacks has the files from the web-based playback +- /data/emacsconf/2022/bbb-raw has the raw files + + +#### DONE Download all the BBB playback files + + (let ((info (emacsconf-prepare-for-display (emacsconf-get-talk-info)))) + (mapconcat + (lambda (o) + (when (plist-get o :bbb-playback) + (let ((meeting-id (when (string-match "meetingId=\\(.+\\)" + (plist-get o :bbb-playback)) + (match-string 1 (plist-get o :bbb-playback))))) + (concat "mkdir " (plist-get o :slug) "\n" + "cd " (plist-get o :slug) "\n" + (mapconcat + (lambda (file) + (concat + "wget https://bbb.emacsverse.org/presentation/" + meeting-id "/" file "\n") + ) + '("video/webcams.webm" "metadata.xml" "deskshare/deskshare.webm" "panzooms.xml" "cursor.xml" "deskshare.xml" "captions.json" "presentation_text.json" "slides_new.xml") + "" + ) + "cd ..\n" + )) + ) + ) + info + "")) + + +#### DONE Convert to Opus in preparation for transcription + +find -name webcams.webm -exec bash -c ’ffmpeg -i {} -c:a copy $(echo {} | sed ’s/webm/opus/’)’ \\; + + +#### TODO Transcribe serially + +in bbb-whisper + + for SLUG in *; do + echo Processing $SLUG $(date -Iseconds) | tee -a bbb-whisper.log + ( + cd $SLUG; + if [[ ! -f webcams.txt ]]; then + whisper --model large --language en --verbose True webcams.opus + else + echo "Skipping, already exists" + fi + ) + done + + +### DONE Extract RMS Q&A from dump + +17:48 of current + + +#### DONE Ffmpeg + +[19:26] <bandali> rsyncing the stream dumps from live0:/data/emacsconf-2022-\* into fh-vm01:~orga/live0-streams/ +[19:26] <bandali> i’ll probably rsync a copy to my own laptop as well, for backup +[19:29] <bandali> a reminder that the stream dumps shouldn’t be used as-is, and should first be remuxed using ffmpeg to fix the timestamps +[19:30] <bandali> using something like this: ffmpeg -i myfile.webm -acodec copy -vcodec copy myfile-remuxed.webm >> myfile.log 2>&1 + + +### DONE Extract orgvm talk + + +### DONE Post IRC logs to backstage so that volunteers can split them up + +See links at the top of backstage + + +### SOMEDAY Copy logs for analysis + + +### DONE Transcribe recordings + + +### DONE Collect recordings from bbb + + +### DONE Back up all the pads + + +### DONE Extract bbb chat and add to backstage + + +### SOMEDAY Awesome Speaker Diarization | awesome-diarization + +<https://wq2012.github.io/awesome-diarization/> + + +### SOMEDAY Document irc, bbb chat, pad tasks + +Experience level: no technical background needed; slightly easier if you’ve set up your computer for editing the wiki, which needs ssh and git + +There were lots of interesting notes and Q&A on IRC and the pad. If we can copy them to the talk page on the wiki, then we can catch any questions that hadn’t been answered and forward feedback to the speaker. It’s a little challenging because the IRC conversation might get mixed up when another talk starts, so it helps to read the IRC log and decide what lines to include. We usually remove names from the public log as well. Most of the conversations should be in the track-specific channels, but some might have ended up in #emacsconf as well. + +I’ve added IRC chat logs to the top of the backstage page, and each talk also links to the HTML (–pad.html) and Markdown (–pad.md) version of the pad. + +You can see the 2021 talks (ex: <https://emacsconf.org/2021/talks/frownies/> , <https://emacsconf.org/2021/talks/pattern/> ) for an example of how the discussions were archived on the talk pages. Sometimes we organize them by type of comment, so it’s easy to see Q&A vs. notes vs. feedback about the talk itself. + +To avoid duplicating work, maybe we can use this Etherpad to call dibs on talks to process. You can write your name or nick next to the talk(s) you’re archiving. + +If you’re already set up to edit the wiki or you can figure out the slightly complicated setup for editing, feel free to edit the page directly. If not, you can email a Markdown or Org Mode snippet to emacsconf-submit@gnu.org and let me know what page to put it on. + + +### STARTED Write some code to copy the events.xml to the backstage + +recording timestamp is 2022-12-03T09:41:30.888-08 +bandali user ID is w\_uwwpzp4fjtqq +joined 2022-12-03T10:07:06.066-08 +aaaaaah, hmm. recording timestamp seems earlier, that might just be when BBB starts the whole thing. +aha! The raw directory has the whole thing, not just the recorded part, and the recording timestamp is the beginning of the meeting. So let’s find out where the actual recording starts. + +Maybe StartWebRTCShareEvent ? +ParticipantStatusChangeEvent might be the webcam start. +Is it DeskShareStartRTMP ? + + +### TODO Improve visualization for Q&A sessions, especially when there’s nothing else to look at + + +#### SOMEDAY Consider the challenge of aligning video segments with a timeline + + +#### SOMEDAY windows - Reducing command-line shortcomings caused by excessive number of FFmpeg inputs - Super User + +<https://superuser.com/questions/1369843/reducing-command-line-shortcomings-caused-by-excessive-number-of-ffmpeg-inputs> + + +#### SOMEDAY kkroening/ffmpeg-python: Python bindings for FFmpeg - with complex filtering support + +<https://github.com/kkroening/ffmpeg-python> + + +#### SOMEDAY Extension repository - Inkscape Wiki + +<https://wiki.inkscape.org/wiki/index.php/Extension_repository#Generator> + + +#### SOMEDAY how to render a long text in an area with automatic wrap - Legacy ImageMagick Discussions Archive + +<https://www.imagemagick.org/discourse-server/viewtopic.php?t=27325> + + +#### SOMEDAY svg to tex with svg package and inkscape: make the text to wrap inside a shape - TeX - LaTeX Stack Exchange + +<https://tex.stackexchange.com/questions/325711/svg-to-tex-with-svg-package-and-inkscape-make-the-text-to-wrap-inside-a-shape> + + +#### SOMEDAY tikz API documentation + +<https://allefeld.github.io/pytikz/tikz/> + + +#### SOMEDAY tikz pgf - Absolute positioning in beamer - TeX - LaTeX Stack Exchange + +<https://tex.stackexchange.com/questions/6185/absolute-positioning-in-beamer> + + +#### SOMEDAY CTAN: Package textpos + +<https://ctan.org/pkg/textpos> + + +#### SOMEDAY positioning - How do I put some text in specific position on a page horizontally with the prosper class? - TeX - LaTeX Stack Exchange + +<https://tex.stackexchange.com/questions/35602/how-do-i-put-some-text-in-specific-position-on-a-page-horizontally-with-the-pros> + + +#### SOMEDAY Exporting LaTeX TikZ as Image Files | Baeldung on Computer Science + +<https://www.baeldung.com/cs/exporting-tikz-as-images> + + +#### SOMEDAY OpenAI Whisper tutorial: Whisper - Transcription and diarization (speaker identification) | LabLab + +<https://lablab.ai/t/whisper-transcription-and-speaker-identification> + + +#### TODO Consider ffmpeg to make speaker labels so that I can overlay them on webcams.webm + + +#### TODO could be fancy to have an FFMPEG compose the videos with names and webcams on the right side + + +#### SOMEDAY Try using the single webcam view of the speaker + + +### SOMEDAY Think about how I want to format the VTT for the RMS Q&A + + +#### SOMEDAY Use word data, maybe reflow based on it + + +### SOMEDAY Combine webcams and deskshare + + +### TODO Extract comments from IRC + + +#### SOMEDAY Auto-add A: marker for speaker + + +### DONE compare deskshare with webcams + + (mapcar (lambda (o) + (cons (emacsconf-get-slug-from-string o) + (- (compile-media-get-file-duration-ms o) + (compile-media-get-file-duration-ms (replace-regexp-in-string "deskshare" "webcams" o))) ) + + ) + (directory-files emacsconf-cache-dir t "-deskshare.webm")) + + +### Improve segmented audio normalization + + +#### SOMEDAY How to normalize the volume of an audio file in python? - Stack Overflow + +<https://stackoverflow.com/questions/42492246/how-to-normalize-the-volume-of-an-audio-file-in-python> + + +#### SOMEDAY Execute Macro from Script - Audacity Forum + +<https://forum.audacityteam.org/viewtopic.php?t=121821> + + +### TODO subtitle hyperorg + + +### DONE Check duration + + (/ (apply '+ + (mapcar #'compile-media-get-file-duration-ms + (directory-files emacsconf-cache-dir t "\\(main\\|webcams\\).webm\\|rms.*ogg"))) + 3600000.0) + +28.860543888888888 + +- 29 hours including Q&A +- 14 hours of talks, 15 hours of Q&A + +(\* 28 0.0075 60) +12.6 + + +### SOMEDAY Copy irc, haven’t actually done that yet + + +### SOMEDAY Create harvesting etherpad if needed to track the status? + + +### DONE Update task status now that I have TO\_REVIEW\_QA, TO\_INDEX\_QA, TO\_CAPTION\_QA + + (with-current-buffer (find-file-noselect emacsconf-org-file) + (org-map-entries + (lambda () + (if (file-exists-p (expand-file-name (concat (org-entry-get (point) "VIDEO_SLUG") "--answers.webm") + emacsconf-cache-dir)) + (org-todo "TO_INDEX_QA") + (org-todo "TO_REVIEW_QA"))) + "TODO=\"TO_ARCHIVE\"+SLUG={.}") + ) + + (with-current-buffer (find-file-noselect emacsconf-org-file) + (org-map-entries + (lambda () + (unless (file-exists-p (expand-file-name (concat (org-entry-get (point) "VIDEO_SLUG") "--bbb-webcams.webm") + emacsconf-cache-dir)) + (org-todo "TO_ARCHIVE"))) + "TODO=\"TO_REVIEW_QA\"+SLUG={.}") + ) + + +### TODO consider number-anonymizing the IRC chat + + +### TODO switch to resources view + + +### TODO Harvest the closing remarks + + +### TODO Check normalization of answers + +<https://stackoverflow.com/questions/42492246/how-to-normalize-the-volume-of-an-audio-file-in-python> + + +#### SOMEDAY Scripting - Audacity Manual + +<https://manual.audacityteam.org/man/scripting.html> + + +### SOMEDAY Post transcripts, start working on chapter workflow + + +### SOMEDAY Add audio-only handler for media card + + +### SOMEDAY How to chunk text into paragraphs using python | by N Polovinkin | Medium + +<https://medium.com/@npolovinkin/how-to-chunk-text-into-paragraphs-using-python-8ae66be38ea6> + + +### STARTED Figure out ways to make sense of IRC logs + +ssh +Possible: thread speaker messages? +Manual: + +- search backward to find the lines, put something under +- avy to indent it under that line +- use properties to suggest lines +- copy everything, use Emacs News code to refile entries +- anonymize after + + +### TODO improve nil note for missing resources + + +### CANCELLED Trim grail if needed + + +### DONE I uploaded the Q&A sessions to Toobnix. :sachac: + +Least extra work if I do it after chapter markers, but I can just do them now and then update them later + + (mapc (lambda (o) + (let ((default-directory "~/vendor/PeerTube/")) + (when (emacsconf-publish-upload-answers o 'toobnix) + (emacsconf-go-to-talk o) + (shell-command "xdotool mousemove 1782 370 click 1 sleep 1 key Ctrl+r sleep 4 mousemove 1584 546 click 3 sleep 1 mousemove 1664 746 click 1 mousemove 1584 546 sleep 1 key Alt+Tab sleep 1") + (org-entry-put + (point) "QA_TOOBNIX" + (read-string (format "URL for %s: " + (org-entry-get (point) "SLUG"))))))) + (seq-remove + (lambda (o) + (or (null (emacsconf-talk-file o "--answers.webm")) + (plist-get o :qa-toobnix))) + (emacsconf-prepare-for-display (emacsconf-get-talk-info)))) + + +### DONE Upload answers to Youtube :sachac: + +Set eval to yes and work carefully. + + (defun emacsconf-publish-answers-python (talk) + (interactive) + (concat "filename = \"\"\"" (emacsconf-talk-file talk "--answers.webm") "\"\"\"\n" + "title = \"\"\"" (emacsconf-publish-answers-title talk 100) "\"\"\"\n" + "description = \"\"\"" (emacsconf-publish-answers-description talk 'youtube) "\"\"\"\n")) + (plist-get + (seq-find (lambda (talk) + (not (or (null (emacsconf-talk-file talk "--answers.webm")) + (plist-get talk :qa-youtube)))) + (emacsconf-prepare-for-display (emacsconf-get-talk-info))) + :slug) + +:end: + +quota, continue tomorrow + + +#### Setup + + from playwright.sync_api import Playwright, sync_playwright, expect + from pathlib import Path + import json + + playwright = sync_playwright().start() + browser = playwright.firefox.launch(headless=False) + context = browser.new_context() + page = context.new_page() + context.add_cookies(json.loads(Path("cookies.json").read_text())) + page.goto("https://studio.youtube.com/") + +Save the cookies after it’s all set up + + Path("cookies.json").write_text(json.dumps(cookies)) + + context.add_cookies(json.loads(Path("cookies.json").read_text())) + page.goto("https://studio.youtube.com/channel/UCwuyodzTl_KdEKNuJmeo99A") + +1. Upload the file + + #page.get_by_role("dialog", name="Video processing").get_by_role("button", name="Close").click() + page.locator("#create-icon").click() + page.get_by_text("Upload videos").click() + page.get_by_role("button", name="Select files").click() + nil + +1. Set the talk details and copy the URL. + + (save-window-excursion + (emacsconf-go-to-talk (emacsconf-resolve-talk slug)) + (org-entry-put (point) "QA_YOUTUBE" url)) + + +##### Background code + + (let ((talk (emacsconf-resolve-talk slug))) + (kill-new (emacsconf-talk-file talk "--answers.webm")) + (emacsconf-publish-answers-python talk)) + + nil + page.locator("#title-textarea").click() + page.keyboard.press("Control+KeyA") + page.keyboard.press("Delete") + page.keyboard.type(title) + page.locator("#description-textarea #textbox").fill(description) + page.locator('ytcp-video-metadata-playlists .dropdown-trigger-text').click() + page.get_by_role("dialog", name="Choose playlists").get_by_text("EmacsConf 2022").click() + page.get_by_role("button", name="Done").click() + page.get_by_role("button", name="Show more").click() + page.get_by_placeholder("Add tag").fill("emacs, emacsconf, answers") + page.get_by_placeholder("Add tag").click() + href = page.locator('a.ytcp-video-info').get_attribute('href') + page.locator("#step-badge-3").click() + page.locator(".ytcp-video-visibility-select[name=PUBLIC]").click() + page.get_by_role("button", name="PUBLISH").click() + print(href) + +<https://youtu.be/Q453L_whGEc> + + +### TODO Add links to Q&A to Youtube video descriptions + + +### SOMEDAY Make a podcast feed of the talks + + +### TODO Check that webms have latest vtts + + +### TODO Break autocaptions every 5 minutes or so, so that they can be included on the webpage + + +### DONE Add maint chapter markers to Toobnix and Youtube, automate it + + (setq talk (emacsconf-resolve-talk "maint")) + (replace-regexp-in-string + "\\\\" "\\\\\\\\" + (json-encode + (list + :qa-youtube (plist-get talk :qa-youtube) + :qa-toobnix (plist-get talk :qa-toobnix) + :slug (plist-get talk :slug) + :answers-description-youtube (emacsconf-publish-answers-description talk 'youtube) + :answers-description-toobnix (emacsconf-publish-answers-description talk 'youtube)))) + +Update YouTube + + from playwright.sync_api import Playwright, sync_playwright, expect + from pathlib import Path + import json + import re + + talk = json.loads("""nil""") + playwright = sync_playwright().start() + browser = playwright.firefox.launch(headless=False) + context = browser.new_context() + page = context.new_page() + context.add_cookies(json.loads(Path("cookies.json").read_text())) + m = re.search("[^/=]+$", talk['qa-youtube']) + page.goto("https://studio.youtube.com/video/" + m.group(0) + "/edit") + page.locator("#description-textarea #textbox").fill(talk['answers-description-youtube']) + page.get_by_role('button', name="Save").click() + +Update Toobnix: + + talk = json.loads("""nil""") + m = re.search("[^/=]+$", talk['qa-youtube']) + page.goto("https://toobnix.org/videos/update/" + m.group(0)) + page.locator("#description").fill(talk['answers-description-toobnix']) + page.locator('.orange-button').click() + + +<a id="thanks"></a> + +## TODO Send thanks + + +### TODO Send thank-you notes to speakers + +Dependencies: + +- youtube, toobnix urls +- bbb playback urls +- pads copied + + (defvar emacsconf-mail-thank-speaker-open-youtube t + "If non-nil, browse to the YouTube page so we can mention views and stuff.") + + (defun emacsconf-mail-thank-speaker (group &optional template) + (interactive (list (emacsconf-mail-complete-email-group))) + (delete-other-windows) + (with-selected-window + (split-window-right) + (emacsconf-edit-wiki-page (plist-get (cadr group) :slug)) + (when (> (length (cdr group)) 1) + (mapc + (lambda (talk) + (with-selected-window (split-window-below) + (emacsconf-edit-wiki-page (plist-get talk :slug)))) + (cddr group)) + (balance-windows))) + (let ((with-bbb (seq-filter (lambda (talk) (plist-get talk :bbb-playback)) (cdr group)))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "thanks-speaker")) + (car group) + (list + :email (car group) + :conf-name emacsconf-name + :year + emacsconf-year + :plural + (if (= (length (cdr group)) 1) "" "s") + :video-is + (if (= (length (cdr group)) 1) "video is" "videos are") + :bbb-note + (if with-bbb + (concat + " We'd like to publish the audio (and possibly the video as well) + with chapter markers and maybe even captions, depending on + volunteers. In case you want to revisit your Q&A session in + order to remember anything particularly cool that you'd like to + follow up on (or anything particularly sensitive/embarrassing + that you'd like us to omit), you can view the BigBlueButton + playback at " (mapconcat (lambda (talk) (plist-get talk :bbb-playback)) with-bbb " , ") " . Volunteers will be working on harvesting the Q&A over the next few weeks/months. If you'd like to help with the processing, I've added the files + to ${backstage} and documented our harvesting process at + https://emacsconf.org/harvesting/ . The files start with --bbb in the backstage area. This is + totally optional and just there in case you feel like taking advantage + of it. =)") + "") + :backstage + (mapconcat (lambda (talk) + (concat "https://media.emacsconf.org/" emacsconf-year "/backstage/#" (plist-get talk :slug))) + (cdr group) " , ") + :urls + (mapconcat (lambda (talk) + (plist-get talk :absolute-url)) + (cdr group) " , ") + :toobnix-url + (mapconcat (lambda (talk) + (plist-get talk :toobnix-url)) + (cdr group) " , ") + :youtube-url + (mapconcat (lambda (talk) + (plist-get talk :youtube-url)) + (cdr group) " , ") + :speakers-short (plist-get (cadr group) :speakers-short))) + (when emacsconf-mail-thank-speaker-open-youtube + (mapc (lambda (talk) + (when (plist-get talk :youtube-url)) (browse-url (plist-get talk :youtube-url))) + (cdr group))))) + + +#### Template + +Hi, ${speakers-short}! + +Thank you so much for being part of EmacsConf ${year}! Hundreds of +people enjoyed it, and I’m sure even more will come across the videos +in the days to follow. + +Your ${video-is} available on the talk page${plural} at ${urls} , and +we’ve added the discussions from Etherpad/IRC.${bbb-note}${wrap} + +We’ve also uploaded your talk video${plural} to Toobnix (a PeerTube +instance) at ${toobnix-url} and YouTube at ${youtube-url} . If you +want to reupload the video to your own channel, please feel free to do +so. If you let me know where you’ve uploaded it, I think I can switch +our playlist to include your version of the video instead. That way, +it might be easier for you to respond to comments on videos.${wrap} + +If you would like to share more resources, you can add them to the +talk page or e-mail them to us and we can add them for you. + +Thanks again for speaking at EmacsConf! + +Sacha + + +### TODO Send thank-you notes to volunteers + + +<a id="files"></a> + +## STARTED Finalize the files to be used for streaming + +Verify that all the files load + + (let ((info (emacsconf-prepare-for-display (emacsconf-get-talk-info)))) + (mapconcat + (lambda (track) + (concat "- " (plist-get track :name) "\n" + (mapconcat + (lambda (talk) + (if (plist-get talk :video-file) + (format " - [ ] [[elisp:(emacsconf-stream-play-talk-on-change \"%s\")][Play %s]]\n" + (plist-get talk :slug) (plist-get talk :slug)) + "")) + (emacsconf-filter-talks-by-track track info)))) + emacsconf-tracks)) + +How about the ones that might be live + + (let ((info (emacsconf-prepare-for-display (emacsconf-get-talk-info)))) + (mapconcat + (lambda (track) + (concat "- " (plist-get track :name) "\n" + (mapconcat + (lambda (talk) + (if (null (plist-get talk :video-file)) + (format " - [ ] [[elisp:(emacsconf-stream-play-talk-on-change \"%s\")][Play %s]]\n" + (plist-get talk :slug) (plist-get talk :slug)) + "")) + (emacsconf-filter-talks-by-track track info)))) + emacsconf-tracks)) + + +### TODO Fix my audio volume for intros + + +### DONE Remove first eight seconds of Jupyter if possible, and the last 16 seconds or so + +screen -S jupyter-trim ffmpeg -y -ss 8 -to 00:16:40 -i emacsconf-2022-jupyter–edit-live-jupyter-notebook-cells-with-emacs–blaine-mooers–final.webm emacsconf-2022-jupyter–edit-live-jupyter-notebook-cells-with-emacs–blaine-mooers–trimmed.webm + + +### TODO Regenerate overlays to accommodate different layout + +<a id="derisk"></a> + +## Look for ways to reduce risk :derisk: + +<https://pad.emacsconf.org/premortem> + + +### DONE Click on stuff with xdotool + +(emacsconf-stream-bbb “journalism”) +(emacsconf-stream-xdotool-set-up-bbb “journalism”) +;; get into backstage area +xdotool mousemove 806 385 click 1 + +(progn +) + +(let ((pos (emacsconf-stream-xdotool “General” “getmouselocation”))) + (when (string-match “x:\\$[0-9]+\$ y:\\$[0-9]+\$” pos) + (insert (format “(emacsconf-stream-xdotool \\”General\\“ \\”mousemove %s %s click 1\\“)\n” (match-string 1 pos) (match-string 2 pos))))) + +(emacsconf-stream-track-ssh + (emacsconf-get-track “General”) + (split-string “xdotool ”)) + +xdotool mousemove 253 176 click 1 +xdotool mousemove 215 164 click 1 +xdotool key f11 + + +### DONE Make copyable version of bbb redirect :derisk: + + +### DONE Make sure all the important tasks are scheduled over the next two weeks + + (defun emacsconf-prep-agenda () + (interactive) + (let* ((notebook (expand-file-name "index.org" (expand-file-name "organizers-notebook" (expand-file-name emacsconf-year emacsconf-directory)))) + (org-agenda-custom-commands + `(("a" "Agenda" + ((tags-todo "-PRIORITY=\"C\"-SCHEDULED={.}-nextyear" + ((org-agenda-files (list ,notebook)))) + (agenda "" + ((org-agenda-files (list ,notebook)) + (org-agenda-span 7))) + ))))) + (org-agenda nil "a"))) + + +### DONE Try a reboot before the resize :sachac: + +- After rebooting live0, we should still be able to: + - [X] SSH to it + - [X] Stream gen to it + - [X] Start up the fallbacks: screen-fallbacks + - test: mpv <https://live0.emacsconf.org/gen-fallback.webm> + - [X] Play gen stream: mpv <https://live0.emacsconf.org/gen.webm> + - [X] Play gen 480p stream: mpv <https://live0.emacsconf.org/gen-480p.webm> + - [X] Go to watch page for gen: + - <https://emacsconf.org/2022/watch/gen/> + - <https://live.emacsconf.org/2022/watch/gen/> + - [X] Start test restream to toobnix + - screen-restream-test-toobnix.sh + - <https://toobnix.org/w/dmibQFkBTNcJyTVVQTyd5C> + - Test dev as well (optional) + - [X] Stream dev to it + - [X] Play dev stream + - [X] Play dev 480p stream + - [X] Go to watch page for dev +- After rebooting front0, we should still be able to: + - [X] View the wiki <https://emacsconf.org/2022/> + - [X] Update the status page [edit](file://ssh:front0.emacsconf.org:/var/www/status.emacsconf.org/index.html) <https://status.emacsconf.org> + - [ ] Go to the pad: <https://pad.emacsconf.org/2022> + + +### DONE icecast fallback :derisk:sachac: + + +#### Creating the files + +ffmpeg -y -f lavfi -i anullsrc=channel\_layout=stereo:sample\_rate=48000 -loop 1 -r 20 -t 10 -i sorry.png -c:v libvpx -c:a libvorbis -color\_primaries 1 -color\_trc 1 -colorspace 1 -crf 30 -g 120 -minrate 1.5M -b:v 1500 -g 120 -maxrate 1.5M -cluster\_time\_limit 5100 -shortest sorry.webm + +ffmpeg -y -f lavfi -i anullsrc=channel\_layout=stereo:sample\_rate=48000 -loop 1 -r 20 -t 10 -i sorry.png -vf scale=854:480 -c:v libvpx -c:a libvorbis -color\_primaries 1 -color\_trc 1 -colorspace 1 -crf 30 -g 120 -minrate 1.5M -b:v 1500 -g 120 -maxrate 1.5M -cluster\_time\_limit 5100 -shortest sorry-480p.webm + +icecast 2.4.4 + Stream #0:0: Video: vp8, yuv420p(tv, bt709, progressive), 1280x720, SAR 1:1 DAR 16:9, 20 fps, 20 tbr, 1k tbn, 1k tbc (default) + Stream #0:1: Audio: vorbis, 48000 Hz, stereo, fltp (default) + +Okay. I can ffmpeg to /gen-sorry.webm with +orga@live0:/usr/share/icecast2/web$ ffmpeg -r 20 -re -stream\_loop -1 -i gen-fallback.webm -f webm -content\_type video/webm -c:a copy -c:v copy icecast://https://emacsconf.org/2022/talks/$PASSWORD@localhost:8001/gen-sorry.webm + + +##### TODO Add test pattern to part of the screen + + +##### gen + +Input #0, matroska,webm, from ’http://live0.emacsconf.org:8001/gen.webm’: + Metadata: + ENCODER : Lavf58.20.100 + icy-pub : 0 + icy-metadata : 1 + Duration: N/A, start: 39.061000, bitrate: N/A + Stream #0:0: Video: vp8, yuv420p(tv, bt709, progressive), 1280x720, SAR 1:1 DAR 16:9, 20 fps, 20 tbr, 1k tbn, 1k tbc (default) + Stream #0:1: Audio: vorbis, 48000 Hz, stereo, fltp (default) + + +##### fallback + +Input #0, matroska,webm, from ’http://live0.emacsconf.org:8001/gen.webm’: + Metadata: + ENCODER : Lavf58.20.100 + icy-pub : 0 + icy-metadata : 1 + Duration: N/A, start: 19.473000, bitrate: N/A + Stream #0:0: Video: vp8, yuv420p(tv, bt709, progressive), 1280x720, SAR 1:1 DAR 16:9, 20 fps, 20 tbr, 1k tbn, 1k tbc (default) + Stream #0:1: Audio: vorbis, 48000 Hz, stereo, fltp (default) + + +#### DONE Create fallback for 480p as well + + +#### DONE Create fallback video + + +#### DONE Add more ffmpeg options from the OBS profile to try to get them to match as closely as possible + + +#### DONE Detect fallback and reload the video player + +<https://stackoverflow.com/questions/36280764/audio-stops-playing-while-moving-to-fallback-mount-using-icecast#36332739> + + // @license magnet:?xt=urn:btih:90dc5c0be029de84e523b9b3922520e79e0e6f08&dn=cc0.txt txt CC0-1.0 + // Copyright (c) 2022 Sacha Chua - CC0 Public Domain + var video = document.querySelector('video.reload'); + if (video) { + var myVar = setInterval(reloadAsNeeded, 1000); + var oldTime = ''; + function reloadAsNeeded() { + if ((video.paused != true && (video.currentTime - oldTime) == 0 && video.currentTime != 0)) { + var source = video.querySelector('source'); + var oldVideo = source.src; + source.src = ''; + source.src = oldVideo; + video.load(); + video.play(); + } + oldTime = video.currentTime; + }; + } + // @license-end + + +### DONE Make sure things are okay for me to handle both streams :sachac: + + +#### DONE Add keyboard shortcuts + +<table> + + +<colgroup> +<col class="org-left"> + +<col class="org-left"> +</colgroup> +<tbody> +<tr> +<td class="org-left">S-g</td> +<td class="org-left">gen VNC</td> +</tr> + + +<tr> +<td class="org-left">S-d</td> +<td class="org-left">dev VNC</td> +</tr> + + +<tr> +<td class="org-left">S-G</td> +<td class="org-left">gen console</td> +</tr> + + +<tr> +<td class="org-left">S-D</td> +<td class="org-left">dev console</td> +</tr> + + +<tr> +<td class="org-left">S-o</td> +<td class="org-left">orga@res console</td> +</tr> +</tbody> +</table> + + +#### DONE figure out left/right to keep track of both streams + +I’m just going to do this with pavucontrol so that it’s not too complicated + + +#### CANCELLED Tweak my audio setup for push-to-talk? + +<https://news.ycombinator.com/item?id=23160101> +<https://gist.github.com/zouppen/bdd40a42c77ca387fae8bace0f2ed3e0> + + +#### DONE Guard against over-announcing by paying attention to erc + +Goal: Don’t spam the channel with talk announcements + +If it was announced in the last 5 minutes, don’t reannounce it as part +of the hook, but allow reannouncements if called manually. + +How to detect announcements: + +If it was the most recently announced talk in the channel, don’t re-announce it + +(with-eval-after-load ’erc (add-hook ’erc-insert-pre-hook ’emacsconf-erc-notice-announcements)) + + +<a id="qa"></a> + +## CANCELLED Make checkin and Q&A process slide :sachac: + +Low-priority because people were able to manage fine last year +Even better if we can add in-between slides (ex: +<https://media.emacsconf.org/2022/in-between/journalism>) for slide #2 + +asked corwin about access to bbb.emacsverse.org because uploading +presentations seems to not work on our instance. In the meantime, we +can paste in <https://emacsconf.org/2022/qa/> for tips. + + +<a id="caption"></a> + +## Caption talks and make chapter headings + + +### DONE Nudge volunteers to e-mail me captions by Dec 1 :mail:sachac: + + +### DONE Copy chapter headings for mail talk :emacsconf:captions: + + +### DONE Caption the new talks :sachac: + + +<a id="host-intros"></a> + +## Prepare intros for the hosts to read + +<https://pad.emacsconf.org/intros> +also in :INTRO\_NOTE: in conf.org so that we can plop it into the hyperlists. + + +### DONE Write intros for all the other talks + +so that people on other platforms can come across EmacsConf + + +### DONE Record a few sample intros to test the workflow + +mogrify -alpha off file.png + + +### DONE Write the restreaming shell scripts + + +### DONE Create the events and save the keys :sachac: + +[Other platforms](file:///home/sacha/proj/emacsconf/private/conf.md) + +$1 is of the form rtmp://…/stream\_key + + MOUNT=$1 + while true; do ffmpeg -loglevel 24 -i http://localhost:8000/main.webm -cluster_size_limit 2M -cluster_time_limit 5100 -b:v 1M -crf 30 -g 125 -deadline good -threads 4 -vcodec libx264 -acodec libmp3lame -f flv $MOUNT; done + +Creating the events + +- YouTube: Create - Go Live - Schedule Stream - Streaming Software +- Toobnix: Publish - Go live + - max live is 5 hours + + +##### EmacsConf 2022 - General track + +This is for the general track of EmacsConf, the conference about the joy of Emacs and Emacs Lisp. + +Schedule: +Saturday Dec 3, 2022, 9 AM - 12 PM EST, 1 PM - 5 PM EST +Sunday Dec 4, 2022, 9 AM - 12 PM EST, 1 PM - 5 PM EST + +Watch using free/open source software: <https://live.emacsconf.org/2022/watch/gen/> +Conference info: <https://emacsconf.org/2022/> +Schedule: <https://emacsconf.org/2022/talks/> +Chat on #emacsconf-dev via <https://chat.emacsconf.org> or irc.libera.chat +Etherpad: <https://pad.emacsconf.org/2022> + +Videos are shared under the terms of the Creative Commons Attribution-ShareAlike 4.0 +International (CC BY-SA 4.0) license. Please observe the guidelines for conduct: <https://emacsconf.org/conduct/> + + +##### EmacsConf 2022 - Development track + +This is for the development track of EmacsConf, the conference about the joy of Emacs and Emacs Lisp. + +Schedule: +Saturday Dec 3, 2022, 9 AM - 12 PM EST, 1 PM - 5 PM EST +Sunday Dec 4, 2022, 9 AM - 12 PM EST, 1 PM - 5 PM EST + +Watch using free/open source software: <https://live.emacsconf.org/2022/watch/dev/> +Conference info: <https://emacsconf.org/2022/> +Schedule: <https://emacsconf.org/2022/talks/> +Chat on #emacsconf-dev via <https://chat.emacsconf.org> or irc.libera.chat +Etherpad: <https://pad.emacsconf.org/2022> + +Videos are shared under the terms of the Creative Commons Attribution-ShareAlike 4.0 +International (CC BY-SA 4.0) license. Please observe the guidelines for conduct: <https://emacsconf.org/conduct/> + + +### DONE Test start restream on a timer :emacsconf: + +ssh live0.emacsconf.org +confirm that Toobnix test stream isn’t playing + +echo ’/bin/bash /home/orga/screen-restream-test-toobnix.sh’ | at ’now + 1 minute’ +echo ’/bin/bash /home/orga/screen-restream-test-toobnix.sh’ | at 8:30 + + +### TODO Process the other intros + + +### DONE Record more intros :zaeph: + + +### DONE Record two-part introduction for RMS talk + +Before Richard Stallman shares what he’d like to see in Emacs, we will first play Richard Stallman’s 2014 TEDx talk called “Free Software, Free Society”. The TEDx talk is licensed under the Creative Commons Attribution - No Derivative Works 3.0 license. + +The next talk is called “What I’d like to see in Emacs,” by Richard Stallman. This talk will be under the Creative Commons Attribution - ShareAlike license like the other talks at EmacsConf. Afterwards, he will answer questions via a moderated Q&A, so please put your questions in the Etherpad or IRC. + + +### DONE Add images to zaeph’s intros :sachac: + + +### DONE Add subtitles to intros + + +### DONE rerecord zachary, pronunciation + + +### DONE rerecord buddy, got mixed up with meetups + + +### DONE redo visual for health, changed the title case + + +### DONE rerecord indieweb, accent on the wrong syllable + + +### DONE rerecord jupyter intro, repetitive + + +### TODO consider rerecording meetups to add + +Spanish subtitles are also available for this talk. + +You can find them on the talk page. + + +### TODO Contextualize journalism talk + + +<a id="video-platforms"></a> + +## DONE Set up talks on Toobnix and YouTube :sachac:yt:toobnix: + +so that people can find the videos on other video platforms +waiting for prerecs + +category 15: science and technology +license 2: attribution - share alike +language: en +privacy 2: unlisted +tags: emacs,emacsconf + + +### DONE Add toobnix url on schedule + + +### Upload to YouTube + + (insert + (string-join + (seq-take + (seq-keep + (lambda (o) + (when (and + (file-exists-p + (expand-file-name + (concat (plist-get o :video-slug) "--final.webm") + emacsconf-cache-dir)) + (null (plist-get o :youtube-url))) + (format "./youtube-upload --client-secrets=../../client_secret.json --title=%s --description=%s --category=%s --tags=emacs,emacsconf --recording-date=%s --default-language=en --default-audio-language=en --embeddable=True %s" + (shell-quote-argument + (concat emacsconf-name " " emacsconf-year ": " (plist-get o :title) " - " (plist-get o :speakers-with-pronouns))) + (shell-quote-argument + (emacsconf-publish-video-description o)) + (shell-quote-argument "Science & Technology") + (format-time-string "%Y-%m-%dT%H:%M:%S.0Z" (plist-get o :start-time) t) + (expand-file-name + (concat (plist-get o :video-slug) "--final.webm") + emacsconf-cache-dir) + ))) + (emacsconf-get-talk-info)) 1) + "\n")) + ./youtube-upload --client-secrets=../../client_secret.json --title=EmacsConf\ 2022\:\ Writing\ and\ organizing\ literature\ notes\ for\ scientific\ writing\ -\ Vidianos\ Giannitsis --description=https\://emacsconf.org/2022/talks/science' + '' + '00\:00\:00\ My\ second\ brain' + '00\:28\ Contents\ of\ the\ talk' + '01\:40\ Bibliography\ management' + '02\:35\ Creating\ literature\ notes\:\ ivy-bibtex-edit-notes' + '03\:04\ org-roam\ reference\ template' + '04\:40\ Demo' + '05\:40\ Annotating\ with\ org-noter' + '06\:44\ Annotating\ in\ English' + '07\:02\ Afterthoughts\ on\ an\ article' + '07\:30\ Adding\ a\ note' + '08\:21\ Creating\ permanent\ notes\ from\ reference\ material' + '09\:01\ The\ organization\ problem' + '09\:21\ zetteldesk.el' + '10\:43\ The\ zetteldesk-desktop' + '11\:45\ Filtering\ with\ ivy-bibtex' + '12\:09\ Inserting\ literature' + '13\:46\ Composing\ the\ final\ article' + '15\:19\ Thanks' + '' + 'You\ can\ view\ this\ and\ other\ resources\ using\ free/libre\ software\ at\ https\://emacsconf.org/2022/talks/science\ .' + 'This\ video\ is\ available\ under\ the\ terms\ of\ the\ Creative\ Commons\ Attribution-ShareAlike\ 4.0\ International\ \(CC\ BY-SA\ 4.0\)\ license. --category=Science\ \&\ Technology --tags=emacs,emacsconf --recording-date=2022-12-03T15:45:00.0Z --default-language=en --default-audio-language=en --embeddable=True /home/sacha/proj/emacsconf/cache/emacsconf-2022-science--writing-and-organizing-literature-notes-for-scientific-writing--vidianos--final.webm + + +### Toobnix + + (insert + (string-join + (seq-keep + (lambda (o) + (when (and + (file-exists-p + (expand-file-name + (concat (plist-get o :video-slug) "--main.webm") + emacsconf-cache-dir)) + (null (plist-get o :toobnix-url))) + (format "cd ~/vendor/PeerTube; node dist/server/tools/peertube.js upload -f %s -n %s -l 2 -c 15 -P 2 -t emacs,emacsconf -L en -C emacsconf -d %s" + (expand-file-name + (concat (plist-get o :video-slug) "--main.webm") + emacsconf-cache-dir) + (shell-quote-argument + (concat emacsconf-name " " emacsconf-year ": " (plist-get o :title) " - " (plist-get o :speakers-with-pronouns))) + (shell-quote-argument + (emacsconf-publish-video-description o))))) + (emacsconf-get-talk-info)) + "\n")) + + +### DONE Upload the rest of the talks to Toobnix + + +### DONE Add Toobnix talks to a playlist + + (mapc (lambda (o) + (when (plist-get o :toobnix-url) + (browse-url (plist-get o :toobnix-url)) + (shell-command "xdotool sleep 5 mousemove 1815 1030 click 1 sleep 2 mousemove 1684 799 click 1 key Alt+Tab") + (read-string "Continue?"))) + (let ((talks (emacsconf-prepare-for-display (emacsconf-get-talk-info)))) + (seq-drop talks + (1+ (seq-position talks + (seq-find (lambda (o) (string= (plist-get o :slug) "haskell")) talks))))) + ) + + +### DONE Add Youtube talks to a playlist + + +### DONE Upload talks to YouTube + + (seq-keep + (lambda (o) + (when (and + (file-exists-p + (expand-file-name + (concat (plist-get o :video-slug) "--final.webm") + emacsconf-cache-dir)) + (null (plist-get o :youtube-url))) + (concat (plist-get o :video-slug) "--final.webm"))) + (emacsconf-get-talk-info)) + + ;; This buffer is for text that is not saved, and for Lisp evaluation. + ;; To create a file, visit it with C-x C-f and enter text in its buffer. + + (let ((pos (shell-command-to-string "xdotool getmouselocation"))) + (when (string-match "x:\\([0-9]+\\) y:\\([0-9]+\\)" pos) + (insert (format "(shell-command \"xdotool mousemove %s %s click 1\")\n" (match-string 1 pos) (match-string 2 pos))))) + + (setq list (seq-filter (lambda (o) + (and + (file-exists-p + (expand-file-name + (concat (plist-get o :video-slug) "--final.webm") + emacsconf-cache-dir)) + (null (plist-get o :youtube-url)))) + (emacsconf-prepare-for-display (emacsconf-get-talk-info)))) + (setq list (cons talk list)) + + (while list + (progn + (shell-command "xdotool mousemove 707 812 click 1 sleep 2") + + (setq talk (pop list)) + ;; click create + (shell-command "xdotool mousemove 843 187 click 1 sleep 1") + ;; video + (shell-command "xdotool mousemove 833 217 click 1 sleep 1") + ;; select files + (shell-command (concat "xdotool mousemove 491 760 click 1 sleep 4 type " + (shell-quote-argument (concat (plist-get talk :video-slug) "--final.webm")))) + ;; open + (shell-command "xdotool mousemove 1318 847 click 1 sleep 5") + + (kill-new (concat + emacsconf-name " " + emacsconf-year ": " + (plist-get talk :title) + " - " + (plist-get talk :speakers-with-pronouns))) + (shell-command "xdotool sleep 1 mousemove 331 440 click :1 key Ctrl+a Delete sleep 1 key Ctrl+Shift+v sleep 2") + + (kill-new (emacsconf-publish-video-description talk t)) + (shell-command "xdotool mousemove 474 632 click 1 sleep 1 key Ctrl+a sleep 1 key Delete sleep 1 key Ctrl+Shift+v")) + (read-string "Press a key once you've pasted in the description") + + ;; next + (when (emacsconf-captions-edited-p (expand-file-name (concat (plist-get talk :video-slug) "--main.vtt") emacsconf-cache-dir)) + (shell-command "xdotool mousemove 352 285 click 1 sleep 1") + + ;; add captions + (shell-command "xdotool mousemove 877 474 click 1 sleep 3") + (shell-command "xdotool mousemove 165 408 click 1 sleep 1") + (shell-command "xdotool mousemove 633 740 click 1 sleep 2") + (shell-command (concat "xdotool mousemove 914 755 click 1 sleep 4 type " + (shell-quote-argument (concat (plist-get talk :video-slug) "--main.vtt")))) + (read-string "Press a key once you've loaded the VTT") + (shell-command "xdotool mousemove 910 1037 sleep 1 click 1 sleep 4") + ;; done + (shell-command "xdotool mousemove 890 297 click 1 sleep 3") + ) + + + (progn + ;; visibility + (shell-command "xdotool mousemove 810 303 click 1 sleep 2") + ;; public + (shell-command "xdotool mousemove 119 614 click 1 sleep 2") + ;; copy + (shell-command "xdotool mousemove 882 669 click 1 sleep 1") + ;; done + (shell-command "xdotool mousemove 908 1089 click 1 sleep 5 key Alt+Tab") + + (emacsconf-with-talk-heading talk + (org-entry-put (point) "YOUTUBE_URL" (read-string "URL: ")) + )) + ) + + ;; (shell-command "xdotool mousemove 165 408 click 1 sleep 1") + ;; (shell-command "xdotool mousemove 2312 1483 click 1 sleep 1") + ;; ;; schedule + ;; (shell-command "xdotool mousemove 1527 752 click 1") + ;; (message "%s" (format-time-string "%Y-%m-%d %I:%M %p" (plist-get talk :start-time) + ;; emacsconf-timezone)))) + ;; ;; (shell-command (concat "xdotool mousemove 1695 611 click 1 key Shift+PgDn Ctrl+a Del type " + ;; ;; (format-time-string "%I:%M %p" + ;; ;; (plist-get talk :start-time) + ;; ;; emacsconf-timezone))) + ;; ;; copy link + + ;; (progn + ;; (shell-command "xdotool mousemove 2284 668 click 1 sleep 1 click 1") + ;; ;; schedule + ;; (shell-command "xdotool mousemove 2324 1498 click 1 sleep 3") + + ;; ;; close + ;; (shell-command "xdotool mousemove 2100 996 click 1") + ;; ) + + +### DONE upload the rest of the files onto Toobnix + + +### TODO Upload more Toobnix and YouTube talks + + +<a id="dry-run"></a> + +## DONE Do another run + +Summary: + +- bandali will stream from his computer; confirmed can stream to dev +- corwin will probably connect to gen by VNC; confirmed can connect to VNC and click around, need to become more familiar with setup after trip +- sachac will be backup streamer if bandali or corwin are unavailable + +Goals: + +- Good: Streamers are set up to broadcast from their own OBS if needed (could be a backup plan, could be the main plan) +- Better: Streamers can connect to the VNC session for their track, manage OBS, start videos (with overlays), and browse the Q&A links +- Best: Streamers can connect via emacsclient in orga@res.emacsconf.org, manage the task status, and have everything working + +Agenda: + +- Get familiar with the setup +- Consider whether we want to prioritize local OBS (more screen real estate) or stream OBS (easier swapping, can be controlled remotely) +- Consider whether we want mumble to be able to quickly add audio; how do we want to set it up scene-wise? + + +### Checklist for later dry run + +1. Streams + - [ ] General stream + - [ ] Development stream + - [ ] 480p streams +2. Scenes + - [ ] Intro + - [ ] Prerec + - [ ] Q&A: live + - [ ] Q&A: IRC + - [ ] Q&A: pad +3. [ ] IRC channels + - [ ] Announce + - [ ] Question handling + - [ ] Timers +4. [ ] Watching pages + - [ ] Before launch + - [ ] Streaming + - [ ] Emergency announcement +5. [ ] Pads +6. [ ] Wiki + - [ ] Schedule update + - [ ] Message on the schedule + - [ ] Prerec live +7. [ ] Wind everything down + +Later on + +- [ ] Toobnix stream +- [ ] YouTube stream + + +### Create test + +gst-launch-1.0 compositor name=mix sink\_1::xpos=1180 sink\_1::ypos=470 ! videoconvert ! autovideosink filesrc location=community-title.svg ! rsvgdec ! imagefreeze num\_buffers=100 ! mix. videotestsrc ! video/x-raw,width=400,height=300 ! mix. audiotestsrc freq ! autoaudiosink + +gst-launch-1.0 compositor name=mix sink\_1::xpos=1200 sink\_1::ypos=600 ! videoconvert ! autovideosink \\ +filesrc location=community-title.svg ! rsvgdec ! imagefreeze num\_buffers=100 ! mix. \\ +filesrc location=background.opus ! oggdemux ! opusdec ! audioconvert ! audioresample ! mix. +videotestsrc ! video/x-raw,width=400,height=300,framerate=25/1 num\_buffers=(25 \* (4 \* 60 + 5)) ! mix. + +gst-launch-1.0 webmmux name=mux ! filesink location=community.webm \\ +compositor name=mix sink\_1::xpos=1200 sink\_1::ypos=600 ! videoconvert ! vp8enc ! queue ! mux.video\_0 \\ +filesrc location=community-title.svg ! rsvgdec ! imagefreeze num\_buffers=2450 ! mix. \\ +filesrc location=background.opus ! oggdemux ! opusdec ! audioconvert ! audioresample ! vorbisenc ! queue ! mux.audio\_0 \\ +videotestsrc num\_buffers=2450 ! video/x-raw,width=400,height=300,framerate=10/1 ! mix. + +1251,/home/sacha/proj/emacsconf/private/assets/titles% find -name community-title.svg -exec inkscape –export-type=png –export-width=1280 –export-height=720 –export-background-opacity=0 {} \\; + + +### DONE Do mini dry run + + +#### DONE Revisit OBS and streaming setup to prepare for the dry run next weekend + + +#### DONE Make mini dry run hyperlist with buttons + +- hh:mm slug + - hyperlist note + - set talk playing + - play intro + - play talk + - set talk closed q + - join bbb + - set talk open q + - set talk to archive + +(emacsconf-hyperlist-show-streamer-day “2022-12-03”) +(emacsconf-hyperlist-show-streamer-day “2022-12-04”) + +Testing: + +<table> + + +<colgroup> +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> +</colgroup> +<tbody> +<tr> +<td class="org-left"> </td> +<td class="org-left">intro</td> +<td class="org-left">talk</td> +<td class="org-left">Q&A</td> +<td class="org-left">Expected</td> +</tr> + + +<tr> +<td class="org-left">journalism</td> +<td class="org-left">recorded</td> +<td class="org-left">live</td> +<td class="org-left"> </td> +<td class="org-left"> </td> +</tr> + + +<tr> +<td class="org-left">school</td> +<td class="org-left">recorded</td> +<td class="org-left">recorded</td> +<td class="org-left">IRC</td> +<td class="org-left"> </td> +</tr> + + +<tr> +<td class="org-left">handwritten</td> +<td class="org-left">recorded</td> +<td class="org-left">recorded</td> +<td class="org-left">BBB</td> +<td class="org-left"> </td> +</tr> + + +<tr> +<td class="org-left">treesitter</td> +<td class="org-left"> </td> +<td class="org-left"> </td> +<td class="org-left"> </td> +<td class="org-left"> </td> +</tr> + + +<tr> +<td class="org-left">health</td> +<td class="org-left">live</td> +<td class="org-left">recorded</td> +<td class="org-left">BBB</td> +<td class="org-left"> </td> +</tr> + + +<tr> +<td class="org-left">jupyter</td> +<td class="org-left">live</td> +<td class="org-left">live</td> +<td class="org-left">BBB</td> +<td class="org-left"> </td> +</tr> +</tbody> +</table> + +- journalism: recorded intro, recorded talk, live + +(emacsconf-hyperlist-show-streamer-day “2022-12-03” nil +(list “journalism” “school” “treesitter” “handwritten” “health” “jupyter”)) + + +### DONE Do a dry run for the dry run + + +<a id="upload-off"></a> + +## TODO Turn off file upload service on media.emacsconf.org :sachac:infra: + +so that nginx can have more memory and we don’t risk slowdowns + + +<a id="review"></a> + +## DONE Review notebook for tasks, priorities, and scheduling + + +### TODO Review tasks + + +<a id="mumble"></a> + +## Use Mumble for backchannel coordination and also on-stage + +<span class="timestamp-wrapper"><span class="timestamp">[2022-11-19 Sat] </span></span> sachac: Confirmed that you can join the emacsconf-dev or emacsconf-gen channel if you have access, and you can speak on air in just that channel + + +### DONE Update the Mumble setup :bandali: + +- [X] Add emacsconf-gen and emacsconf-dev channels +- [X] Give the emacsconf-gen and emacsconf-dev users access to them +- [X] Give the other organizers access to emacsconf-gen, emacsconf-dev, and org-private +- [X] Get emacsconf-gen and -dev to join the right channels + + +### DONE E-mail volunteers and help them get on Mumble :bandali: + + +#### Template + +We plan to use Mumble as a virtual walkie-talkie during the conference +so that we can quickly talk to each other as needed. It can also be a +way for us to add our audio to the streams. Please set up your system +as follows: + +1. Install a Mumble client on the device you want to use to connect to + the voice channel. It can be your computer or phone. You can choose + the username that you would like to log in with. +2. Create and backup your certificate. (This is part of the wizard for + the desktop client, and it might be automatic on a phone client.) +3. Connect to mumble.emacsconf.org with your desired username. +4. Register your account on the server using the `Self > Register` + command. This reserves your username using your certificate and + allows me to add you to ACLs. +5. Let me know (sachac on #emacsconf-org in IRC or + sacha@sachachua.com) when you’ve registered so that I can add you + to the access control lists for the private channels. If I’m around + on mumble (sachac), you can say hi to me there and confirm that + it’s working. + +You can enter a channel by double-clicking on it. (On Mumla for +Android, entering a channel is instead done by clicking on the arrow +to the right of the channel.) Then your audio will go to that channel, +and you can hear audio from that channel. We can use the +`emacsconf-gen` and `emacsconf-dev` channels to speak on air, and we +can use the `backstage` channel for coordination. + +Looking forward to hearing from you! + +Sacha + + +### DONE Generate certificates, add them to conf.org, and register the users :sachac: + + +### DONE Set up Mumble and bring the volunteers on board + +<table> + + +<colgroup> +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> +</colgroup> +<thead> +<tr> +<th scope="col" class="org-left"> </th> +<th scope="col" class="org-left">Emailed</th> +<th scope="col" class="org-left">Onboarded</th> +</tr> +</thead> + +<tbody> +<tr> +<td class="org-left">FlowyCoder</td> +<td class="org-left">X</td> +<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-11-19 Sat] </span></span> access granted, briefed</td> +</tr> + + +<tr> +<td class="org-left">jman</td> +<td class="org-left">X</td> +<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-11-21 Mon] </span></span> access granted, briefed</td> +</tr> + + +<tr> +<td class="org-left">vetrivln</td> +<td class="org-left">X</td> +<td class="org-left"><span class="timestamp-wrapper"><span class="timestamp">[2022-11-19 Sat] </span></span> access granted, briefed</td> +</tr> +</tbody> +</table> -### TODO corwin: document such that someone else could use/fix it :corwin: +### DONE set up Mumble channels for host-dev and host-gen? -### TODO corwin: recruit at least one more person to help operate the "video bouncer" :corwin: +zaeph wants to make it easy to talk to the host without distracting them all the time -## TODO Work on the OBS scenes :zaeph:corwin: +### DONE add dry-run check of whispering to hosts + + +<a id="satellite"></a> + +## Satellite events + + +### Zurich + + +#### DONE Link to satellite events on the wiki :bandali: + +<https://200ok.ch/posts/2022-11-01_emacsconf__with_a_new_physical_venue.html> + +on the watch page + + +#### DONE announce on the emacsconf-discuss mailing list :bandali: + + +<a id="volunteer-2022-11-14"></a> + +## Volunteer update + +- talk banners, akshay + + +<a id="hyperlist"></a> + +## Make a linear hyperlist for managing EmacsConf :sachac: + +Goal: + +- Volunteers should be able to coordinate everything by stepping through a linear list of things to do +- The hyperlist will primarily live on orga@res.emacsconf.org and be accessed through emacsclient. (Maybe sat.org and sun.org) +- Volunteers should be able to take breaks as needed + +emacsconf-hyperlist-show-streamer-day + +[How do we want to coordinate during the conference itself?](#coordination) + + +### DONE Try writing it to an Etherpad + + +### DONE Revisit the hyperlists to make sure they make sense + + +### DONE Add intro notes and specific talk notes to the hyperlist + + +### DONE Make a hyperlist for checking people in for easier copying and pasting + + +### DONE Send FlowyCoder hyperlist for checking people in :mail: + +[Use Mumble for backchannel coordination and also on-stage](file:///home/sacha/proj/emacsconf/wiki/2022/organizers-notebook/index.md) + + +#### DONE make sure live talks are on the checkin list + + +### DONE Make backstage redirects for pad and qa so that hosts and streamers can have an easier time + +ex: +<https://media.emacsconf.org/2022/backstage/current/pad/journalism> +<https://media.emacsconf.org/2022/backstage/current/room/journalism> + +Pattern: +<https://media.emacsconf.org/2022/backstage/current/slug/pad> +<https://media.emacsconf.org/2022/backstage/current/slug/room> +<https://media.emacsconf.org/2022/backstage/current/pad/slug> +<https://media.emacsconf.org/2022/backstage/current/room/slug> + + +### CANCELLED Regenerate hyperlist if sched changes + + +### CANCELLED Put shell commands on a separate line so they’re easy to select and run + + +### DONE Make a hyperlist for hosts + + +### DONE Update etherpad hyperlist + + +### DONE Adjust audio levels from hyperlist + + +### TODO Adjust audio levels from hyperlist with a repeat-mode keymap + + +### DONE Link pamix to a konsole ssh + + +### DONE Add monitoring the streams to the hyperlist / shortcuts + + +### TODO Test hyperlist on obs and record quick demos + + +<a id="rec-intro"></a> + +## TODO Record intro/outro for day-1 and day-2 :zaeph: + +- Opening remarks Sat + - Welcome to EmacsConf 2022 + - What’s new at EmacsConf? + - This year, we have two tracks: General and Development. + - Prerecorded videos will be published as soon as possible (aiming + for publishing them as the talks stream), so you can check the + talk page for the video and the transcript a few minutes after the + talk starts. + - How to participate + - You can watch at live.emacsconf.org using free and open source software. + - Select the stream you’re interested in. + - There are quick shortcuts on the watch page so that you can + open the Etherpad, Q&A, or IRC. + - We recommend adding notes asking questions in the Etherpad + for the talk. That way, it’s easier to organize the + questions and answers, and the host can read questions out + to the speaker as needed. + - You can also use the track-specific IRC channels + (#emacsconf-gen and #emacsconf-dev). + - You can look at the schedule to see what else is going on. + - IRC: + - You can use #emacsconf for hallway conversations. + - If you need to reach conference organizers, you can use the + \#emacsconf-org IRC channel or e-mail sacha@sachachua.com . + - General feedback in pad.emacsconf.org/2022 + - Accessibility + - Streaming with open captions thanks to speakers and volunteers + - Talks indicated with “captioned” on the schedule + - Transcript available on talk pages + - Encourage people to add notes, questions, and answers to the + Etherpad, which will be archived as plain text on the talk + pages after the conference + - If you need additional support, ask in #emacsconf-accessible or #emacsconf-org +- Closing remarks Sat + - Thanks + - Thank you to all the speakers and participants. + - This year’s conference will be hosted by zaeph, bandali, and + vetrivln, and streamed by corwin, bandali, and jman. + - Thanks to our captioning volunteers: sachac, bhavin192, Tom + Purl, Hannah Miller, triko, and anush, and also to the speakers + who captioned their own talks. Thanks to quiliro for translating + the meetups talk into Spanish. and to Akshay Gaikwad for + contributing some designs. + - Thanks to the Free Software Foundation for the mailing + lists. Thanks to Ry P for the server that we’re using for OBS + streaming and for processing videos. + - Come back tomorrow +- Closing remarks Sun + - Thanks + - + + +### DONE Review opening remarks from last year + +<https://emacsconf.org/2021/talks/day1-open/> + + +<a id="link-pages"></a> + +## TODO Add category tags and possibly links between talks across 2022 and all previous years :quiliro:wiki: + +- Prerequisite: Can edit wiki pages (<https://emacsconf.org/edit/>) +- Goal: Make it easier for people to discover interesting related talks + +- List of talks for EmacsConf 2022: <https://emacsconf.org/talks/> +- List of talks: <https://emacsconf.org/talks/> +- List of categories: <https://emacsconf.org/CategoryCategory/> +- To add something to a category, add `\[[!taglink CategoryName]]` to the bottom of its talk page (ex: 2022/talks/maint.md is in CategoryCommunity) +- You can create new categories by making up new CategoryNames. +- You can also link to a talk with a link like this: `\[[/2022/talks/maint|Maintaining the Maintainers: Attribution as an Economic Model for Open Source]]` + You can make a new heading called `# Related talks` + + +<a id="watch-css"></a> + +## TODO JS/CSS enhancement :emacsconf: + + +### TODO Add start and end attributes to the brief stuff for possible JS/CSS + + +### TODO Consider putting the subtitles outside the video <https://stackoverflow.com/questions/61826237/is-there-a-simple-way-to-position-subtitles-below-the-hlml5-video> :emacsconf: + +<file:///home/sacha/sync/orgzly/Inbox.md> + + +### SOMEDAY Make video sticky and move it to the right :js:css:nextyear: + +<https://webdesign.tutsplus.com/tutorials/how-to-create-a-sticky-floating-video-on-page-scroll--cms-28342> + + +<a id="ansible"></a> + +## TODO Build up the ansible playbook :sachac:opal: + +git@git.emacsconf.org:pub/emacsconf-ansible + +Goals: + +Playbook will be able to reproduce: + +- [Etherpad](#etherpad): probably okay to deploy on VPS +- web-based file upload: probably in a docker +- publishing environment for schedule etc. + +in prod or docker container + + +### DONE restreamers on live0 + +[Set up stream events on Toobnix and YouTube](#other-streams) + + +### DONE icecast on live0 + +(find-file “/ssh:live|sudo::/etc/icecast2/icecast.xml”) + + +#### DONE Set up watch/gen-480p + + +### DONE publishing environment + + +### DONE Get ansible to run against a clean docker + + +### DONE Set up Etherpad with MySQL + + +### TODO Make the upload ansible configuration controllable via a variable + + +<a id="breakouts"></a> + +## SOMEDAY Consider breakout rooms for lunch break + + +<a id="obs-scenes"></a> + +## CANCELLED Work on the OBS scenes :zaeph:corwin:sachac: - [ ] corwin is out from Nov 11-20, and we should start working on them before then. -## TODO Figure out web-based file upload :needsowner: +<a id="etherpad"></a> -Lesson learned from last year: "Since people kept running into ftp problems, we might want to set up a web-frontend next year to minimise problems." -Maybe we could ask some of the volunteers who wanted to help us with the infra? It shouldn’t be complicated to deploy a ready-made solution. +## INPROGRESS Plan Etherpad use and hosting :sachac:ansible: +- Relevant links: + - Per-pad, nicely structured info with abstract, watching information, etc. CarpentryCon 2022 Schedule • CarpentryCon 2022 <https://2022.carpentrycon.org/> + - One pad per session: <https://meta.wikimedia.org/wiki/Arctic_Knot_Conference_2021/Program#Friday,_June_25th> + - [Etherpad integration in Jitsi ](https://community.jitsi.org/t/tutorial-etherpad-integration-in-jitsi-meetings/99697) -## DONE Prepare to export talk information to wiki :sachac: +- Good: One pad per session +- Better: Some kind of monitoring so that we can link to the pads or embed + the pads even before the conference starts while not risking too + much vandalism +- Best: + - Pad can be easily regenerated from Emacs Lisp with a check to see if people have been adding to it + - Pad links to next talks -Tested code in a fork, can publish talk information once talks are approved. -emacsconf-generate-info-pages -emacsconf-generate-main-schedule -emacsconf-generate-talk-pages +Where should we host this? +- live0: gets scaled up the most, lots of people connect to it for the conference, didn’t hit performance constraints last time +- front0: lower risk of interfering with stream +- bbb: will already be put on strain with the concurrent streams (test showed it was stable with up to 10 concurrent video streams and 40 total participants) +- opal’s: no news from owner, but beefy server that we used for reencode last year +- new Linode (probably 4GB or 8GB shared CPU): can easily be spun up, yay Ansible -## DONE Give access to emacsconf-2022-private to dto :zaeph: +[Ansible notes](#ansible) +Consider if we need extra scaling beyond being on a beefy live0? -## DONE Write better subtitle documentation :sachac: +- Scale calculator: <https://scale.etherpad.org/> + - assuming 3 concurrent authors, 100 lurkers per pad, 3 concurrent pads + - 1 core, 4GB RAM, bandwidth Mb/s: 7.488 +- <https://mclear.co.uk/2021/09/08/deploying-etherpad-at-scale-in-one-minute/> +- <https://github.com/ether/etherpad-load-test> -<https://wiki.debian.org/Teams/DebConf/Video/Subtitles> -<https://emacsconf.org/captioning> -That will help more people subtitle things +Will need to try this again when we resize nodes. Probably just the extra memory will be enough and the CPU use from node won’t step on the streaming, but not sure -## TODO Create Org heading for scheduling caption team's live IRC duty shifts :dto: +### DONE Use the API to create pages based on all the slugs -## DONE Write volunteer page :sachac: +### CANCELLED Figure out monitoring; maybe get everything daily and commit to git repo? -<https://emacsconf.org/2022/volunteer> +History or regeneration will be fine. We’ll probably link to it shortly before the event, and we can also turn off the service until we’re ready. -## TODO Review metadata for speakers in conf.org :zaeph: +### DONE Generate talk-specific pad content -## TODO Do we want to use JS on the wiki? +### DONE Set up nginx reverse proxy -### BLOCKED ?: Figure out JS and CSS niceties that will make organizers-notebook more enjoyable to browse through :css:js: +### DONE Load-test -- TODO/DONE/etc. keyword highlighting? -- Collapsible sections? +tl;dr: Either a separate 4GB Linode or being on live0 will probably be +okay, but I’m not 100% sure due to the limitations of my load-testing +setup. I don’t know if we need to shard by pad. +It looks like etherpad-load-test tends to max out at ~40 connections +on a specific node. I used GNU Parallel to run the loadtesting tool +against a 4GB Linode instance (shared CPU) from five nodes at the same +time (my X220, my 2GB Linode instance, front0, and the node with the +pad), and they all reached about 35-45 clients before failure (not +updating within 100ms). -### BLOCKED ?: Find a way to add JS libraries to the wiki but shield them from anon editing :js: + echo 'node node_modules/etherpad-load-test/app.js http://170.187.195.5:9001 -d 120 > ~/output.txt' | parallel -J loadtest -j 1 --onall --verbose --tag -gitolite should have some options to do this + echo 'grep Local ~/output.txt | tail -1' | parallel -J loadtest -j 1 --onall --tag +Files were created at roughly the same time, so the max loads probably +overlapped. It would be good to have finer control over the +etherpad-load-test tool. Haven’t figured out how to properly use `-l` +and `-a` yet. -### BLOCKED ?: Beautify video players :js:css: + echo 'stat -c %y ~/output.txt' | parallel -J loadtest -j 1 --onall --tag -Might not be necessary. +CPU graph went only up to 5%. Network max was 2.36 Mb/s in, 1.25 Mb/s out. +looking at top, CPU seems to go only up to about 12% or so. -<a id="decisions"></a> +### DONE Set up pad.emacsconf.org to point to live0.emacsconf.org :bandali: + + +### DONE Set up letsencrypt + +Waiting for DNS +add to /etc/dehydrated/domains.txt +sudo sh -x /etc/cron.daily/renew-https-cert-local + + +### DONE Link to pad from talk page + + +### DONE Add links to general conference pad + +for collecting feedback + + +### TODO Prototype shift pads for easier scrolling + +if we can get the anchor plugin + + +### DONE Be able to fall back to wikimedia if necessary, maybe with nginx redirects + + +### DONE Export pad initial content HTML to make it easier to reimport into wikimedia or elsewhere + +`emacsconf-pad-export-initial-content-for-all-talks` + + +### SOMEDAY Cache pad times in a json or el :emacsconf: + + +### DONE Confirm that we can use the time slider to move back in time + + +### TODO Consider monospace font for Etherpad? :nextyear: + + +<a id="writing"></a> + +## TODO Write about EmacsConf behind the scenes :sachac: + + +### TODO Write about scheduling and tracks + + +### TODO Write about scheduling and summing up properties + + +### TODO Write about scheduling and SVG + + +### TODO Write about timers and todo state change hooks -# Things to figure out / decisions to make +### TODO Write about TRAMP and workaround of shifting talks -## What ideas do we want to borrow from other conferences? + +### TODO Write about OBS on VNC + + +### TODO Write about BBB redirects and opening things up + + +### TODO Write about ERC announcements + + +### TODO Write about copying files to backstage + + +### TODO Write about captions + + +### SOMEDAY Write about setup for vnc + + +### SOMEDAY Write about setting org properties from a region, looking at tables, summing it up + + +### SOMEDAY Record animation of changing the schedule + + +### SOMEDAY Write about mail merge + + +### #EmacsConf behind the scenes: Testing the schedule with SVGs + +> Org mode allows you to have inline images, and you can return them as the results of Org Babel +> blocks. I wanted to test different #EmacsConf scheduling strategies quickly. I used Emacs’s XML and +> SVG support to create the SVGs based on the scheduling data I gave it. Splitting my window made it +> easy to change the schedule, use \`C-c C-c\` to execute the block, and see the schedule image +> (including any validation notes) in the other window. The code is in +> <https://git.emacsconf.org/emacsconf-el/tree/emacsconf-schedule.el> . +> +> [Screenshot of how I tested #EmacsConf scheduling strategies using inline images in an Org file](https://emacs.ch/system/media_attachments/files/109/485/992/555/721/586/original/7bf3ab2a89fdcaec.png) + +<https://emacs.ch/@sachac/109486006078029919> + + +### SOMEDAY <https://graz.social/@publicvoit/109496340869869181> + +publicvoit@graz.social - Organizers of online #video #conferences: take a look at the amazing work the organizers of #EmacsConf are doing with the pre- and post-processing of a 9 minute demo #video: <https://emacsconf.org/2022/talks/orgsuperlinks/> + +Subtitles, transcript, (Q&A from the live discussion are following), chapter marks, discussion thread from the #Etherpad used, … + +I only wrote the ’Description’ section and contributed the raw video file. It’s really impressive what @sachac and the other organizers + volunteers are doing here. + + +<a id="maybe-projects"></a> + +# Ideas for next year :nextyear: + + +## Possible talks + + +### SOMEDAY Is eMacs worth using/learning for non programmers? I.e are there non programming applications for it? + +<https://www.reddit.com/r/emacs/comments/107y169/is_emacs_worth_usinglearning_for_non_programmers/> +Interesting comments + + +## SOMEDAY <https://www.reddit.com/r/i3wm/comments/b1hgxm/i3wm_over_vnc_with_dual_monitors/?utm_source=share&utm_medium=android_app&utm_name=androidcss&utm_term=2&utm_content=share_button> might be interesting to have dual monitors next year + + +## SOMEDAY Suggest public submissions next time + +would it be interesting to see if other people can build on what’s submitted? + + +## SOMEDAY Match /names with speakers, maybe make a page with people currently online + + +## SOMEDAY EmacsWiki: Erc Robot + +<https://www.emacswiki.org/emacs/ErcRobot> + +After I get ikiwiki sorted out, I can use Erc to control it so that I can test it a lot before letting it mess with the real thing + +Goals: +Update schedule +Publish prerec when talk is playing + + +### SOMEDAY Irc bot for opening + +notice the message +open the Q&A specified by slug, or look it up from the channel + + +## TODO Consider making a bot to support announcing, updating, publishing, who’s here, announcing when speakers are here + +<https://salsa.debian.org/rhonda/schedulebot> + +- announces: + - $talk will start in $min minutes + - $talk has just begun + - $talk has just finished +- seen + + +## SOMEDAY indentation - CSS - successive indenting of siblings after headings - Stack Overflow + +<https://stackoverflow.com/questions/31872535/css-successive-indenting-of-siblings-after-headings> + + +## SOMEDAY html - Indent everything after h1, h2, etc. before the next, one, while stacking the indents, with CSS - Stack Overflow + +<https://stackoverflow.com/questions/69711847/indent-everything-after-h1-h2-etc-before-the-next-one-while-stacking-the-in> + + +## Video + + +### SOMEDAY infrastructure/source-recording.sh at master · FOSDEM/infrastructure + +<https://github.com/FOSDEM/infrastructure/blob/master/ansible/playbooks/roles/video-bbb/files/scripts/source-recording.sh> + + +### SOMEDAY c3voc/voctomix - Docker Image | Docker Hub + +<https://hub.docker.com/r/c3voc/voctomix/> + + +### SOMEDAY DebConf video team / vogol · GitLab + +<https://salsa.debian.org/debconf-video-team/vogol> + + +### SOMEDAY roles/vogol · master · DebConf video team / ansible · GitLab web interface for voctomix + +<https://salsa.debian.org/debconf-video-team/ansible/-/tree/master/roles/vogol> + + +### SOMEDAY CarlFK/veyepar: Video Eyeball Processor and Review + +<https://github.com/CarlFK/veyepar> + + +### SOMEDAY timvideos/streaming-system: Tim Video’s - Live Streaming for user groups and other events. + +<https://github.com/timvideos/streaming-system> + + +### SOMEDAY <no title> — DebConf Videoteam Ansible documentation + +<https://debconf-video-team.pages.debian.net/ansible/ansible_roles/etherpad.html> + + +### SOMEDAY DebConf video team / ansible · GitLab + +<https://salsa.debian.org/debconf-video-team/ansible> + + +## SOMEDAY handprint · PyPI + +<https://pypi.org/project/handprint/> +That might be interesting for reviewing text recognition output + + +## TODO Update websocket + + +## TODO Idea for next year: save talk details in an org note so that I can easily send e-mails comparing previous with current + +<file:///home/sacha/proj/emacsconf/wiki/2022/speakers.md> + + +## DONE What ideas do we want to borrow from other conferences? - FOSDEM had a conference track - <https://archive.fosdem.org/2022/schedule/track/conference_organisation/> - DebConf - Thorough documentation at <https://debconf-video-team.pages.debian.net/docs/> - <https://debconf-video-team.pages.debian.net/docs/online_volunteer_roles.html> + - Ansible: <https://salsa.debian.org/debconf-video-team/ansible> , <https://debconf-video-team.pages.debian.net/ansible> - SReview for cutting videos? - <https://wiki.debian.org/Teams/DebConf/Video/Subtitles> - Pentabarf <https://lists.debian.org/debconf-team/2008/08/msg00147.html> - + - Schedule shows local time and DebConf time: <https://debconf21.debconf.org/schedule/> - LibrePlanet <https://libreplanet.org/2022/> + - libreadventure, minetest? + + - <https://www.collabmagazine.com/organizing-a-multi-track-virtual-conference-with-microsoft-teams-live-events-a-technical-playbook-and-lessons-learned/> : 4-person team, post-prod, break commercials -## Do we want to make the ikiwiki web-editable? +### SOMEDAY virtual-conf-resources/foss-north.md at master · e8johan/virtual-conf-resources -Pain points: +<https://github.com/e8johan/virtual-conf-resources/blob/master/foss-north.md> -- Speakers usually ended up going through us -Options: +### SOMEDAY e8johan/virtual-conf-resources: Resources for virtual conferences + +<https://github.com/e8johan/virtual-conf-resources> + + +## TODO Consider hosting reveal.js for EmacsConf + + +## TODO back up media and bbb + + +## TODO figure out how zaeph can run ansible + + +## TODO Check that the restreams can handle hiccups + +<https://toobnix.org/w/dmibQFkBTNcJyTVVQTyd5C> + +ugh might need to restart restreams +PTS 233286211, next:63716000 invalid dropping st:0 +DTS 233286223, next:63828674 st:1 invalid dropping + +screen -S restream-test-toobnix -X quit; screen-restream-test-toobnix.sh +screen -S restream-test-youtube -X quit; screen-restream-test-youtube.sh +screen -S restream-gen-toobnix -X quit; screen-restream-gen-toobnix.sh +screen -S restream-gen-youtube -X quit; screen-restream-gen-youtube.sh +screen -S restream-dev-toobnix -X quit; screen-restream-dev-toobnix.sh +screen -S restream-dev-youtube -X quit; screen-restream-dev-youtube.sh + +ugh sound timestamps get all messed up + + +## TODO Figure out how to have a test talk for publishing + + +## TODO figure out back button + +<bandali> hmm, for some reason with firefox the back button doesn’t seem to + work as expected on after clicking on one of the tracks on + live.emacsconf.org [21:44] +<bandali> seems like there’s an additional redirect or something. doesn’t + matter too much tho [21:45] + + +## TODO Erc bot so bandali and zaeph can check time remaining + + +## TODO make hotkeys for kicking the 480p streams + + +## SOMEDAY Add timezones to all schedules + + +## SOMEDAY <https://social.coop/@jotaemei/109456544613400591> + +jotaemei@social.coop - This year’s #Emacs Conference is taking place right now; its official website is naturally RMS/FSF/MIT flavored. The video feed is not working on my mobile phone browser. So, the alternative instructions are to open a link in MPV (will VLC work?) on a desktop. The event times that are given in the schedule do not display a timezone. And presentation notes and collection of audience questions are provided via Etherpad. 😆 I hope the recordings will be available. ☺️ <https://emacsconf.org/2022/watch/dev/> + + +## SOMEDAY Consider idle timer for wiki publishing the wiki, at for running things + + +## SOMEDAY Re: How to avoid the user triggering “Forbidden reentrant call of Tramp” + +<https://lists.gnu.org/archive/html/tramp-devel/2021-04/msg00036.html> + + +## TODO Make it easier to ship a last-minute update + +1. Upload file to backstage +2. make all +3. Copy to orga@res:~/stream +4. Sync it to orga@res:~/cache + + +## SOMEDAY Add timezone note above every schedule table + + +## TODO Braindump things that worked well and things I’m looking forward to tweaking + + +## TODO Incorporate zaeph’s braindump + + +## SOMEDAY <https://social.coop/@jotaemei/109468491432592197> + +jotaemei@social.coop - @sachac I like this idea of a timezone converter for people displayed on (or by) the listing. For me, the cause was that I was trying to find my way around the site at the last second and was afraid I’d missed a presentation I saw someone post earlier about coming up, but I think it was just that the speakers were running a little behind schedule. + + +## SOMEDAY Add export/txt to the pad announcements next year - dto + + +## TODO Learn from other conferences + + +### Neovimconf + + +### SOMEDAY Normconf: The Normcore Tech Conference + +<https://normconf.com/> + + +## SOMEDAY Look into properly streaming to YouTube, Toobnix, and 480p -- Web-editable: - - Speakers and general public will be able to edit it more easily -- Git: (current) - - Haven't had a problem with spam - - Reduces merge conflict potential +## TODO Consider practising with ffmpeg in the cloud so that we can handle last-minute submissions + +<https://cloud.google.com/functions/docs/console-quickstart-1st-gen> +<https://aws.amazon.com/marketplace/pp/prodview-ixe3igo3gsu24#pdp-pricing> +or a VM + + +### TODO <https://github.com/tuomastik/ffmpeg-google-cloud> + +<https://cloud.google.com/functions/docs/console-quickstart-1st-gen> + + +### SOMEDAY Investigate bacalhau compute over data + + +### SOMEDAY Using video transcoding on Amazon ECS - Amazon Elastic Container Service + +<https://docs.aws.amazon.com/AmazonECS/latest/developerguide/ecs-vt1.html> + + +## SOMEDAY Add timer for 5 minute and 2 minute warnings to go to emacsconf-org + + +## TODO make the Org agenda versions more visible + + +## SOMEDAY Explore idea of OBS virtual webcam showing the question vs screenshare + + +## SOMEDAY Ideas for people to reach out to for talks? + + +### Using emacs mail to prefilter mail + +<https://www.reddit.com/r/emacs/comments/zp0qn6/a_tragic_story_of_emacs_lover/j0r7i1f/> + + +## SOMEDAY Check ffmpeg benchmarks and recommendations; can we speed up our encoding for last-minute submissions? + + +### SOMEDAY <https://www.reddit.com/r/AV1/comments/k7colv/encoder_tuning_part_1_tuning_libvpxvp9_be_more/?utm_source=share&utm_medium=android_app&utm_name=androidcss&utm_term=2&utm_content=share_button> + + +## TODO <https://owncast.online/faq/> + +instead of Icecast? uses RTMP + + +## STARTED Jingle + +[02:38] <dto> tweaked it <https://usercontent.irccloud-cdn.com/file/akHATPq3/emacsconf.ogg> + + +<a id="decisions"></a> + +# Things to figure out / decisions to make + +- [Do we want to drop talks?](#drop) +- [How do we want to coordinate during the conference itself?](#coordination) +- [How do we want to make the full schedule more manageable?](#sched-decision) +- [Do we want to skip the closed Q&A and go straight to open?](#closed) +- [How much do we want to enrich the wiki with JS?](#wiki-design) +- [How do we want to make better use of Etherpad?](#pad-decision) +- [Can we nudge people to ask IRC questions in a way that will make it easier for us to follow them?](#irc-markers) +- [Do we want people to advertise any openings with their companies or any work that they’re looking for?](#advertising) +- [Decision archive](#decision-archive) +- [Think about what to do with schedule gaps due to cancelled talks](#schedule-gaps):thoughts: +- [Split rms into two talks?](#rmstedsplit) + + +<a id="drop"></a> + +## Do we want to drop talks? + +- **Keep the slot open, allow people to speak live** + - If they don’t show up, continue with previous Q&A or have an open room + + +<a id="coordination"></a> + +## How do we want to coordinate during the conference itself? + +- Considerations: + - Good to have something that the hosts and streamers can walk through step by step + - Do we want the check-in volunteer to also keep something + - Announcing and publishing are easier if the task states are updated + +- Mumble for walkie-talkie communications? + - Can we keep it off the stream more reliably, but still be able to choose to put it on the stream? + - We can keep it in the combined sink and then manually go to that + channel in our clients when we want to talk on stream + - Should we have a Gen channel and a Dev channel so that we can choose to speak into ? +- Checklist + - Etherpad + - All the volunteers can access it easily + - Tasks can be updated through SSH commands + - conf.org + - Run Emacs commands directly from it + - A little trickier in terms of access + + +<a id="sched-decision"></a> + +## How do we want to make the full schedule more manageable? + +Host role: + +- Give the speaker a heads-up before their Q&A session begins +- If needed, read the questions from the pad to the speaker (Many speakers are comfortable reading the pad on their own.) +- Give the speaker time warnings before the end of their Q&A session on the stream. Interested participants can continue + +Streamer role: + +- Switch between playing the prerec and joining the Q&A session +- Adjust audio volume at the beginning of the Q&A session +- (optional) Switch scene layouts to focus on different things + +Shifts will be Sat AM, Sat PM, Sun AM, or Sun PM per track. People can take multiple shifts. + +<https://emacsconf.org/2022/decisions/#schedule> + +- Figure out how hosting can be done in shifts + - Add notes in one place +- Figure out how streaming can be done in shifts: OBS in the cloud? + - [Investigate streaming options, maybe OBS in the cloud](#streaming) +- Figure out how publishing can be done in shifts + - Console Emacs in a VM with everything set up for publishing to the wiki + +<span class="timestamp-wrapper"><span class="timestamp">[2022-10-04 Tue]</span></span> + +- Added option H: general starts with general Org use cases and moves on to more niche things on day 2. + - compared to A, general audience will be more interested in Org use + cases than in Hyperbole, and then we can look at specific + techniques on day 2 + +<span class="timestamp-wrapper"><span class="timestamp">[2022-10-04 Tue]</span></span> + +- Discussed option G with zaeph on #emacsconf-org. zaeph prefers + option A over option G because it gives people more choices - + they can hop from talk to talk. + +<span class="timestamp-wrapper"><span class="timestamp">[2022-10-03 Mon]</span></span> + +- Discussed with bandali and zaeph on #emacsconf-org +- Decided on Option A with B, C, or F as fallbacks depending on volunteer roster +- Better for the viewers and the volunteers + + +<a id="closed"></a> + +## Do we want to skip the closed Q&A and go straight to open? + +- Closed: Less moderation needed in the beginning +- Open: less coordination needed (since the host doesn’t have to either tell me that it’s okay to open it up or change the task status themselves), and people are generally good at meeting etiquette + + +<a id="wiki-design"></a> + +## How much do we want to enrich the wiki with JS? + +Ideas to consider: + +- Toggling local time display on the schedule +- Making organizers-notebook nicer to browse through (or maybe use organice?) +- Improve the video player (resolution switching? chapter markers?) - <https://github.com/sampotts/plyr> for video? + + +### SOMEDAY ?: Figure out JS and CSS niceties that will make organizers-notebook more enjoyable to browse through :css:js: + +- TODO/DONE/etc. keyword highlighting? +- Collapsible sections? + + +### SOMEDAY ?: Find a way to add JS libraries to the wiki but shield them from anon editing :js: + +gitolite should have some options to do this + + +### SOMEDAY ?: Beautify video players :js:css: + +Might not be necessary. + + +<a id="pad-decision"></a> ## How do we want to make better use of Etherpad? @@ -297,30 +2998,16 @@ Options: - Embed the IRC channel instead -## Shall we put a generic e-mail address for sending feedback, maybe with different mailtos? - -Pain points: - -- Many talk pages don't have public e-mail addresses, so it takes a - little extra work (or is sometimes impossible) for people to follow - up if they have questions - -Options: - -- Do nothing (current) -- Add a mailto link to emacsconf-discuss that prepopulates the subject -- Add a mailto link to emacsconf-org - - Wider discussion -- Add a mailto to emacsconf-org-private - - Private feedback that can be forwarded to the speaker - +<a id="irc-markers"></a> ## Can we nudge people to ask IRC questions in a way that will make it easier for us to follow them? +Two tracks mean two IRC channels with lots of space for Q&A, so this may become less of an issue + Pain points: - Q&A/discussions often overlap with the next talks -- Sometimes questions don't get copied to the pad +- Sometimes questions don’t get copied to the pad - Fast discussions can get overwhelming Ideas: @@ -339,29 +3026,17 @@ Ideas: - Maybe a volunteer can have an ERC command that copies a question into a buffer, or even into the Etherpad -## How many BBB rooms do we want to set up? - -- One per talk - - We can send speakers a direct link to their room and they can check into it themselves - - Needs a little more work when setting up rooms and when extracting videos - - Easier for the host to join - - Check-in person can just keep an ear open in that room -- Five or so, rotating among them - - Check-in person directs the speaker to the next available room - - Worked fine last time +<a id="advertising"></a> +## Do we want people to advertise any openings with their companies or any work that they’re looking for? -## Do we want to do alt-stream the same way again this year? +- Speakers on their page? +- General audience on a wiki page somewhere? -- Alt stream joins the current session and then continues with it until the Q&A finishes; people join the BBB room if they want to ask questions - - Nice and convivial, Q&A still gets captured - - Inertia means most people get the main message -- Multiple streams with more space between talks, people choose which stream they want to watch - - How other conferences do it - - Speakers can attend related talks more easily +<a id="decision-archive"></a> -## Archive +## Decision archive ### Where should volunteers e-mail? @@ -374,18 +3049,157 @@ Ideas: - If you’re thinking about the enticement factor of having people volunteer publicly, we’ll still have a well-furnished list of people helping us run the conf somewhere on the wiki. [11:22] - - i would think if someone doesn't want to do it publicly, they could + - i would think if someone doesn’t want to do it publicly, they could opt to write to -org-private instead, but otherwise the defacto should be public (-org) - i just think most folks would want to do this publicly unless for specific reasons, rather than the other way around +### CANCELLED Do we want to do alt-stream the same way again this year? + +Superseded by decision to have multiple tracks + +- Alt stream joins the current session and then continues with it until the Q&A finishes; people join the BBB room if they want to ask questions + - Nice and convivial, Q&A still gets captured + - Inertia means most people get the main message +- Multiple streams with more space between talks, people choose which stream they want to watch + - How other conferences do it + - Speakers can attend related talks more easily + + +### DONE Shall we put a generic e-mail address for sending feedback, maybe with different mailtos? + +Pain points: + +- Many talk pages don’t have public e-mail addresses, so it takes a + little extra work (or is sometimes impossible) for people to follow + up if they have questions + +Options: + +- Do nothing (current) +- Add a mailto link to emacsconf-discuss that prepopulates the subject +- Add a mailto link to emacsconf-org + - Wider discussion +- **Add a mailto to emacsconf-org-private** + - Private feedback that can be forwarded to the speaker + + +### DONE How many BBB rooms do we want to set up? + +- One per talk + - We can send speakers a direct link to their room and they can check into it themselves + - Needs a little more work when setting up rooms and when extracting videos + - Easier for the host to join + - Check-in person can just keep an ear open in that room +- Five or so, rotating among them + - Check-in person directs the speaker to the next available room + - Worked fine last time + + +### DONE How easy do we want to make it to join the BBB session? + +Considerations: + +- It’s easier for the checkin person to deal with only the speaker +- We may not want people to join the Q&A session at the beginning +- We want to make it easy for people to join the Q&A session eventually + +Options: + +- PROBABLY EASIEST: Set it to anyone can join, but the meeting needs to be started by a + moderator. Start the meeting on the day of the talk. Announce the + BBB URL in the pad, IRC channel, and on the talk page when the host + is ready. Maybe add a rewrite rule when the host is ready. +- Set an access code. Announce the access code when the host is ready. + - Access codes are annoying to copy and paste. + - Access codes might get accidentally unset or regenerated. +- Set room so that moderators have to approve waiting users. + - Check-in has to watch out for waiting speaker. + - Host sets it to accept everyone who’s waiting when the host is ready. + - Changing it to turn the option off doesn’t seem to affect an + ongoing meeting, even though the web interface says you should be + able to change the setting any time. + - Waiting users don’t make the user notification go ding. + +Change talk status to OPEN\_Q or UNSTREAMED\_Q, and change to TO\_ARCHIVE when done. +M-x emacsconf-publish-bbb-redirect to update the redirect for a single talk +M-x emacsconf-publish-bbb-redirect-all updates all the redirects + + +#### DONE Add nginx redirect from emacsconf.org + +/ssh:front|sudo::/etc/nginx/sites-available/emacsconf.org + + +### DONE How do we want to name the BBB rooms? + +Needs to be easy to: + +- share all the BBB rooms for a particular shift with the check-in volunteer +- start the BBB rooms for the morning +- match up the recordings with the talks afterwards +- find the BBB room for a talk or speaker +- remove all the BBB rooms for the year + +ec22-sat-am-dev Speaker Name (slugs) + + +### SOMEDAY Do we want to make the ikiwiki web-editable? + +Pain points: + +- Speakers usually ended up going through us + +Options: + +- Web-editable: + - Speakers and general public will be able to edit it more easily +- Git: (current) + - Haven’t had a problem with spam + - Reduces merge conflict potential + + +<a id="schedule-gaps"></a> + +## TODO Think about what to do with schedule gaps due to cancelled talks :thoughts: + +- if the previous Q&A is still going, we can stream that one +- if there are no previous Q&As running, options: + - just leave it on the in-between slide: no extra effort required + - host a breakout room in [ec22-open](https://media.emacsconf.org/current/bbb-open.html): gives people someplaco to go, might lead to interesting conversatinos +- big gaps: consider: + - substitute talk + - rearrange conference schedule + - just show the IRC + - replay talks from previous years + + +### SOMEDAY Consider fillers covering conference stuff :thoughts: + + +<a id="rmstedsplit"></a> + +## CANCELLED Split rms into two talks? + +- Split into a separate talk: + - Can more easily have intros + - Can post the transcript to the talk page +- Same talk, stream files: + - Might as well learn how to do that anyway + + +### DONE Figure out what to do about rms sequence + +Keep it at one talk, but figure out stream files thing + + <a id="roles"></a> # Roles needed -Each role comprises different responsibilities. A person may have multiple roles. An organizer might take the lead for a role, but if you want to volunteer, speak up and they'll probably be glad to share the load. +Each role comprises different responsibilities. A person may have multiple roles. An organizer might take the lead for a role, but if you want to volunteer, speak up and they’ll probably be glad to share the load. Some roles are also described on the <https://emacsconf.org/2022/volunteer> page. If you want to encourage people to volunteer to help, add a role description there. @@ -403,7 +3217,7 @@ The roles below are related to the proposals in the early stages of the preparat - Listener - Receive emails from emacsconf-submit - Ensure that candidates are sticking to the prescribed format (esp. the 10/20/40 duration rule) - - Respond to people's requests and suggestions, pulling in other people to help as needed + - Respond to people’s requests and suggestions, pulling in other people to help as needed - Publisher (PUB: sachac) - Set up the wiki page - Infrastructure @@ -414,6 +3228,11 @@ The roles below are related to the proposals in the early stages of the preparat ## When speakers have submitted their pre-recorded videos +- Copy to backstage as –original.webm and –main.webm using M-x emacsconf-upload-copy-from-json +- Copy to res /data/emacsconf/2022 +- Start /data/emacsconf/2022/process-captions.py if it’s not already running +- Use ~zaeph/scripts/reencode.sh on the file as well + - Video processor (zaeph) - Standardize and compress uploaded videos - Caption lead (sachac) @@ -449,12 +3268,12 @@ The roles below are related to the proposals in the early stages of the preparat - Get them into the correct room and help them doublecheck their audio and video quality - Troubleshoot as needed - Notify host about next room to join - - Follow up with speakers who haven't checked in yet - - Check on speakers periodically so that they're not waiting alone + - Follow up with speakers who haven’t checked in yet + - Check on speakers periodically so that they’re not waiting alone - Questions - Copy questions from IRC and the pad to wherever the host and speaker are looking - Pad scribe - - Organize and format people's contributions + - Organize and format people’s contributions - Add notes about links, key points, questions, answers - Accessibility (ACCESS: dto) - Describe visuals in #emacsconf-accessible @@ -468,6 +3287,220 @@ The roles below are related to the proposals in the early stages of the preparat - Nice to have: Update the schedule to reflect changes throughout the day +<a id="shifts"></a> + +### Shifts + +<a name="shifts"></a> + +AM: 9-12 PM EST, PM: 1-5 PM EST (plus a little extra for setup/transition) + +Saturday Dec 3 + +<table id="org4d51b24"> + + +<colgroup> +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> +</colgroup> +<thead> +<tr> +<th scope="col" class="org-left"> </th> +<th scope="col" class="org-left">Host</th> +<th scope="col" class="org-left">Streamer</th> +<th scope="col" class="org-left">Checkin</th> +<th scope="col" class="org-left">IRC</th> +<th scope="col" class="org-left">Pad</th> +<th scope="col" class="org-left">Coord</th> +</tr> +</thead> + +<tbody> +<tr> +<td class="org-left">Gen AM</td> +<td class="org-left">zaeph</td> +<td class="org-left">sachac</td> +<td class="org-left">corwin</td> +<td class="org-left">dto</td> +<td class="org-left">publicvoit</td> +<td class="org-left">sachac</td> +</tr> + + +<tr> +<td class="org-left">Gen PM</td> +<td class="org-left">zaeph</td> +<td class="org-left">sachac</td> +<td class="org-left">FlowyCoder</td> +<td class="org-left">bandali</td> +<td class="org-left">publicvoit</td> +<td class="org-left">sachac</td> +</tr> + + +<tr> +<td class="org-left">Dev AM</td> +<td class="org-left">bandali</td> +<td class="org-left">sachac</td> +<td class="org-left">corwin</td> +<td class="org-left">dto</td> +<td class="org-left"> </td> +<td class="org-left">sachac</td> +</tr> + + +<tr> +<td class="org-left">Dev PM</td> +<td class="org-left">bandali</td> +<td class="org-left">sachac</td> +<td class="org-left">FlowyCoder</td> +<td class="org-left">bandali</td> +<td class="org-left"> </td> +<td class="org-left">sachac</td> +</tr> +</tbody> +</table> + +publicvoit - pad until 4pm on Sat, until 2pm on Sun + +Sunday Dec 4 + +<table id="org9b01a39"> + + +<colgroup> +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> +</colgroup> +<thead> +<tr> +<th scope="col" class="org-left"> </th> +<th scope="col" class="org-left">Host</th> +<th scope="col" class="org-left">Streamer</th> +<th scope="col" class="org-left">Checkin</th> +<th scope="col" class="org-left">IRC</th> +<th scope="col" class="org-left">Pad</th> +<th scope="col" class="org-left">Coord</th> +</tr> +</thead> + +<tbody> +<tr> +<td class="org-left">Gen AM</td> +<td class="org-left">zaeph</td> +<td class="org-left">sachac</td> +<td class="org-left">corwin</td> +<td class="org-left">dto</td> +<td class="org-left">publicvoit</td> +<td class="org-left">sachac</td> +</tr> + + +<tr> +<td class="org-left">Gen PM</td> +<td class="org-left">zaeph</td> +<td class="org-left">jman</td> +<td class="org-left">FlowyCoder</td> +<td class="org-left">bandali</td> +<td class="org-left">publicvoit</td> +<td class="org-left">sachac</td> +</tr> + + +<tr> +<td class="org-left">Dev AM</td> +<td class="org-left">bandali</td> +<td class="org-left">sachac</td> +<td class="org-left">corwin</td> +<td class="org-left">dto</td> +<td class="org-left"> </td> +<td class="org-left">sachac</td> +</tr> + + +<tr> +<td class="org-left">Dev PM</td> +<td class="org-left">bandali</td> +<td class="org-left">sachac</td> +<td class="org-left">FlowyCoder</td> +<td class="org-left">bandali</td> +<td class="org-left"> </td> +<td class="org-left">sachac</td> +</tr> +</tbody> +</table> + +Backups: + +- dev host/streamer: bandali, sachac +- gen host/streamer: zaeph, sachac +- checkin, IRC, pad: sachac + +Interested in a shift? Please e-mail <mailto:emacsconf-org-private@gnu.org> and we’ll help you figure out what you need to learn. + + `(setq emacsconf-shifts + (list + ,@(apply #'append + (mapcar + (lambda (day) + (let ((headers (mapcar (lambda (field) (intern (concat ":" (downcase field)))) + (cdr (car (cadr day)))))) + (mapcar + (lambda (row) + (apply #'append + (list 'list :id + (when (string-match "^\\([^ ]+\\) \\(AM\\|PM\\)" (car row)) + (format "%s-%s-%s" + (car day) + (downcase (match-string 2 (car row))) + (downcase (match-string 1 (car row))))) + :track + (if (string-match "^Gen" (car row)) "General" "Development") + :start + (format "%sT%s:00:00%s" + (elt day 2) + (if (string-match "AM" (car row)) "08" "13") + emacsconf-timezone-offset) + :end + (format "%sT%s:00:00%s" + (elt day 2) + (if (string-match "AM" (car row)) "12" "18") + emacsconf-timezone-offset)) + (seq-map-indexed + (lambda (value index) + (unless (string= value "") + (list (elt headers index) value))) + (cdr row)))) + (cdr (cadr day))) + )) + (list + (list "sat" sat "2022-12-03") + (list "sun" sun "2022-12-04")))))) + + ## After the conference - Video processor @@ -479,25 +3512,150 @@ The roles below are related to the proposals in the early stages of the preparat - Post more information +<a id="infra"></a> + +# Infrastructure notes + + +## Uh… how should ikiwiki be set up? + +- remove the ikiwiki\_src clone from the ansible config + +<https://ikiwiki.info/rcs/git/> +bare repo has a post-update hook that updates the src repo +src repo is ~ikiwiki/emacsconf +~git/repositories/pub/emacsconf-wiki.git/hooks/post-update runs ~git/repositories/pub/emacsconf-wiki.git/hooks/post-update.h00-ikiwiki-wrapper +there is an anon mirror that’s updated with sudo -u anon /home/anon/fetch-wiki +the git wrapper is +/home/ikiwiki/hooks/emacsconf + +~anon/emacsconf-wiki.git has origin git@git.emacsconf.org:pub/emacsconf-wiki (fetch) +but git log does not have the new stuff +Where is the new stuff? +… hah, maybe I forgot to push + + +## Backstage + + +### File suffixes, and what they correspond to + +Per categories, earlier suffixes come earlier in the process. + +<table> + + +<colgroup> +<col class="org-left"> + +<col class="org-left"> +</colgroup> +<thead> +<tr> +<th scope="col" class="org-left">Suffix</th> +<th scope="col" class="org-left">Description</th> +</tr> +</thead> + +<tbody> +<tr> +<td class="org-left">VIDEO</td> +<td class="org-left"> </td> +</tr> + + +<tr> +<td class="org-left">–original.EXT</td> +<td class="org-left">File as submitted by speaker</td> +</tr> + + +<tr> +<td class="org-left">–reencoded.webm</td> +<td class="org-left">Reencode via ffmpeg incantation</td> +</tr> + + +<tr> +<td class="org-left">–final.webm</td> +<td class="org-left">Broadcast-ready reencode with normalized audio</td> +</tr> +</tbody> + +<tbody> +<tr> +<td class="org-left">AUDIO</td> +<td class="org-left"> </td> +</tr> + + +<tr> +<td class="org-left">–original.EXT</td> +<td class="org-left">Extracted audio track from speaker upload; used for speech-recognition</td> +</tr> + + +<tr> +<td class="org-left">–normalized.opus</td> +<td class="org-left">Normalized audio track</td> +</tr> +</tbody> + +<tbody> +<tr> +<td class="org-left">SUBTITLES</td> +<td class="org-left"> </td> +</tr> + + +<tr> +<td class="org-left">–?(incomplete-)transcript</td> +<td class="org-left">Transcript provided by speaker</td> +</tr> + + +<tr> +<td class="org-left">–main.EXT</td> +<td class="org-left">Broadcast-ready reencode; different formats for different uses</td> +</tr> +</tbody> +</table> + + <a id="other"></a> # Other tasks and processes +- [Giving conf.org access to a new volunteer or fake user](#private-access) +- [As prerecorded talks come in](#prerec-process) +- [When a talk is captioned](#when-captioned) +- [Other tasks before the conference](#before) +- [During the conference](#during-conference) +- [After the conference](#after-conference) -## DONE Sacha: Organize volunteer information :sachac: +<a id="private-access"></a> -## Once talks are approved +## Giving conf.org access to a new volunteer or fake user -- sacha: Publish initial talk information pages -- Double-check talk pages, format them nicely -- Publish draft schedule -- Confirm e-mail communication with all of the speakers +This can only be done by the admins of the gitolite instance (zaeph, +or bandali as a backup). This is because the changes need to be made +in the gitolite-admin repo that can only be accessed by admins. In a +pinch, people with access to the \`orga\` user on front0 can manually +add themselves to the list of admins and manually rebuild the +instance. +Regular process: + +- Get public key from volunteer, +- Add key under `./key/dir/`, +- Update permissions on `./conf/gitolite.conf`, +- Push to origin. -## As prerecorded talks come in -- +<a id="prerec-process"></a> + +## As prerecorded talks come in - Sacha: Parcel out captioning work to volunteers, help them get set up - Volunteers: Caption pre-recorded videos (usually starting from autogenerated ones for easier work) @@ -516,63 +3674,288 @@ Usage: `compress-video.sh original-file output-file`: We tried using q56 before, but it was a little too aggressive. Q=32 is the default and is probably a reasonable space vs. quality compromise. +2020 version used with parallel + + Q=$1 + WIDTH=1280 + HEIGHT=720 + AUDIO_RATE=48000 + VIDEO_FILTER="scale=w=${WIDTH}:h=${HEIGHT}:force_original_aspect_ratio=1,pad=${WIDTH}:${HEIGHT}:(ow-iw)/2:(oh-ih)/2,fps=25,colorspace=all=bt709:iall=bt601-6-625:fast=1" + FILE=$2 + SUFFIX=$Q + shift + shift + if [ ! -f $FILE ]; then + wget https://mirror.csclub.uwaterloo.ca/emacsconf/2020/$FILE + fi + ffmpeg -y -i "$FILE" -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -an -threads 8 /dev/null && + if [[ $FILE =~ "webm" ]]; then + ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a copy "${FILE%.*}--compressed$SUFFIX.webm" + else + ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a libvorbis "${FILE%.*}--compressed$SUFFIX.webm" + fi + rm $FILE + +2022 version used with parallel to compress low version + + Q=$1 + WIDTH=1280 + HEIGHT=720 + AUDIO_RATE=48000 + VIDEO_FILTER="scale=w=${WIDTH}:h=${HEIGHT}:force_original_aspect_ratio=1,pad=${WIDTH}:${HEIGHT}:(ow-iw)/2:(oh-ih)/2,fps=25,colorspace=all=bt709:iall=bt601-6-625:fast=1" + FILE=$2 + SUFFIX=$Q + shift + shift + ffmpeg -y -i "$FILE" -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -an -threads 8 /dev/null && + if [[ $FILE =~ "webm" ]]; then + ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a copy "${FILE%.*}--compressed$SUFFIX.webm" + else + ffmpeg -y -i "$FILE" $* -pixel_format yuv420p -vf $VIDEO_FILTER -colorspace 1 -color_primaries 1 -color_trc 1 -c:v libvpx-vp9 -b:v 0 -crf $Q -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -ac 2 -threads 8 -c:a libvorbis "${FILE%.*}--compressed$SUFFIX.webm" + fi + + +### sachac + +- download to local cache + ~/proj/emacsconf/private/sync-cache +- upload to YouTube in case we can get autogenerated subtitles from there + <https://studio.youtube.com/channel/UCwuyodzTl_KdEKNuJmeo99A/videos/upload?filter=%5B%5D&sort=%7B%22columnType%22%3A%22date%22%2C%22sortOrder%22%3A%22DESCENDING%22%7D> +- upload to res:~/2022/captions +- caption.sh +- sync-cache to copy the vtt +- emacsconf-make-backstage-index +- send confirmation e-mail + + +### Confirmation e-mail + + +#### DONE Make sure all submissions have been acknowledged + +- [X] sibi +- [X] vidianos +- [X] bhavin +- [X] gopar +- [X] bala +- [X] andrea +- [X] andrew +- [X] zachary for asmblox (reception confirmed by zaeph, and no problem + with video) +- [X] ramin (ack’d by zaeph) +- [X] abin (meain, ack’d by zaeph) + + +#### Acknowledge pre-rec submission + + (defun emacsconf-mail-acknowledge-submission (talk &optional template) + (interactive (list (emacsconf-complete-talk-info))) + (save-window-excursion + (emacsconf-with-talk-heading (plist-get talk :slug) + (emacsconf-cache-video-data talk) + (when (string= (plist-get talk :status) "WAITING_FOR_PREREC") + (org-todo "TO_PROCESS")))) + (emacsconf-publish-backstage-index) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "ack-prerec")) + (plist-get talk :email) + (list + :backstage "https://media.emacsconf.org/2022/backstage/" + :backstage-user "emacsconf" + :backstage-password emacsconf-backstage-password + :time (plist-get talk :time) + :title (plist-get talk :title) + :email (plist-get talk :email) + :minutes (plist-get talk :video-time) + :speakers-short (plist-get talk :speakers-short) + :url (concat emacsconf-base-url (plist-get talk :url)) + :year emacsconf-year))) -## When a talk is captioned -- Upload talk +#### Template +Hi, ${speakers-short}! -## Other tasks before the conference +Just a quick note to let you know that I’ve downloaded your submission +for “${title}”. We’ve added your submission to the backstage area at +${backstage} (username: ${backstage-user}, password: +${backstage-password}), and we’ll post the files on your talk page +when the talk is public. A quick check shows that your video is about +${minutes} minutes long (${time} minutes budgeted). -- Coordinate volunteer schedules so all the roles are covered +We’ll be working on captioning it over the next few weeks. We’ll +e-mail again a little closer to the conference with schedule updates +and other useful information. If you want to upload a new version, you +can upload it the same way you did the previous one. +Please feel free to e-mail us at emacsconf-submit@gnu.org if you need +help updating the talk wiki page at ${url} or if you have other +questions. -### Test stream setup +Thank you so much for all the work you put into preparing a talk for +EmacsConf ${year}, and thank you for submitting the prerecorded video +before the conference! -[Stream](#org4fe1799) +Sacha Chua -### Set up MPV for captions +<a id="mastering"></a> + +### Mastering the prerec’s audio-track + +Mastering is the process of preparing an audio-track for a purpose. For +us, the purpose is quite simple: maximize the intelligibility of the +speaker and minimize the noise. + +We can get great results with Audacity for the vast majority of +audio-tracks. Sometimes, however, some audio-tracks have intractable +noise-profile that require the use of model-based denoising filters that +can applied with ffmpeg. + +We’ll start with the average Audacity workflow, and we’ll move on to the +model-based filters after. + + +#### Audacity workflow + +When we process a prerec, we extract the audio of the original upload +and add it to the backstage. You should be able to find it under the +name –original.$audio\_format or –main.$audio\_format. If it’s not +there, it’s easy to extract the audio from the original video, but +we’d prefer if you warned core-organizers about it because it’s not +normal. + +We’ve simplified the process down to these steps: + +1. Open the audio file in Audacity. + + You might want to increase the size of the waveform by pulling on the + bottom of the bottom of the track. + + [audacity-demo-noise-reduction.webm](https://media.emacsconf.org/misc/audacity-demo-noise-reduction.webm) +2. Find a moment of quiet in the video, and select it. + + We ask our speakers to include 5 seconds of quiet at the beginning or + end of their prerecs, but even if they don’t, it’s relatively. + +3. Effects → Noise Reduction → Get Noise Profile -#### mpv profile +4. Select → All -Add the following profile to `~/.config/mpv/mpv.conf`: +5. Effects → Noise Reduction → OK + + You can select a spoken portion of the track before applying the + effect and preview it to test your settings. The default are usually + enough (Noise reduction (dB): 12, Sensitivity: 6.00, Frequency smoothing + (bands): 3). + + [audacity-demo-noise-reduction.webm](https://media.emacsconf.org/misc/audacity-demo-noise-reduction.webm) - # Uncomment this line to load the profile by default - # Otherwise, use `--profile=emacsconf-talks` - # profile=emacsconf-talks +6. Tools → Apply Macro → Alpha - [emacsconf-talks] - # Positioning - video-zoom=-0.15 - video-pan-y=-0.055 - sub-use-margins=yes - sub-scale-by-window=yes - sub-pos=103 - sub-margin-x=150 - sub-margin-y=40 - # Style - sub-font="Clear Sans Bold" - sub-color="1/0.82/0" - sub-blur=0.2 - sub-scale=0.9 - sub-font-size=40 - sub-border-size=0 - sub-border-color=0/1 - sub-shadow-color=0/1 - sub-shadow-offset=1.2 - sub-ass-force-style=Kerning=yes - sub-ass-line-spacing=0 + Before you can apply the Alpha macro, you need to save its content to + disk and import it via Tools → Macro Manager → Import. + + Reverb:Delay="20" DryGain="5" HfDamping="99" Reverberance="15" RoomSize="70" StereoWidth="25" ToneHigh="0" ToneLow="100" WetGain="-13" WetOnly="0" + Amplify:Ratio="1" + FilterCurve:f0="79.621641" f1="101.02321" FilterLength="8191" InterpolateLin="0" InterpolationMethod="B-spline" v0="5.9148936" v1="0.042552948" + Normalize:ApplyGain="1" PeakLevel="-3" RemoveDcOffset="1" StereoIndependent="1" + Compressor:AttackTime="0.1" NoiseFloor="-50" Normalize="1" Ratio="2" ReleaseTime="1" Threshold="-30" UsePeak="0" + +1. Export → Export Audio… → Opus Files (.opus format) + + Use the following settings: + + [audacity-export-settings.png](https://media.emacsconf.org/misc/audacity-export-settings.png) + + > Bit Rate: 64 kbps + > VBR Mode: On + > Compression: 10 + > Application: Audio + > Frame Duration: 20 ms + > Cutoff: Disabled + + +#### Model-based denoising filter + +If you can’t manage to get a good result with Audacity, chances are it’s +because there’s too much noise in the video, even after profile-based +denoising. This usually happens when the noise-pattern of an +audio-track evolves over the video, or if has an aperiodic quality. For +those, we’re going to need a bigger boat. + +Model-based denoising means using an AI-generated model to remove the +audio frequencies that are usually associated to noise and preserve +those that aren’t. A different context (e.g. noisy room with statics, +noisy room with people chatting, etc.) means a different model; for us, +this means a model that minimizes background noise and maximizes clear +voices (the speakers’). + +This is the model we’ve been using: + +[audio-denoiser-model-mp.rnnn](https://media.emacsconf.org/misc/audio-denoiser-model-mp.rnnn) (download link) + +Source: [rnnoise-models](https://github.com/GregorR/rnnoise-models), Model: [marathon-prescription](https://raw.githubusercontent.com/GregorR/rnnoise-models/master/marathon-prescription-2018-08-29/mp.rnnn) + +You should always apply the filter on the original’s audio, as opposed +to an Audacity-processed audio. This is to ensure that we have the most +information about the signal, which means we can have gather the most +information about the noise-profile. + +Following is the ffmpeg incantation to use to apply the filter-model. +Make sure to modify the `DENOISER` variable and adapt input/output. + + DENOISER="/path/to/audio-denoiser-model-mp.rnnn" + input="original.opus" + output="denoised.opus" + ffmpeg -i "$input" -af "arnndn=m=$DENOISER" "$output" + +There’s no need to customize the libopus export information; the default +is more than enough for human-speech. + +When you’re done with this step, you can then process the outputted +audio-track with Audacity, skipping the denoising steps (1 to 5). -(Thanks, zaeph) +#### Questions? + +If you’ve got any question on the process, you canget in touch with me (zaeph)! + + +<a id="when-captioned"></a> + +## When a talk is captioned + +- Combine captions with talk +- Upload captions to YT and Toobnix +- Prepare captions for wiki inclusion + + +<a id="before"></a> + +## Other tasks before the conference + +- Coordinate volunteer schedules so all the roles are covered + + +### Test stream setup + +[Stream](#other-streams) + + +<a id="mpv-captions"></a> + +### Set up MPV for captions -#### Font: Clear Sans +mpv.conf profile tips are now at <https://emacsconf.org/mpv/> . + + +#### Suggested font: Clear Sans Links: -- tar.gz with all fonts: [from zaeph's server](https://zaeph.tk/files/emacsconf/captions/fonts.tar.gz) (more convenient) +- tar.gz with all fonts: [from zaeph’s server](https://zaeph.tk/files/emacsconf/captions/fonts.tar.gz) (more convenient) - WOFF from GitHub repo: [clear-sans/WOFF at main · intel/clear-sans](https://github.com/intel/clear-sans/tree/main/WOFF) @@ -583,6 +3966,8 @@ Links: rsync -avzue ssh front:/var/www/media.emacsconf.org/2021/protected/*--main.webm . +<a id="during-conference"></a> + ## During the conference @@ -642,6 +4027,8 @@ Links: EmacsConf 2021 starting now: <https://emacsconf.org/2021/> +<a id="other-streams"></a> + ##### Stream @@ -655,6 +4042,12 @@ Needs the `$main480p` environment variable set to something of the form `icecast ###### Youtube +###### Toobnix + + +###### DONE Add IRC links to YouTube and Toobnix descriptions + + ### Check in a speaker Exception: [CHECK is unavailable](#check-gone) @@ -667,25 +4060,25 @@ Exception: [CHECK is unavailable](#check-gone) <https://etherpad.wikimedia.org/p/emacsconf-2021> , or IRC (like this)? - [? IRC] Thanks for checking in! Feel free to keep an eye on - \#emacsconf for questions and discussion, and we'll copy things from + \#emacsconf for questions and discussion, and we’ll copy things from the pad to there. If the volume gets overwhelming, let us know and - we can forward questions to #emacsconf-questions for you. If you'd + we can forward questions to #emacsconf-questions for you. If you’d like to try Q&A over live video or the collaborative pad instead, or if you need help, please let us know. -- [? Etherpad] Thanks for checking in! The collaborative pad we'll be +- [? Etherpad] Thanks for checking in! The collaborative pad we’ll be using for questions is at - <https://etherpad.wikimedia.org/p/emacsconf-2021> . We'll collect - questions from #emacsconf and put them there. If you'd like to jump + <https://etherpad.wikimedia.org/p/emacsconf-2021> . We’ll collect + questions from #emacsconf and put them there. If you’d like to jump to your part of the document, you might be able to keep an eye on questions. Please let us know if you need help, or if you want to switch to live Q&A. -- [? live] Thanks for checking in! I'll send you some private messages - with instructions, so please check there. Let me know if you don't +- [? live] Thanks for checking in! I’ll send you some private messages + with instructions, so please check there. Let me know if you don’t get them. - Private messages: - - (erc-message "PRIVMSG" (format "%s You can use this BBB room: %s . I'll join you there shortly to set up the room and do the last-minute tech check." nick room-url)) - - (erc-message "PRIVMSG" (format "%s The collaborative pad we'll be using for questions is at %s . We'll collect questions from #emacsconf and put them there. If you'd like to jump to your part of the document, you might be able to keep an eye on questions. Alternatively, we can read questions to you." nick conf-collaborative-pad)) - - (erc-message "PRIVMSG" (format "%s Leo Vivier will join when it's time, and he will give you the go-ahead when it's time to present. See you in the BBB room!" nick)) + - (erc-message “PRIVMSG” (format “%s You can use this BBB room: %s . I’ll join you there shortly to set up the room and do the last-minute tech check.” nick room-url)) + - (erc-message “PRIVMSG” (format “%s The collaborative pad we’ll be using for questions is at %s . We’ll collect questions from #emacsconf and put them there. If you’d like to jump to your part of the document, you might be able to keep an eye on questions. Alternatively, we can read questions to you.” nick conf-collaborative-pad)) + - (erc-message “PRIVMSG” (format “%s Leo Vivier will join when it’s time, and he will give you the go-ahead when it’s time to present. See you in the BBB room!” nick)) - CHECK directs speaker to available room with `/checkin <room> <nick>` - Speaker joins talk room - CHECK makes speaker presenter and moderator, does last-minute tech check @@ -696,7 +4089,7 @@ Exception: [CHECK is unavailable](#check-gone) - live Q&A: reading questions themselves (can do in any order, can skip; coach possible responses for awkward things) or asking HOST to read questions to them - HOST can share the pad or IRC; speaker shares screen only if doing demo - - encouragement of webcam, although it's optional + - encouragement of webcam, although it’s optional - how HOST will join shortly before the prerec ends and then give them the go-ahead - closing any tabs watching the stream as their talk starts @@ -710,11 +4103,11 @@ Exception: [CHECK is unavailable](#check-gone) information. -#### bandali's check-in steps +#### bandali’s check-in steps -- please leave webcam quality on 'medium' +- please leave webcam quality on ’medium’ - please read each audience question out loud before responding -- please mute stream on your machine if you're watching +- please mute stream on your machine if you’re watching - would you like to stay around for a longer q&a? - would you like to share your webcam or screen? (quickly mention how) @@ -726,7 +4119,7 @@ Exception: [CHECK is unavailable](#check-gone) - [? prerec] - HOST switches to MPV scene in OBS and plays the video (with captions if available). - Exception: [Last-minute prerecording submission](#last-minute-prerec) - - Exception: [Last-minute caption update](#last-minute-captions) + - Exception: - [CHECK publishes information](#publish) - [HOST gets a head start on handling Q&A](#questions) - When prerec finishes, HOST switches the OBS scene to show BBB. @@ -767,14 +4160,110 @@ Exception: [CHECK is unavailable](#check-gone) - Doublecheck subtitles - Add it to the EmacsConf 2021 playlist. - [? live sections] - - CHECK does a rough-cut of the recording from ${dump} to get the last X minutes or by time range. There's about a 1-2 minute delay. + - CHECK does a rough-cut of the recording from ${dump} to get the last X minutes or by time range. There’s about a 1-2 minute delay. Ex: `(kill-new (conf-dump-get "alt" "10:24" "10:30" "qa_"))` - - When there's an opportunity to do so: + - When there’s an opportunity to do so: - CHECK finetunes the rough-cut recording (trim start and end) and posts it to: - media.emacsconf.org/2021 - wiki page for talk +#### DONE Automatically commit to the wiki + +when emacsconf-publish-autocommit-wiki is set + +(emacsconf-publish-update-talk (append (list :public t) (emacsconf-resolve-talk “journalism”))) +(emacsconf-publish-update-talk (append (list :public nil) (emacsconf-resolve-talk “journalism”))) + + +#### DONE Make sure VTTs only get published when they’re edited + + +##### publishing + + +##### webm + + +##### media directory + + +#### DONE Fix mapconcat error in updating task status + + +#### DONE Add intros to wiki pages + + +#### SOMEDAY Cache video data - audio processed? + + +#### DONE Cache video data - edited captions + + +##### DONE Double-check that all the edited captions have the header + + (mapcar (lambda (o) + (plist-get o :slug)) + (seq-filter + (lambda (o) (and + (string= (plist-get o :status) "TO_STREAM") + (null (plist-get o :captions-edited)))) + (emacsconf-get-talk-info))) + + +#### DONE Automatically commit and push the wiki + + +#### DONE Set publishing on a timer :sachac: + + +##### DONE Single timer, batch timers for playing and closed q + +(emacsconf-stream-schedule-timers) + + +##### DONE Take intro into account for scheduling q&a time + + +##### TODO Test the timer + + (let ((info (emacsconf-inflate-sexp '(journalism + + +#### DONE Simplify manual setting of a timer to update task status :sachac: + +emacsconf-stream-schedule-talk-status-change + + +#### DONE Rename update-task-status.sh to talk :sachac: + + +#### DONE make sure captions are included on the wiki page + + +#### DONE Set public based on time, expose more interactive functions :sachac: + +so that the wiki doesn’t have to depend on synchronized conf.org state + + (cl-assert + (plist-get + (emacsconf-add-talk-status (list :start-time (date-to-time "2022-01-01T12:00:00-0400"))) + :public)) + (cl-assert + (null + (plist-get + (emacsconf-add-talk-status (list :start-time (date-to-time "2030-01-01T12:00:00-0400"))) + :public))) + (cl-assert + (plist-get + (emacsconf-add-talk-status (list :start-time (date-to-time "2030-01-01T12:00:00-0400") + :status "PLAYING")) + :public)) + + +#### TODO figure out if we need to adapt to org-time-stamp-formats change removing brackets + + ### Handle Q&A Exceptions: @@ -784,7 +4273,7 @@ Exceptions: - [? live] - CHECK-alternate joins the BBB room and pauses MPV. - HOST joins the BBB room - - HOST starts recording in BBB or confirms that it's already recording + - HOST starts recording in BBB or confirms that it’s already recording - HOST switches to the BBB scene in OBS. - HOST describes how to ask questions. - [? No questions yet] @@ -798,15 +4287,15 @@ Exceptions: - [? IRC/pad] - HOST switches to pad/chat OBS scene. - HOST describes Q&A method and shows it on the screen. - - While there's buffer time before the next talk, HOST can read out + - While there’s buffer time before the next talk, HOST can read out questions and answers, or transition to the next talk early - - HOST: It's time for the next talk, but if you want to keep + - HOST: It’s time for the next talk, but if you want to keep discussing the previous talk, please feel free to continue doing so on IRC or the pad. - [? speaker will answer after the conference] - HOST switches to pad/chat OBS scene. - - HOST says the speaker is not available right now, but we'll - forward the questions to the speaker and we'll post the speaker's + - HOST says the speaker is not available right now, but we’ll + forward the questions to the speaker and we’ll post the speaker’s answers on the wiki page. Leave your contact information if you want to be notified, or subscribe to the emacsconf-discuss mailing list to get the announcement. Please feel free to continue @@ -841,12 +4330,14 @@ Exceptions: - bandali figures out the downstream +<a id="after-conference"></a> + ## After the conference ### Send thanks -[Thank you, next steps](#orgad192ac) +[Thank you, next steps](#thanks) ### Extract the opening and closing remarks @@ -881,7 +4372,7 @@ Resource explanation: - **deskshare.webm:** Shared desktop as video - metadata.xml -Probably focus on grabbing the audio first and seeing what's worth keeping +Probably focus on grabbing the audio first and seeing what’s worth keeping (defun emacsconf-extract-chat (slug speaker) (interactive (list @@ -997,21 +4488,21 @@ Probably focus on grabbing the audio first and seeing what's worth keeping Make a table of the form -<table id="org40dcda4" border="2" cellspacing="0" cellpadding="6" rules="groups" frame="hsides"> +<table id="orgf99a134"> <colgroup> -<col class="org-left" /> +<col class="org-left"> -<col class="org-left" /> +<col class="org-left"> -<col class="org-left" /> +<col class="org-left"> -<col class="org-left" /> +<col class="org-left"> -<col class="org-left" /> +<col class="org-left"> -<col class="org-left" /> +<col class="org-left"> </colgroup> <tbody> <tr> @@ -1084,45 +4575,201 @@ Make a table of the form - Update ${conf-year}/${captions}/${slug}.md in the wiki. To make this from scratch, use `M-x conf-prepare-transcript-directives` from the talk heading in the conference Org file. +### STARTED Update the chapter index for answers + +- emacsconf-subed-make-chapter-file-based-on-comments +- emacsconf-publish-process-answers-chapters + - Put it in wiki/year/captions/ and add it to the repository + - Add it to the cache directory + - Upload it to media.emacsconf.org:~/year +- Update the talk page +- Remove the help marker from the talk page + + <https://emacsconf.org/help_with_chapter_markers/> + <file:///home/sacha/proj/emacsconf/cache> + + ### BLOCKED Downsize the server :bandali: -## In case of +<a id="exceptions"></a> +# In case of -### Stuck wiki +See <https://pad.emacsconf.org/premortem> for more. + +- [Common broadcast (gen and dev)](#common):stream: +- [Stream OBS needs to be restarted](#obs-restart):stream: +- [Wiki](#ikiwiki-stuck):publish: +- [Cancelled talk](#cancelled):schedule: +- [Last-minute prerecording submission](#last-minute-prerec):upload: +- [Technical issues during a live presentation](#live-issues):stream: +- [Big technical issues with streaming](#stream-issues):stream: +- [Last-minute caption or file update](#last-minute-captions):upload: +- [Pad malfunction or mess-up](#pad-broken):infra: +- [Speaker has not checked in](#missing):sched: +- [Speaker does not have a prerec and has not checked in](#really-missing):sched: +- [Conduct guidelines issue](#conduct):host: +- [CHECK is unavailable](#check-gone) +- [HOST is unavailable](#host-gone) +- [live0 can’t handle the load or is close to network transfer limit](#network) +- [People have a hard time seeing dark-mode presentations (or light-mode)](#dark-mode) +- [Schedule update](#update-sched):sched: +- [New talk](#new-talk):sched: +- [In case we need to do things manually because the task status hooks don’t work](#manual) +- [Alternate stream volunteer wants to stream](#alternate) +- [Video playing error, need to play with mpv manually](#play-mpv-manually):stream: +- [Shift changes](#orgd99c648) +- [Need to restart 480p stream](#restart-480p):stream: +- [Renamed talk](#renamed):sched: +- [Need to restart the Toobnix streams so we don’t exceed 5 hours](#orgc1b179b) + + +<a id="common"></a> + +## Common broadcast (gen and dev) :stream: + +Options: + +- mpv <https://live.emacsconf.org/emacsconf/gen.webm> +- mpv the same video +- join the BBB room + +emacsconf-stream-rebroadcast - specify the source track + +[Development -> General]((emacsconf-stream-rebroadcast "Development" "General")) +[General -> Development]((emacsconf-stream-rebroadcast "General" "Development")) + + +<a id="obs-restart"></a> + +## Stream OBS needs to be restarted :stream: + +- ssh to the track and run `track-obs` +- ssh to live0.emacsconf and run whatever’s appropriate: + + screen -S restream-test-toobnix -X quit; screen-restream-test-toobnix.sh + screen -S restream-test-youtube -X quit; screen-restream-test-youtube.sh + screen -S restream-gen-toobnix -X quit; screen-restream-gen-toobnix.sh + screen -S restream-gen-youtube -X quit; screen-restream-gen-youtube.sh + screen -S restream-dev-toobnix -X quit; screen-restream-dev-toobnix.sh + screen -S restream-dev-youtube -X quit; screen-restream-dev-youtube.sh +- check if the streams are all right + + +<a id="ikiwiki-stuck"></a> + +## Wiki :publish: + +Stuck: sudo -iu ikiwiki – ikiwiki –setup ~ikiwiki/emacsconf.setup +emacsconf.setup changed: + +ssh orga@front0.emacsconf.org +sudo su - ikiwiki +ikiwiki –setup emacsconf.setup –rebuild –wrappers + -### Last-minute prerecording submission +<a id="cancelled"></a> -- CHECK will copy it from the FTP upload server to ${protected} and name it appropriately. -- CHECK will notify STREAM with the scp command and the mpv command so that STREAM can choose. +## Cancelled talk :schedule: +1. Update conf.org to mark the talk as cancelled. +2. Update the `schedule-choices` block to fix the time for the following talk, or recalculate all the schedules. Check for any validation errors in the `:results:` block. +3. When you’re happy with the schedule, run the `draft-schedule` block. +4. Update the talk page to add CANCELLED to the title. +5. Publish the wiki and doublecheck it. + - Talk gone from the schedule? + - Talk listed among the cancelled talks? + - Talk page has cancelled info? +6. Remove the talk from the [one-track emergency schedule](#one-track) -### Last-minute caption update -- CHECK uploads the –main.vtt file to ${protected} -- CHECK notifies STREAM via ${upcoming} -- STREAM uses the provided commands to download the VTT file and load it into MPV with `--sub-file` +<a id="last-minute-prerec"></a> +## Last-minute prerecording submission :upload: -### Speaker has not checked in +- COORD will copy it from the FTP upload server to orga@res.emacsconf.org:~/stream -p 46668 and name it appropriately. +- COORD will notify STREAM with the scp command and the mpv command so that STREAM can choose. + + +<a id="live-issues"></a> + +## Technical issues during a live presentation :stream: + +- HOST tries to contact the speaker +- [? back on track] + - [? can be squeezed into remaining time]: Continue + - [? need extra time]: CHECK fiddles with buffer of following talks in conf.org and updates schedule + - [? need too much extra time (ex: 10min)]: HOST acknowledges + technical issues and says we may be able to follow up after the + conference +- [? can’t resume]: HOST acknowledges technical issues and says we may + be able to follow up after the conference + + +<a id="stream-issues"></a> + +## Big technical issues with streaming :stream: + +<file://ssh:orga@front0.emacsconf.org:/var/www/status.emacsconf.org/index.html> + +- HOST notifies #emacsconf and #emacsconf-org and adds a note at the top of the ${pad}. +- HOST updates the 2022.md wiki page +- CHECK publishes prerecordings + - media.emacsconf.org + - wiki + - Toobnix + - Peertube +- STREAM e-mails the mailing list + + +<a id="last-minute-captions"></a> + +## Last-minute caption or file update :upload: + +- CHECK uploads the –main.vtt file to orga@res.emacsconf.org:~/stream -p 46668 +- If streaming locally, STREAM copies the VTT file and loads it into MPV with `--sub-file` + +ssh orga@media.emacsconf.org +cd backstage; make all + +ssh orga@res.emacsconf.org -p 46668 +~/cache/update-cache +cd ~/stream +cp ~/cache/\*$SLUG\*–main.webm . + + +<a id="pad-broken"></a> + +## Pad malfunction or mess-up :infra: + +- PAD resets the pad using the time slider +- [? still not recovered] + - PAD reimports the pad from backup + + +<a id="missing"></a> + +## Speaker has not checked in :sched: - Let the previous talk run a little longer for Q&A; end at least in time for the prerec - After the previous Q&A wraps up, play the prerec - [? still not around after prerec finishes] - - HOST: Speaker might be having some difficulty connecting, but we'll collect your questions on the pad and send them afterwards. - - Can play next prerec a few minutes early + - HOST: Speaker might be having some difficulty connecting, but we’ll collect your questions on the pad and send them afterwards. + - Show the questions and discussion, invite people into the Q&A to talk about the talk. They can share their experiences and comments. -### Speaker does not have a prerec and has not checked in +<a id="really-missing"></a> -- Let the previous talk do live Q&A/demo if ready +## Speaker does not have a prerec and has not checked in :sched: + +- Let the previous talk do extended Q&A - Close to the time of the missing talk: - See if any of the previous speakers want to be set up for an impromptu talk/extension in a BBB room, just in case - - HOST: The next speaker might be having some difficulty connecting. In the meantime, let's… + - HOST: The next speaker might be having some difficulty connecting. In the meantime, let’s… - OR: - highlight ongoing discussions - invite another speaker for an impromptu extension; mplsCorwin will keep a list of possible speakers who are still active @@ -1130,22 +4777,118 @@ sudo -iu ikiwiki – ikiwiki –setup ~ikiwiki/emacsconf.setup - let mplsCorwin or zaeph fill in -### Speaker whose talk was reallocated shows up and has a prerec +<a id="conduct"></a> + +## Conduct guidelines issue :host: + +- [? IRC]: IRC operator addresses it with a reminder and/or a kick or a ban +- [? not resolved, or onscreen] + - HOST addresses it (on-camera if needed) with a reminder and/or a kick or a ban + + +<a id="check-gone"></a> + +## CHECK is unavailable + +- COORD or STREAM does check-ins +- HOST refers to the shift pad for Q&A preference etc. +- STREAM checks ~/stream for prerec filenames etc. +- Dropped goals: + - Publishing recordings ASAP + - Updating schedule/wiki on the fly + + +<a id="host-gone"></a> + +## HOST is unavailable + +- STREAM will do the hosting. + + +<a id="network"></a> + +## live0 can’t handle the load or is close to network transfer limit + +- OR: + - Redirect some viewers via asking in #emacsconf: + - watch via main-480p + - watch via Toobnix + - Consider dropping the restream to Toobnix (lower audience?) or to Youtube + - Add additional node to Linode account for shared transfer pool (TODO: doublecheck) + + +<a id="dark-mode"></a> + +## People have a hard time seeing dark-mode presentations (or light-mode) + +mpv –vf=negate $url + + +<a id="update-sched"></a> + +## Schedule update :sched: + +- Test the new schedule using the blocks near the beginning of conf.org +- emacsconf-publish-update-schedule +- E-mail affected speakers - see emacsconf-mail-schedule-update function + + +<a id="new-talk"></a> + +## New talk :sched: + +- Create entry in conf.org +- Fit it into the schedule using the emacsconf-schedule-plan variable +- When happy, execute the draft-schedule block to update the SCHEDULED properties +- emacsconf-generate-talk-page +- emacsconf-update-schedule +- emacsconf +- emacsconf-stream-generate-assets-for-talk + + +<a id="manual"></a> + +## In case we need to do things manually because the task status hooks don’t work + +export SLUG=the ID of the talk + +- [TO\_STREAM -> PLAYING](#orgffa54ff):stream: +- [CLOSED\_Q -> OPEN\_Q](#open) +- [OPEN\_Q -> TO\_ARCHIVE](#archive) -- CHECK copies it to ${protected} -- Plan to play prerec at the end of the day, or in any gaps if a live talk falls through +<a id="orgffa54ff"></a> -### Speaker whose talk was reallocated shows up and wants to do it live +### TO\_STREAM -> PLAYING :stream: -- See if there's enough time if buffers are shuffled back; if so, set up for a live presentation -- Check for alternate stream volunteers -- [? not enough time] Offer to set up a BBB room for recording or to - accept a prerecording afterwards, then include it on the site and in - post-conference communication +play slug (ex: play journalism) -### Alternate stream volunteer wants to stream (nice to have, at risk) +<a id="open"></a> + +### CLOSED\_Q -> OPEN\_Q + +Example for mail talk: + +STATE=open; ssh orga@media.emacsconf.org “cp *home/orga/backstage/assets/redirects/$STATE/bbb-$SLUG.html /home/orga/2022/current*” + + +<a id="archive"></a> + +### OPEN\_Q -> TO\_ARCHIVE + +Example for mail talk: + +STATE=after; ssh orga@media.emacsconf.org “cp *home/orga/backstage/assets/redirects/$STATE/bbb-$SLUG.html /home/orga/2022/current*” + +If you need to reset the state: + +STATE=before; ssh orga@media.emacsconf.org “cp *home/orga/backstage/assets/redirects/$STATE/bbb-$SLUG.html /home/orga/2022/current*” + + +<a id="alternate"></a> + +## Alternate stream volunteer wants to stream - CHECK gives ALTERNATE the BBB room URL for the talk they are interested in - ALTERNATE starts streaming to assigned end point @@ -1153,7 +4896,7 @@ sudo -iu ikiwiki – ikiwiki –setup ~ikiwiki/emacsconf.setup - CHECK updates ${stream-status} - CHECK notifies STREAM and HOST - After prerec plays: - - HOST: This talk has an extended demo/Q&A. You can go to ${alternate-url} to watch it, and we'll post a recording afterwards. + - HOST: This talk has an extended demo/Q&A. You can go to ${alternate-url} to watch it, and we’ll post a recording afterwards. - HOST sends ${alternate-url} to IRC: Alternate stream for ${title}: ${alternate-url} - ALTERNATE notifies #emacsconf-org when the stream is done. - CHECK updates ${stream-status} to note that the alternate stream is finished. @@ -1161,7 +4904,7 @@ sudo -iu ikiwiki – ikiwiki –setup ~ikiwiki/emacsconf.setup FFMPEG process for sending the desktop and audio to the $CONFALT mountpoint on Linux with X11 and Alsa: 1. Set the CONFALT environment variable to icecast://user:password@live0.emacsconf.org:8000/alt.webm - 2. Install pavucontrol if you don't have it already. + 2. Install pavucontrol if you don’t have it already. 3. Start the following command (<stream-desktop-and-audio.sh>: while true; do ffmpeg -loglevel 0 -ar 48000 -f alsa -channels 2 -sample_rate 48000 -i default -re -video_size 1280x720 -framerate 25 -f x11grab -i :0.0 -cluster_size_limit 2M -cluster_time_limit 5100 -content_type video/webm -c:v libvpx -b:v 1M -crf 30 -g 125 -deadline good -threads 4 -f webm $CONFALT; done @@ -1175,332 +4918,2983 @@ sudo -iu ikiwiki – ikiwiki –setup ~ikiwiki/emacsconf.setup - MPV goes to MPV sink, browser goes to recording sink, FFMPEG takes in recording monitor -### Pad malfunction or mess-up +<a id="play-mpv-manually"></a> -- PAD resets the pad using <https://etherpad.wikimedia.org/p/emacsconf-2021/timeslider> -- [? still not recovered] - - PAD reimports the pad from backup +## Video playing error, need to play with mpv manually :stream: +You can skip the intro and play a video by specifying the filename, like this: +play ~/stream/emacsconf-2022-journalism-\* -### CRDT malfunctions -- HOST notifies CHECK and tries reconnecting -- [? still doesn't work] - - Switch to backup Etherpad +<a id="orgd99c648"></a> +## Shift changes -### Conduct guidelines issue +1. Update [Shifts](#shifts) +2. Evaluate the code underneath to get the setq. +3. Put the setq in emacsconf.el. +4. Regenerate the hyperlists: emacsconf-pad-prepopulate-hyperlists -- HOST addresses it (on-camera if needed) with a reminder and/or a kick or a ban +<a id="restart-480p"></a> -### CHECK is unavailable +## Need to restart 480p stream :stream: -- HOST does check-ins -- HOST refers to conf.org for Q&A preference etc. -- STREAM checks conf.org for prerec filenames etc. -- Dropped goals: - - Publishing recordings ASAP - - Updating schedule/wiki on the fly +ssh live +/usr/local/bin/emacsconf-lowres-dev-on-connect +or +/usr/local/bin/emacsconf-lowres-gen-on-connect -### HOST is unavailable -- STREAM joins the BBB room and streams directly from there (or streams the prerecs). -- STREAM will do the hosting. +<a id="renamed"></a> +## Renamed talk :sched: -### Technical issues during a live presentation +1. Change conf.org heading. +2. Change the video slug property. +3. Rename any existing files in the backstage area. +4. emacsconf-publish-backstage-index +5. Change the title and heading on the wiki page. +6. Update the schedule (emacsconf-publish-schedule). +7. Update info pages (emacsconf-publish-info-pages). +8. Update the watch page (emacsconf-publish-watch-pages). +9. Update the pad, and the two previous pads. +10. Update the in-between slide (and for the following one) and upload the assets. +11. Redo the intros for that talk and the following one + SLUG=health; ffmpeg -y -loop 1 -i ../../in-between/$SLUG.png -i $SLUG.opus -i $SLUG.vtt -shortest ../$SLUG.webm; mpv $SLUG.webm -- HOST tries to contact the speaker -- [? back on track] - - [? can be squeezed into remaining time]: Continue - - [? need extra time]: CHECK fiddles with buffer of following talks in conf.org and updates schedule - - [? need too much extra time (ex: 10min)]: HOST acknowledges - technical issues and says we may be able to follow up after the - conference -- [? can't resume]: HOST acknowledges technical issues and says we may - be able to follow up after the conference +### DONE Rename lspbridge -### Big technical issues with streaming +rerecord lspbridge intro -- HOST notifies #emacsconf and #emacsconf-org and adds a note at the top of the ${pad}. -- HOST updates the 2021.md wiki page -- CHECK publishes prerecordings - - media.emacsconf.org - - wiki - - Toobnix - - Peertube -- STREAM e-mails the mailing list +lspbridge science -### live0 can't handle the load or is close to network transfer limit +### DONE Rename health -- OR: - - Redirect some viewers via asking in #emacsconf: - - watch via main-480p - - watch via Toobnix (if we can get that working) - - Consider dropping the restream to Toobnix (lower audience?) or to Youtube - - Add additional node to Linode account for shared transfer pool (TODO: doublecheck) +health eev -### People have a hard time seeing dark-mode presentations (or light-mode) +<a id="orgc1b179b"></a> -mpv –vf=negate $url +## TODO Need to restart the Toobnix streams so we don’t exceed 5 hours +screen -S restream-gen-toobnix -X quit; screen-restream-gen-toobnix.sh +screen -S restream-dev-toobnix -X quit; screen-restream-dev-toobnix.sh -<a id="comms"></a> -# Communications +<a id="archive"></a> +# Task archive -## DONE Ask emacsconf-org-private for feedback on early submissions -The EmacsConf 2022 CFP was extended to Sept 30 with notifications to -go out on Oct 15. We've got plenty of submissions and with any luck, -you've been reviewing them as they come in (assuming you have access to -emacsconf-submit@). +## DONE Write preparation instructions :zaeph: -As a courtesy to people who got their stuff together in a timely manner -and to give them extra time to prepare a prerecorded talk (which might -also translate into extra time for us to process and caption the talks), -I'd like to send acceptances and tentative time allotments by Sept 30. -I plan to offer a max of 20 minutes with a note that additional time may -be available for Q&A depending on how many additional submissions we get. +2021/prepare.md can be reused. -Could everyone who wants a say in the program please add comments to -$url by ****Sept 26**** so that we can send out early acceptances? In -general, we try to say yes to everything, so here's your chance to -raise any red flags or suggest ways to make things even better. -Thanks! +Extra stuff to consider adding: -Sacha +- DONE Suggestions for themes (especially wrt colourscape) +- DONE “Please don’t squeeze your talk by fast-forwarding your speech. Trimming silences and filler words can help, though. Sometimes it’s easier to write, record, and edit your voiceover, and then record the video to go along with it.“ +- DONE Allowing speakers to plant questions, esp. to cover tangential stuff that couldn’t fit in the prerec -## TODO Early speaker notification +## CANCELLED Allocate extra time if possible; send e-mail :sachac: + + +## DONE Review metadata for speakers in conf.org :zaeph: + +See the bottom of conf.org for some automated validation -We can accept early or send people a note saying notification of acceptance will be on Oct 15, because of the extended CFP. +## DONE Review the submissions in the pad (see emacsconf-org-private or conf.org for the link) and add any objections or comments by Sept 26 for possible [early speaker notification](#acceptance), Oct 7 for everything :organizers: -### Option A: Early speaker notification(?) +- zaeph: will start reviewing on Sep 21 + + +## DONE Write preparation instructions :zaeph: + +2021/prepare.md can be reused. + +Extra stuff to consider adding: + +- DONE Suggestions for themes (especially wrt colourscape) +- DONE “Please don’t squeeze your talk by fast-forwarding your speech. Trimming silences and filler words can help, though. Sometimes it’s easier to write, record, and edit your voiceover, and then record the video to go along with it.“ +- DONE Allowing speakers to plant questions, esp. to cover tangential stuff that couldn’t fit in the prerec + + +## DONE Add more submissions (CFP deadline Sept 30) :sachac: -Hi, $name! +- Sacha: Add submissions to emacsconf-2022-private, draft 2-day schedule by Oct 10 + + +## DONE Publish talk pages :sachac: -I'm happy to tell you that we've accepted your EmacsConf proposal for "$talk." Thanks for volunteering to share what you're learning about! I know it takes a fair bit of work to prepare a presentation, so I appreciate that you're taking the time to show what's possible with Emacs and encourage people to learn more. -We've extended the call for participation to Sept 30, so we might get a few more submissions over the next two weeks. That means we'll confirm time allocations on Oct 15. Since you submitted before the original deadline, we wanted to send you your acceptance by the original timeline so that you wouldn't be waiting in uncertainty. +## DONE Send early acceptances :sachac: -Just like last year, talks will be prerecorded in order to minimize technical risks, make it easier for speakers to enjoy other people's talks, allow captions, and let attendees catch up or share cool stuff quickly. I hope we get everything together in time so that we can ask volunteers to check for any issues that might come up when we re-encode. (I missed parts of some talks last time because I was rushing. <blush>) +Ideal sequence: -–— if $time = $max\_time +1. publish /2022/prepare (zaeph) +2. publish wiki pages +3. send acceptance e-mails + - Allocate at most 20 minutes, say we’ll try to add more time depending on the schedule (probably know by Sept 30 or Oct 1) + - Include review comments +4. Send an additional e-mail introducing speakers who may want to coordinate -You asked for $max\_time minutes for your talk and I think that should be all right. -–— else +## DONE Prepare to export talk information to wiki :sachac: + +Tested code in a fork, can publish talk information once talks are approved. +emacsconf-publish.el +emacsconf-generate-info-pages +emacsconf-generate-main-schedule +emacsconf-generate-talk-pages -You asked for at most $max\_time minutes for your talk. I think at this moment we can commit to $time minutes, with possibly more time being available depending on other submissions. If you want to plan a pre-recorded talk for that length and then use extra time for a live presentation or as Q&A, that would be great. Alternatively, you can wait until we confirm the schedule in case you want to plan a longer prerecorded talk. + +## DONE Give access to emacsconf-2022-private to dto :zaeph: + + +## DONE Write better subtitle documentation :sachac: + +<https://wiki.debian.org/Teams/DebConf/Video/Subtitles> +<https://emacsconf.org/captioning> +That will help more people subtitle things + + +## DONE Write volunteer page :sachac: + +<https://emacsconf.org/2022/volunteer> + + +## DONE Review the submissions in the pad (see emacsconf-org-private or conf.org for the link) and add any objections or comments by Sept 26 for possible [early speaker notification](#acceptance), Oct 7 for everything :organizers: + +- zaeph: will start reviewing on Sep 21 + + +## DONE Double-check sachac’s timezone conversions for availability :zaeph: + +zaeph helped with this, even catching some based on e-mail timestamps + + +## DONE Copy things over from previous notebooks :sachac: + + +## DONE Prepare to publish schedule :sachac:wiki: + +- Should be understandable as plain text +- Ideally responsive to take advantage of more screen space on monitors while still being understandable on mobile +- Organize by tracks and then days +- Links to jump to a track and day +- Graphics to make it easier for people to see nearby talk options +- Optionally, graphical view on talk pages as well (might need to publish a JSON somewhere to front) + + Schedule inspiration: + + - [DebConf 2022](https://debconf22.debconf.org/schedule/) converted times to your local timezone + - [LibrePlanet 2022](https://libreplanet.org/2022/program/) used table columns for the different tracks + - [SFSCON 2022](https://www.sfscon.it/programs/2022/) lists sessions chronologically, indicating tracks with labels and dots on a diagram. Dropdowns act as filters. + - <https://css-tricks.com/building-a-conference-schedule-with-css-grid/> + +- With JS and grid CSS: <https://imgur.com/KNpGayp> +- Fallback <https://imgur.com/HT9vX3o> + +Draft: <https://emacsconf.org/2022/draft-schedule/> + + +### DONE Set up main schedule as plain text + +general track +day 1 and day 2 + +dev track +day 1 and day 2 + +by day +all talks + + +### DONE Set up talk page navigation + +- program phase: by track +- schedule phase: chronological + + +### CANCELLED See if I can get the schedule to split into a nice grid on larger devices that support it + +Slightly annoying to do with JS/CSS because I want it to fall back to an interleaved schedule on small screens, so we would probably need to duplicate the elements and then use media queries. + + +### SOMEDAY Add caption icon to schedule :emacsconf: + +so that it’s easier for people to see which talks are accessible + + +### DONE Add captioned label in talk index + + +### TODO Display breaks and lunch in the schedule + + +## DONE Process confirmations as we receive them :sachac:zaeph: + +- Reply to the speaker and Cc -submit to confirm the confirmation. Something like “Confirming your confirmation, no reply needed to this one. Thank you!” +- Update talk to WAITING\_FOR\_PREREC in conf.org +- Add a note in the logbook (C-c C-z - org-add-note) for the talk entry +- Add :PUBLIC\_EMAIL: t if given permission to use the e-mail on the + talk page, or set it to an alternative e-mail if provided. +- Update the public wiki’s ${year}/talks/{$slug}.md page to add the + e-mail address as <mailto:person@example.com> on the speaker + information line. +- At some point, use `M-x emacsconf-generate-talk-pages` to update the e-mail address used in the footer. + + (let (waiting) + (save-window-excursion + (with-current-buffer (find-file emacsconf-org-file) + (org-map-entries (lambda () (add-to-list 'waiting + (list (org-entry-get (point) "SLUG") + (org-entry-get (point) "ITEM")))) "TODO=\"TO_CONFIRM\""))) + waiting) + + +## CANCELLED Create Org heading for scheduling caption team’s live IRC duty shifts :dto: + +See [Shifts](#shifts) + + +## DONE Sacha: Organize volunteer information :sachac: + + +## DONE Once talks are approved + +- sacha: Publish initial talk information pages +- Double-check talk pages, format them nicely +- Publish draft schedule +- Confirm e-mail communication with all of the speakers + +Process for accepting a talk: + +- Create subtree for talk and populate it with properties. + - Required: CUSTOM\_ID SLUG NAME NAME\_SHORT EMAIL AVAILABILITY Q\_AND\_A TRACK MAX\_TIME + - Optional: PRONOUNS PRONUNCIATION IRC PUBLIC\_EMAIL MIN\_TIME EMERGENCY + - Can be validated with `emacsconf-validate-talk-subtree` + - Add a talk abstract subtree +- Add it to emacsconf-schedule-plan and fiddle with it until the flow looks good +- Execute the draft-schedule block to update the schedule in the Org file +- Add the talk page to the wiki with `emacsconf-add-talk-page`. +- Stage, commit, and push the wiki files. Make sure to add the talk page and the info pages. +- Doublecheck the wiki page on the web, since the e-mail refers to it. +- E-mail the speaker the acceptance by using `emacsconf-draft-acceptance-for-email-group` from `organizers-notebook/`. +- Log the acceptance using `C-c C-z` in the talk subtree in `conf.org`, noting the number of minutes. +- Change the status to TO\_CONFIRM. + + +## DONE Remind people about confirming e-mail communications :sachac:email:speakers: + +Look for the TO\_CONFIRM status in conf.org, probably include in schedule e-mail + + +## DONE Send people schedule information and doublecheck their availability/Q&A preference :sachac:email:speakers:sched: + + (defun emacsconf-mail-schedule (group &optional template) + "Send draft schedule. + GROUP is (email . (talk talk))" + (interactive (list (emacsconf-mail-complete-email-group))) + (require 'emacsconf-ical) + (let ((reply-by-date (date-to-time "2022-10-14")) + (draft-schedule (concat emacsconf-base-url emacsconf-year "/draft-schedule/"))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "check-sched")) + (car group) + (list + :titles + (mapconcat (lambda (o) (format "%s: %s" + (plist-get o :slug) + (format-time-string + "%b %-e %-I:%M %#p %Z" + (plist-get o :start-time) + emacsconf-timezone))) + (cdr group) "; ") + :draft-schedule + draft-schedule + :speakers-short + (plist-get (cadr group) :speakers-short) + :plural + (if (= (length (cdr group)) 1) "" "s") + :email + (plist-get (cadr group) :email) + :year + (or (plist-get (cadr group) :year) emacsconf-year) + :coordination-note + (if (seq-find (lambda (o) (member (plist-get o :slug) '("journalism" "rolodex" "orgsuperlinks" "buttons" "hyperorg" "science"))) + (cdr group)) + "I've changed the order slightly from the coordination e-mail I sent you. The sequence is now journalism - science - rolodex - orgsuperlinks - buttons - hyperorg. science is now second instead of last, and the first two talks are on Sat while the last four are on Sun. That probably means you don't have to coordinate as much, but you can still do so if you would like to build on other people's talks." + "") + :schedule + (mapconcat + (lambda (o) (format "* TODO Check time for \"%s\" (%s) :emacsconf:\nDEADLINE: %s\n(Not a hard deadline, just encouragement to e-mail us before that date if you can)\nPlease e-mail [[mailto:emacsconf-submit@gnu.org]] if you need it changed\n%s track\n%s\nIn context: %s" + (plist-get o :title) + (plist-get o :slug) + (format-time-string (car org-time-stamp-formats) reply-by-date emacsconf-timezone) + (plist-get o :track) + (string-join + (let ((emacsconf-timezones + (if (plist-get o :timezone) + (seq-uniq (append (list emacsconf-timezone) + (split-string (plist-get o :timezone) " ") + (list "UTC"))) + emacsconf-timezones))) + (emacsconf-timezone-strings o)) + "\n") + draft-schedule)) + (cdr group) + "\n----------------------------------------------------------------\n") + :reply-by + (format-time-string "%b %-e (%a)" reply-by-date emacsconf-timezone) + :timezone-note + (if (plist-get (cadr group) :timezone) + (format "I've included timezone conversion to %s. Let me know if you'd like me to use a different timezone in future e-mails." + (plist-get (cadr group) :timezone) " ") + "I can translate times into your local timezone. Let me know what timezone you'd like me to use.") + :availability-note + (cond + ((seq-find (lambda (o) (string-match "yes" (or (plist-get o :availability) ""))) (cdr group)) + (format "I think you've indicated that you're available during the conference.")) + ((seq-find (lambda (o) (string-match "not indicated" (or (plist-get o :availability) ""))) (cdr group)) + (format "I think you didn't indicate any particular availability constraints in your submission.")) + (t (format "I think it respects your indicated availability, which we've noted as %s." + (string-join + (seq-uniq + (mapcar + (lambda (o) (format "\"%s\"" (plist-get o :availability))) + (cdr group))) + " and ")))))))) + + (defun emacsconf-mail-schedule-update (group &optional template) + "Send draft schedule update. + GROUP is (email . (talk talk))" + (interactive (list (emacsconf-mail-complete-email-group))) + (require 'emacsconf-ical) + (let ((reply-by-date (date-to-time "2022-10-14")) + (draft-schedule (concat emacsconf-base-url emacsconf-year "/draft-schedule/"))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "check-sched")) + (car group) + (list + :titles + (mapconcat (lambda (o) (format "%s: %s" + (plist-get o :slug) + (format-time-string + "%b %-e %-I:%M %#p %Z" + (plist-get o :start-time) + emacsconf-timezone))) + (cdr group) "; ") + :draft-schedule + draft-schedule + :speakers-short + (plist-get (cadr group) :speakers-short) + :plural + (if (= (length (cdr group)) 1) "" "s") + :email + (plist-get (cadr group) :email) + :year + (or (plist-get (cadr group) :year) emacsconf-year) + :coordination-note + (if (seq-find (lambda (o) (member (plist-get o :slug) '("journalism" "rolodex" "orgsuperlinks" "buttons" "hyperorg" "science"))) + (cdr group)) + "I've changed the order slightly from the coordination e-mail I sent you. The sequence is now journalism - science - rolodex - orgsuperlinks - buttons - hyperorg. science is now second instead of last, and the first two talks are on Sat while the last four are on Sun. That probably means you don't have to coordinate as much, but you can still do so if you would like to build on other people's talks." + "") + :schedule + (mapconcat + (lambda (o) (format "\"%s\" (%s)\n%s track\n%s\nIn context: %s" + (plist-get o :title) + (plist-get o :slug) + (plist-get o :track) + (replace-regexp-in-string + "^\\(.*\\)\n\\(.*\\)" + "\\1\nIn other timezones:\n\\2" + (string-join + (let ((emacsconf-timezones + (if (plist-get o :timezone) + (seq-uniq (append (list emacsconf-timezone) + (split-string (plist-get o :timezone) " ") + (list "UTC"))) + emacsconf-timezones))) + (emacsconf-timezone-strings o)) + "\n")) + draft-schedule)) + (cdr group) + "\n----------------------------------------------------------------\n") + :reply-by + (format-time-string "%b %-e (%a)" reply-by-date emacsconf-timezone) + :timezone-note + (if (plist-get (cadr group) :timezone) + (format "I've included timezone conversion to %s. Let me know if you'd like me to use a different timezone in future e-mails." + (plist-get (cadr group) :timezone)) + "I can translate times into your local timezone. Let me know what timezone you'd like me to use.") + :availability-note + (cond + ((seq-find (lambda (o) (string-match "yes" (or (plist-get o :availability) ""))) (cdr group)) + (format "I think you've indicated that you're available during the conference.")) + ((seq-find (lambda (o) (string-match "not indicated" (or (plist-get o :availability) ""))) (cdr group)) + (format "I think you didn't indicate any particular availability constraints in your submission.")) + (t (format "I think it respects your indicated availability, which we've noted as %s." + (string-join + (seq-uniq + (mapcar + (lambda (o) (format "\"%s\"" (plist-get o :availability))) + (cdr group))) + " and ")))))))) + + +### Template + +Hi, ${speakers-short}! + +Here’s the tentative schedule for when your EmacsConf talk${plural} +will be streamed. Your talk${plural} will be streamed once, but I’ve +included a few timezone conversions for convenience. --- -— if Q&A will be live or IRC — +${schedule} + +--- + +${availability-note} You’ll also have time for Q&A afterwards, which +can be as short or as long as you like. We’ll send you more +information about how the Q&A will work as the conference gets closer. + +If you’d like to see the other talks for context, you can check out +the draft schedule at <https://emacsconf.org/${year}/draft-schedule/> . +The times may move around a bit as we update the schedule, so I’ll +check in with you if things change a lot. ${coordination-note} -You'll have some time after your talk for Q&A, so the $time minutes can be just for your talk. Of course, if you like, you can make it shorter. +We’d like to publish the schedule this month, so we’d love to hear +from you by **${reply-by}** if the times don’t work for you. (We can +shuffle things around even after that date if something comes up.) +Also, if you think your talk${plural} would go better next to a +different talk, please let us know. ${timezone-note} Please keep +emacsconf-submit@gnu.org in To or Cc when replying. Thanks! + +Sacha + + +### Schedule change affecting dev + +(Please ignore the previous update, I included the wrong times in the +e-mail. The web version’s been fine, though! Sorry about the extra +e-mails.) + +I tweaked the schedule to put treesitter and lspbridge earlier, so +asmblox and wayland are a little later on Saturday morning. If you’d +like to see the latest schedule for your talk, you can go to +<https://emacsconf.org/${year}/draft-schedule/> . Thanks for your +patience! --- -If you want to get a head start on recording your talk, please feel free to do so. We'll be streaming talks at 1920x1280 resolution, so the closer your recording is to that, the easier it will be to process for streaming. .webm format is preferred, but we can convert other formats. $recording has some tips on recording tools and settings that you might find helpful. We'll send you instructions on how to upload files once we get that set up. +${schedule} -We're going to try to caption as many talks as possible again this year, and extra time helps a lot. People found the captions really helpful while watching the stream, and sending your talk in early will make it more likely that we'll be able to get your captions edited and reviewed before the conference. +--- -Could you please reply to this email so that we can confirm that I've got the right email address for you and that messages can get properly delivered? +(no need to reply to this to confirm, unless I broke the schedule for +you and you want me to fix it) -We'll be putting up the public wiki pages for each talk soon using the information from the talk abstract, and we can put $public\_email as the contact information for you. Please let us know by $publish\_date if you would prefer something else. +Sacha -Thank you so much! + +### Schedule change for buddy/meetup + +Hi ${speakers-short}! + +I tweaked the schedule to allocate a little more time for the meetups +talk, and I moved the buddy talk earlier to make space. I think this +might improve the flow as well, since the meetups will refer to how +meeting up with a buddy is a good way to get a public Emacs meetup off +the ground. If you’d like to see the latest schedule for your talk, +you can go to <https://emacsconf.org/${year}/talks/> . Thanks for your +patience! + +--- + +${schedule} + +--- + +(no need to reply to this to confirm, unless I broke the schedule for +you and you want me to fix it) Sacha -### Option B: Just letting them know it's been postponed +## DONE Volunteer communications: E-mail update for Oct 9, 2022 :email:volunteers: + +Add your news and requests to this. + + +### Template so far + +Hello, EmacsConf volunteers! + +We’re starting to gear up for EmacsConf 2022, and we would love to +figure out how to work with your skills, interests, and availability. +<https://emacsconf.org/2022/volunteer/> has some specific task ideas and +general roles. + +<https://emacsconf.org/2022/organizers-notebook/#overall> has an +overall prioritization matrix. If any of those options look like +something you want to learn or help with, or if you want to make +things even better than what’s in the table, let me know. + +Given the number of talks this year, we’re going to try to see if we +can pull off two tracks. I’ve posted a draft schedule at +<https://emacsconf.org/2022/draft-schedule/> and have e-mailed speakers +to confirm their availability. This schedule staggers live Q&A +sessions so that the person managing the streams can jump back and +forth as needed. We’ll figure out shifts once we’ve sorted out the +processes and training info, but if you want to call dibs on +something, feel free. +<https://emacsconf.org/2022/organizers-notebook/#shifts> + +Please let me know what kinds of things you’d like to learn more about +or help out with! + +Sacha Chua + +(You’re receiving this e-mail because you’re on the emacsconf-org +mailing list. Thanks for wanting to help out!) + -Hi, $name! +## DONE Delete all the EmacsConf BBB rooms from last year :chore:bbb:zaeph: -We extended the EmacsConf 2022 call for participation deadline to Sept -30, so speaker notifications will go out on Oct 15 instead. Thank you -for your patience! +For the admins on BBB. The list is accessible here: [Organization Settings](https://bbb.emacsverse.org/b/admins/rooms). +Should take no more than ~20′. + + +## DONE Write volunteer update + +Hello, folks! Here’s the weekly update on what’s happening backstage +for EmacsConf 2022 in case you notice something that you want to help +out with. =) + +- All the speakers have confirmed that they’ve gotten the acceptance + e-mails. Many speakers have confirmed that the schedule works for + them after I reshuffled a few talks for better availability. I’ve + posted the schedule at <https://emacsconf.org/2022/talks/> . We’ll + announce the schedule on the emacsconf-discuss mailing, Reddit, and + various places this week. + +- zaeph has been working on the ffmpeg incantations for preprocessing + the videos that will be submitted soon. bandali is working on + getting the FTP and web-based uploads sorted out so that speakers + can submit their videos. + +- I created some watch pages to support viewing different tracks: + <https://emacsconf.org/2022/watch/> . The livestreams won’t work yet + and it would be nice to figure out something that can dynamically + display info for recent/current/upcoming talks, but it’s a start. + +- We set up a self-hosted Etherpad (ex: + <https://pad.emacsconf.org/2022-journalism>) with an easy way to + redirect to using Wikimedia in case we run into scaling issues. I’ve + added it to our Ansible playbook + (git@git.emacsconf.org:pub/emacsconf-ansible) and I’m looking + forward to incorporating Ry P.’s improvements. Karl Voit gave + feedback on the first draft of the template. + +- vetrivln volunteered for some of the dev hosting shifts, Karl Voit + volunteered for some of the gen pad shifts, and FlowyCoder + volunteered for some of the gen check-in shifts. Thanks! + +Next week, we hope to: + +- Announce the EmacsConf 2022 schedule in the usual places (got any wording/JS/CSS suggestions?) +- Finalize the upload instructions so that speakers can start submitting their files +- Put together volunteer training materials +- Set up per-speaker BBB rooms and friendly URLs Sacha -## Future +## DONE Publish icals :sachac: +It would be nice to have track-specific icals as well. -### Acceptance +### DONE Check icals, create org schedule -#### Code +<https://www.reddit.com/r/emacs/comments/yilmhv/emacsconf_2022_dec_3_4_schedule/ixgt1wr?utm_medium=android_app&utm_source=share&context=3> - (defun conf-summarize-times (time timezones) - (let (prev-day) - (mapconcat - (lambda (tz) - (let ((cur-day (format-time-string "%a %b %-e" time tz)) - (cur-time (format-time-string "%H%MH %Z" time tz))) - (if (equal prev-day cur-day) - cur-time - (setq prev-day cur-day) - (concat cur-day " " cur-time)))) - timezones - " / "))) + +<a id="upload"></a> + +## DONE Figure out web-based file upload :needsowner:sachac:ansible: + +zaeph: I can work on it, but I’m not experienced in this domain, so I’d prefer to be a back-up. +task is currently with bandali + +Lesson learned from last year: “Since people kept running into ftp +problems, we might want to set up a web-frontend next year to minimise +problems.” + +Maybe we could ask some of the volunteers who wanted to help us with +the infra? It shouldn’t be complicated to deploy a ready-made +solution. + +“file drop” is a common keyword for looking for information. +Considerations: + +- Probably run it on media.emacsconf.org +- Bonus features: + - password-protected or hidden behind some kind of authentication or hidden behind some kind of URL, so we don’t have to worry too much about spam + - extra points for sending speakers links to upload to specific folders so that we can separate resources by talk + - Resumable uploads would be good, since some speakers had a hard time with unreliable connections +- What other conferences do: + - LibrePlanet uses plain FTP and recommends FileZilla <https://libreplanet.org/wiki/Video_upload_instructions> + - FOSSDEM uses Pentabarf to receive uploads <https://archive.fosdem.org/2022/manuals/program/speaker/> + - DebConf uses SReview(?) + - FOSSGIS uses Seafile <https://vmx.cx/cgi-bin/blog/index.cgi/video-uploads-for-an-online-conference%3A2021-06-12%3Aen%2Cconference%2Cgeo> +- Some options: + + <table> + + + <colgroup> + <col class="org-left"> + + <col class="org-left"> + + <col class="org-left"> + + <col class="org-left"> + + <col class="org-left"> + </colgroup> + <tbody> + <tr> + <td class="org-left">Project</td> + <td class="org-left">Docker</td> + <td class="org-left">Buster</td> + <td class="org-left">Base</td> + <td class="org-left">Notes</td> + </tr> + + + <tr> + <td class="org-left"><a href="https://www.projectsend.org/">https://www.projectsend.org/</a></td> + <td class="org-left"> </td> + <td class="org-left"> </td> + <td class="org-left">php+mysql</td> + <td class="org-left"> </td> + </tr> + + + <tr> + <td class="org-left"><a href="https://github.com/pomf/pomf">https://github.com/pomf/pomf</a></td> + <td class="org-left"> </td> + <td class="org-left"> </td> + <td class="org-left">php+mysql</td> + <td class="org-left"> </td> + </tr> + + + <tr> + <td class="org-left"><a href="https://github.com/psi-4ward/psitransfer">https://github.com/psi-4ward/psitransfer</a></td> + <td class="org-left">official</td> + <td class="org-left"> </td> + <td class="org-left">node</td> + <td class="org-left">can set upload password, resumable; data volume needs uid 1000</td> + </tr> + + + <tr> + <td class="org-left"><a href="https://github.com/epoupon/fileshelter">https://github.com/epoupon/fileshelter</a></td> + <td class="org-left">official</td> + <td class="org-left">ppa</td> + <td class="org-left">C++</td> + <td class="org-left"> </td> + </tr> + + + <tr> + <td class="org-left"><a href="https://github.com/mickael-kerjean/filestash">https://github.com/mickael-kerjean/filestash</a></td> + <td class="org-left">official</td> + <td class="org-left"> </td> + <td class="org-left"> </td> + <td class="org-left">general FTP client</td> + </tr> + + + <tr> + <td class="org-left"><a href="https://gitlab.com/moejo42/Jirafeau">https://gitlab.com/moejo42/Jirafeau</a></td> + <td class="org-left">official</td> + <td class="org-left"> </td> + <td class="org-left">php</td> + <td class="org-left"> </td> + </tr> + + + <tr> + <td class="org-left"><a href="https://github.com/YouTransfer/YouTransfer">https://github.com/YouTransfer/YouTransfer</a></td> + <td class="org-left">official</td> + <td class="org-left"> </td> + <td class="org-left">node</td> + <td class="org-left">looking for maint</td> + </tr> + + + <tr> + <td class="org-left"><a href="https://github.com/dutchcoders/transfer.sh/">https://github.com/dutchcoders/transfer.sh/</a></td> + <td class="org-left"> </td> + <td class="org-left"> </td> + <td class="org-left"> </td> + <td class="org-left"> </td> + </tr> + + + <tr> + <td class="org-left"><a href="https://github.com/eikek/sharry">https://github.com/eikek/sharry</a></td> + <td class="org-left"> </td> + <td class="org-left"> </td> + <td class="org-left"> </td> + <td class="org-left"> </td> + </tr> + </tbody> + </table> + + - NextCloud + + anon FTP upload currently goes to *srv/ftp/anon* on media.emacsconf.org + + <file:///ssh:media|sudo> + + Maybe I’ll do psitransfer as a direct install + + +### DONE Create 2022/upload.md with the same workflow as last year for a start + + +### DONE Implement new workflow + + +<a id="irc"></a> + +## DONE Update IRC instructions because of multiple tracks + +Added to watch pages + + +<a id="publishing-sched"></a> + +## DONE Move scheduling and publishing code to Emacs on a VPS so that other people can help out :sachac: + +Ideal: + +- Update pages with watching information, additional resources, etc. as talks go live +- Update the schedule as needed (cancelled or reordered talks, etc.) + +Where: + +- front? my own VPS? + + Nice if there’s an Ansible playbook + + sachac’s notes: + <file:///home/sacha/code/docker/emacsconf-publish/> +- probably good to set it up on front + +It’s now on front. + + +## DONE Prepare email for nudging speakers to send prerec, and inform on upload workflow :timesensitive:needsowner: + + +### Code + + (defun emacsconf-mail-upload (group &optional template) + "Send upload instructions and reminder. + GROUP is (email . (talk talk))" + (interactive (list (emacsconf-mail-complete-email-group))) + (let ((action-date (date-to-time "2022-11-04"))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "upload")) + (car group) + (list + :slugs (mapconcat (lambda (o) (plist-get o :slug)) (cdr group) " or ") + :speakers-short (plist-get (cadr group) :speakers-short) + :plural (if (= (length (cdr group)) 1) "" "s") + :email (plist-get (cadr group) :email) + :year (or (plist-get (cadr group) :year) emacsconf-year) + :prerec-note (emacsconf-surround + (make-string 64 ?-) + (string-join (seq-uniq (mapcar + (lambda (o) + (plist-get o :prerec-info)) + (cdr group))) + "\n") + (make-string 64 ?-) + ""))))) + + +### Template + +Hi, ${speakers-short}! + +${prerec-note}Here are the instructions for uploading the +video${plural} for your talk${plural}. You can find the latest version +of the instructions at https://emacsconf.org/2022/upload/ . There are +two ways to upload your talk${plural} this year, so you can pick the +one that works best for you: + +- Web-based: <https://ftp-upload.emacsconf.org> , password emacsconf +- FTP: host: ftp-upload.emacsconf.org, port: 21, username: anonymous + folder: upload-here + +If you upload slides and other resources, we can include them on the +talk page when your talk goes live. If you happen to have a script or +a transcript, please include them as well (it’ll speed up the +captioning for us). + +Please add a comment or start your filenames with the ID for the talk +that it’s for: ${slugs}. + +If you’re still working on your talk, you might find the tips at +<https://emacsconf.org/2022/prepare> useful. In brief: + +- at least 1280x720 resolution +- we recommend dark text on a light background, with enough contrast + to make it easy to read +- if possible, use a headset or external microphone to record audio + in order to minimize computer noise +- upload a separate 5 second recording of quiet or leave 5 seconds + of quiet at the end of your talk video so that we can process your + video for noise reduction + +Please plan to upload your talk by November 4 (next Friday) so that we +can get started preparing it for streaming. If you can’t make it by +then, we can accept later submissions, although it’s a bit more of a +scramble and our stress levels go up as the conference approaches. =) +We’d really appreciate the extra time for captioning and +double-checking. Thank you for your help in getting ready for a smooth +EmacsConf 2022! + +Sacha Chua + + +## DONE Send backstage email + + (defun emacsconf-mail-backstage-info (group &optional template) + (interactive (list (emacsconf-complete-talk-info))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "backstage")) + (plist-get group :email) + (append group + (list + :backstage "https://media.emacsconf.org/2022/backstage/" + :backstage-user "emacsconf" + :backstage-password emacsconf-backstage-password + :conf-name emacsconf-name + :year emacsconf-year)))) + (defun emacsconf-mail-backstage-info-to-speakers-and-captioners () + (interactive) + (let ((template (emacsconf-mail-merge-get-template "backstage")) + (speaker-groups + (seq-uniq + (mapcar + (lambda (talk) + (list + :name (plist-get talk :speakers-short) + :email (plist-get talk :email) + :role "speaker" + :backstage-use + "As we add more talks, you can skim through any relevant ones to + see if there are any points you'd like to build on in your talk. + Also, you can get a sense of what we do behind the scenes to try + to get as many talks captioned for broadcast, and what you can do + to make it easier. (A text file with names and technical terms + can be helpful. No need to type out a manual transcript if you + don't start from a script.) After you upload your talk and we + process the files, you can use the backstage area to check the + quality of the reencoded video.")) + (seq-filter (lambda (o) (string= (plist-get o :status) "WAITING_FOR_PREREC")) + (emacsconf-filter-talks (emacsconf-get-talk-info)))))) + (volunteer-groups + (with-current-buffer (find-file-noselect emacsconf-org-file) + (org-map-entries (lambda () + (list :name (org-entry-get (point) "NAME_SHORT") + :email (org-entry-get (point) "EMAIL") + :role "captioning volunteer" + :backstage-use "If you see a talk that you'd like to caption, you can e-mail me at sacha@sachachua.com and I can reserve it for you.")) + "captions")))) + (mapcar (lambda (g) (emacsconf-mail-backstage-info g template)) + (append + speaker-groups + (seq-remove (lambda (v) (seq-find (lambda (s) (string= (plist-get s :email) + (plist-get v :email))) + speaker-groups)) + volunteer-groups))))) + + +### Template + +Hi ${name}! + +You’re getting this e-mail because you are a ${role} for ${conf-name} +${year}. (Thanks!) + +I’m so excited! =) A number of speakers have uploaded their videos, +and OpenAI Whisper looks like a promising way to get automatically +generated captions that we can use as a starting point. + +We’ve set up ${backstage} as the backstage area where you can view the +videos and resources uploaded so far. You can access it with the +username "${backstage-user}“ and the password ”${backstage-password}“. +Please keep the backstage password and other speakers’ talk resources +secret. ${backstage-use} + +Thank you! + +Sacha Chua + + +## DONE Write playbooks + + +### DONE Host :zaeph: + +<https://emacsconf.org/2022/volunteer/host> + + +### CANCELLED Streamer :zaeph: + +Blocked by [Investigate streaming options, maybe OBS in the cloud](#streaming) + +bandali and corwin/zaeph will do the streaming, so writing the streaming playbook is a little lower priority for now + + +### DONE Check-in + +<https://emacsconf.org/2022/volunteer/checkin/> + + +### DONE IRC + +<https://emacsconf.org/2022/volunteer/irc/> + + +### DONE Pad + +<https://emacsconf.org/2022/volunteer/pad/> + + +### DONE Captions + +<https://emacsconf.org/2022/volunteer/caption/> + + +## CANCELLED Figure out why ikiwiki is slow :infra:wiki: + +complex regular expression issues? +should the captions be outside the wiki? + + +## CANCELLED Add nice-to-have stuff to prepare.md :zaeph: + +- org-reveal config +- SIL fonts choice + + +## DONE Write volunteer update 2022-10-23 :update: + +Hello, folks! Here’s the weekly update on what’s happening backstage +for EmacsConf 2022 in case you notice something that you want to help +out with. =) + +- We’ve e-mailed the speakers instructions for uploading their files through either a web browser or an FTP client, and three speakers have already done so! Those talks are now available in the backstage area (<https://media.emacsconf.org/2022/backstage/>), along with the first set of edited captions (thanks Jai Vetrivelan!). If you don’t have the username and password for the backstage area and you would like to access it, please e-mail me and I’ll send you the details. +- We’ve created a BBB room for each speaker’s live Q&A session. The URLs are in conf.org in the private repository if you need them. +- We’ve drafted some documentation for different volunteer roles. If you’d like to volunteer as a captioner, check-in person (hmm, reception?), Etherpad scribe, IRC monitor, or host, please check out the appropriate link and let me know if I need to add anything to the docs: + - <https://emacsconf.org/2022/volunteer/caption> + - <https://emacsconf.org/2022/volunteer/irc> + - <https://emacsconf.org/2022/volunteer/pad> + - <https://emacsconf.org/2022/volunteer/checkin> + - <https://emacsconf.org/2022/volunteer/host> +- Thanks to David O’Toole for signing up for some IRC shifts! If you would like to volunteer for a shift, check out <https://emacsconf.org/2022/organizers-notebook/#shifts> . +- We’ve updated our streaming configuration for the General and Development tracks, and have started testing them using mpv and the watch pages. Videos aren’t currently streaming, but you can check out the layout of the watch pages at: + + - <https://emacsconf.org/2022/watch/gen/> + - <https://live.emacsconf.org/2022/watch/gen/> + - <https://emacsconf.org/2022/watch/dev/> + - <https://live.emacsconf.org/2022/watch/dev/> + + These pages could probably be a lot prettier and easier to use. If you have some ideas for improving them or if you’d like to work on the HTML/CSS/JS, we’d love your help! +- There are now Q&A waiting rooms with friendly URLs so that it’s easier for people to join the live Q&A when the host decides it’s okay to let everyone in. They’re linked on the watch pages (along with the pads) and they’ll be linked from the talk pages once we’re ready to share them. +- zaeph has been busy tweaking the ffmpeg workflow for reencoding and normalizing videos. Thanks to Ry P. for sharing the res.emacsconf.org server with us - we’ve been using it for all the processing that our laptops can’t handle. +- We experimented with using the OpenAI Whisper speech-to-text toolkit to create the auto-generated captions that captioning volunteers can edit. Looks promising! If you’d like to compare the performance between small, medium, and large models, you can look at the VTT files for the sqlite talk in the backstage area. I’ve also added support for tab-separated values (like Audacity label exports) and a subed-convert command to subed.el, which might give us a more concise format to work with. I’ll work on getting word-level timing data so that our captioning workflow can be even easier. + +Next week, we hope to: + +- improve the prerec and captioning workflows +- get more captions underway + +Lots of good stuff happening! + +Sacha Chua + + +## DONE 2022-10-30 volunteer update + +Hello, everyone! Here’s the weekly update on what’s happening backstage +for EmacsConf 2022 in case you notice something that you want to help +out with. =) + +- Help wanted - Captioning: There are three talks open for captioning + in <https://media.emacsconf.org/2022/backstage/> , so feel free to + e-mail me if you’d like to reserve one. I’ve tweaked the captioning + process a little bit so that I can reflow the transcripts into + shorter subtitles before people edit the captions, so editing is + easier to do because you don’t have to split along the way. (If + you’re curious about the technical stuff, I switched to manually + splitting the text using emacsconf-reflow from emacsconf-el and then + the using aeneas for forced alignment, because I couldn’t figure out + how to get torchaudio unstuck sometimes.) + + If you don’t have the username and password for the backstage area + and you would like to access it, please e-mail me and I’ll send you + the details. + +- Help wanted - tech checks: For sessions with live Q&A, we’d like to + set up tech-checks with speakers to make sure that their setup works + well with BigBlueButton. A rough outline of the process is in the + tech-checking protocol heading at + <https://emacsconf.org/2022/organizers-notebook/#tech-checks> . If you + would like to help with tech-checks, please e-mail us with your + general availability (including timezones) and preferred public + contact information so that we can include you on the list at + <https://emacsconf.org/2022/prepare/#tech-check> and in the e-mail to + speakers. + +- Help wanted - intro/intermission slides, OBS overlay, ??: It might + be interesting to design something to show right before and right + after a talk so that people can see the title, speaker name, talk + page URL, Q&A info, pad URL, pronouns, etc. Ideally we’d be able to + generate a whole bunch of these from the talk data, so maybe SVG or + a TikZ picture? If this is your jam, let us know. + +- OBS in the cloud: We’ve been able to figure out how to stream both + streams using OBS, VNC, and PulseAudio on Ry P.’s virtual server, so + it’s even more likely that we’re going to pull off two tracks this + year. Yay! + +- Tom Purl has joined as a captioning volunteer. Hi Tom! + +This week we hope to get lots of talks submitted, processed, and on +the way to being captioned. We’re also planning to make the captioning +workflow even better, and to improve the OBS streaming workflow. Whee! + +Sacha <sacha@sachachua.com> + + +## Volunteer update 2022-11-07 + +Hi everyone! + +Here’s what’s been happening backstage. + +- Speakers have been submitting their videos, hooray! I added a + schedule to the backstage page at + <https://media.emacsconf.org/2022/backstage/> so that people can see + how the schedule’s coming along. We expect more talks to come in the + next two weeks. Not panicking yet. =) + +- Thanks to all the people who’ve been working on captions so far! + Bhavin, Andrea, and Ramin did the captions for their talks, and Jai + captioned Bala’s talk. Tom, Bhavin, and Hannah are currently working + on captions. There are three more talks backstage if anyone wants to + work on them. + +- I just posted some notes on how I reflow and edit subtitles in case + they’re helpful: + <https://media.emacsconf.org/2022/backstage/editing-captions.html> + It’s also linked from the backstage page under More info: editing + captions. + +- We added the Emacs development updates talk from John Wiegley and + updated the times of other talks based on messages from the + speakers. + +- We did a dry run of the OBS streaming setup with Leo, Amin, and + Corwin. I think we’re on track to being able to broadcast two + streams this year. + +- IRC announcements, BBB redirection, and media file publishing can + now all automatically happen when the talk status changes, + simplifying our work during the conference. Video playback and Q&A + browser windows can happen automatically if streaming from + res.emacsconf.org. I want to get the publishing workflow all + smoothed out too, so that talks and transcripts can be more easily + published to the wiki pages during the conference. + +Plans for this week: + +- More videos and captions! +- I plan to work on talk page publishing so that it happens smoothly during the conference +- Leo’s going to review the videos submitted so far and prepare intros for them +- Might be a good idea to reach out to speakers for tech checks and bios + +EmacsConf is a little less than four weeks away. Stuff is happening! + +Sacha + + +## DONE Send prerec reminder :sachac: + + +### DONE Update logbook with notes from e-mails :sachac: + + +### DONE Follow up with speakers based on their availability + + +### CANCELLED Email speakers because I’ll be shutting down the web upload + + +## DONE Send schedule-published email for emacsconf-discuss :needsowner:timesensitive:email: + +Schedule is now available; post to emacsconf-discuss, emacs-tangents +<https://lists.gnu.org/archive/html/emacsconf-discuss/2022-10/msg00000.html> + + +### DONE Post it to r/emacs as well :reddit:zaeph: + +Please let zaeph know when it’s live so that the post can be distinguished. + + +### Template + +Greetings, fellow Emacsians! + +On behalf of the EmacsConf 2022 organizers team, I’m very excited to +announce the schedule for EmacsConf 2022 (Dec 3 and 4), available at: + +<https://emacsconf.org/2022/talks> + +All of the times listed on the schedule are in EST (UTC-5). You can +click on each talk’s title to open its page for more information, +including its scheduled time in your local time. (Displaying local time +requires running a tiny bit of AGPLv3+-licensed free/libre JavaScript +code, included on the talk pages.) + +For prerecorded talks, this time is also when the talk’s video will be +made available on the same page. Please note that the times are +approximations, and that the schedule may change leading up to the +conference. + +As the conference approaches, we’ll post more details on how to watch +and participate. + +You can subscribe to the emacsconf-discuss mailing list at +<https://lists.gnu.org/mailman/listinfo/emacsconf-discuss> to +be sure you’ll get updates. + +Want to help make EmacsConf even awesomer? Volunteer! +<https://emacsconf.org/2022/volunteer/> + +We hope to see you all around on Dec 3-4 for EmacsConf 2022! + +P.S. please direct all replies to this post either to myself or to the +emacsconf-discuss list, so as to help avoid generating extra off-topic +chatter in the other lists cc’d in this message; thank you. + + +## DONE Flesh out prepare.md for audio-recording tips before the prerec-deadline :zaeph: + + +## DONE Write speaker e-mail for people who have already submitted their talks + +To: speakers who have already submitted their talks (so that we don’t distract people who are still working on their talks) + + (defun emacsconf-mail-speaker-after-video (group &optional template) + (interactive (list (emacsconf-mail-complete-email-group + (seq-filter (lambda (o) (plist-get o :intro-note)) + (emacsconf-active-talks (emacsconf-get-talk-info)))))) + (setq template (or template (emacsconf-mail-merge-get-template "speaker-after-video"))) + (let ((talks (cdr group))) + (emacsconf-mail-prepare + template + (car group) + (list :speakers-short (plist-get (cadr group) :speakers-short) + :plural (if (= (length (cdr group)) 1) "" "s") + :email (plist-get (cadr group) :email) + :in-between (mapconcat (lambda (talk) + (emacsconf-surround "<https://media.emacsconf.org/2022/in-between/" (plist-get talk :slug) ".png>" "")) + (cdr group) + ", ") + :intro + (mapconcat (lambda (talk) + (string-join (org-wrap (emacsconf-surround "- " (plist-get talk :intro-note) "\n" "") 70) "\n")) + (cdr group) + "") + :chapters + (mapconcat (lambda (talk) + (format "<https://media.emacsconf.org/2022/backstage/#%s>:\n%s" + (plist-get talk :slug) + (mapconcat + (lambda (chapter) + (concat (format-seconds "%.2h:%z%.2m:%.2s" + (floor (/ (elt chapter 1) 1000))) + " " + (elt chapter 3) "\n")) + (subed-parse-file + (expand-file-name (concat (plist-get talk :video-slug) "--main--chapters.vtt") emacsconf-cache-dir))))) + (cdr group) + "\n\n") + :caption-note + (if (seq-find (lambda (o) (not (string= (plist-get o :status) "TO_STREAM"))) (cdr group)) + " The captions haven't been fully edited yet, so please ignore any errors in the captions themselves." + "") + :urls + (mapconcat (lambda (o) (concat "<" emacsconf-base-url (plist-get o :url) ">")) + (cdr group) " , ") + :tech-check-note + (if (string-match "live" (or (mapconcat (lambda (o) (or (plist-get o :q-and-a) "")) (cdr group) " ") "")) + (format + "*Tech check* - ;; (assert (string= (conf-replace-plist-in-string '(:test "ABC") "hello ${test} world") "hello ABC world")) + Since you're planning to do a live Q&A session, you may want to + connect to the test BBB room at <%s> to make sure you can share + your audio, your window or screen, and your webcam (optional). Sharing + system audio or multi-monitor setups can sometimes be tricky, so + please let us know if you need help figuring things out. You can + double-check by connecting with a separate device, or you can arrange + to meet with one of the tech-check volunteers + (<https://emacsconf.org/2022/prepare/#tech-check>).${wrap} + " emacsconf-test-bbb-room) ""))) + (add-hook 'message-sent-hook + `(lambda () + (mapc (lambda (o) + (emacsconf-add-to-talk-logbook o "Sent speaker-after-video email")) + (list + ,@(mapcar (lambda (talk) (plist-get talk :slug)) talks)))) + nil t))) - (defun conf-draft-acceptance () + (defun emacsconf-mail-speakers-after-videos () (interactive) - (let* ((mustache-key-type 'keyword) - (sched (org-timestamp-from-string (org-entry-get (point) "SCHEDULED"))) - (attrs - (append (emacsconf-get-talk-info-for-subtree) - :other-notes - (if (org-entry-get (point) "ORG_NOTE") (concat "--- notes ---\n" (org-entry-get (point) "ORG_NOTE") "\n-----\n\n") ""))) - (avail (plist-get attrs :avail))) - (plist-put attrs - :availability - (cond - ((null avail) "I don't think you specified availability when submitting. Would this time be okay with you?") - ((string-match "!avail" avail) "We know this isn't when you've indicated when you'd be available, but will this time be okay for presenting the talk? It's okay to follow up with questions after the event. If you happen to be available, we'd love to have you join us.") - ((string-match "live" avail) "We've scheduled a few minutes for live questions and answers via web conference. Will you be available around this time? If there are more questions, you can also continue over Etherpad/IRC.") - ((string-match "IRC" avail) "Will you be able to join around this time to handle questions over IRC or the pad? If not, we can forward questions to you.") - ((string-match "pad" avail) "Will you be able to join around this time to handle questions over the pad? If not, we can forward questions to you.") - (t avail))) - (plist-put attrs - :time-explanation - (if (<= (string-to-number (plist-get attrs :time)) (string-to-number (plist-get attrs :min-time))) - "Thank you for suggesting an awesome talk of that length!" - "This is less time than you requested, but we've had to make some tough choices to fit all these interesting talks into the schedule. Would it be possible for you to squeeze your talk into that time?")) - (save-excursion - (goto-char (org-find-entry-with-id "acceptance")) - (plist-put attrs :subject (conf-replace-plist-in-string attrs (org-entry-get (point) "ITEM"))) - (org-end-of-meta-data) - (plist-put attrs :body (buffer-substring-no-properties (point) (org-end-of-subtree)))) - (compose-mail - (plist-get attrs :email) - (plist-get attrs :subject) - '(("Reply-To" . "emacsconf-submit@gnu.org") - ("Mail-Followup-To" . "emacsconf-submit@gnu.org")) - nil) - (message-goto-body) - (save-excursion (conf-replace-plist-in-string attrs (plist-get attrs :body))))) + (let* ((info (seq-filter (lambda (o) (plist-get o :intro-note)) + (emacsconf-active-talks (emacsconf-get-talk-info)))) + (grouped (seq-group-by (lambda (o) (plist-get o :email)) info)) + (template (emacsconf-mail-merge-get-template "speaker-after-video"))) + (mapc (lambda (group) + (emacsconf-mail-speaker-after-video group template)) + grouped))) + + +### Template + +Hi, ${speakers-short}! + +Thank you for uploading your video early! Let’s get a few more things +sorted out for a smooth EmacsConf 2022. + +${tech-check-note}\*Intro\* + +I’ve written a brief (and possibly inaccurate! =) ) intro that the +host can read out before your talk while the in-between slide +(${in-between}) is being displayed: + +${intro} + +Would you like to tweak it to better reflect your talk? + +**Chapter markers** + +I’ve added chapter markers to your video in the backstage area to help +with navigation. You can click on them in the backstage area if you +want to easily jump around, or review the list that I’ve included for +your convenience: + +${chapters} +If you prefer other headings or timestamps, please let me know!${caption-note} + +**Bio, community support links** + +People often want to learn more about speakers and show their +appreciation. If you’d like to include an author bio and any +social/support links to your talk page${plural} (${urls}), please +e-mail us the text that you’d like to include. You can also follow the +instructions at <https://emacsconf.org/edit/> to edit your talk +page${plural} directly yourself, if you want to.${wrap} + +Thanks again for all your contributions! + +Sacha + + +<a id="prepare-prerec-process"></a> + +## DONE Prepare for prerecs :zaeph: + + +### DONE Optimize ffmpeg incantation + +Remember to update <../prepare.md> with the new incantation. + + +#### Incantation from last year + + Q=32 + ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -aq-mode 2 -an -tile-columns 0 -tile-rows 0 -frame-parallel 0 -cpu-used 8 -auto-alt-ref 1 -lag-in-frames 25 -g 240 -pass 1 -f webm -threads 8 /dev/null && + ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -c:a copy -tile-columns 2 -tile-rows 2 -frame-parallel 0 -cpu-used -5 -auto-alt-ref 1 -lag-in-frames 25 -pass 2 -g 240 -threads 8 "$2" + + +#### New candidate + +Changelog: + +- Disable adaptive quantization by setting aq-mode to 0 (TODO: compare samples) +- Add `-row-mt 1` needed to support `tile-rows` (2×2 is enough for 720p) +- Also use tiles for first pass +- Remove `-frame-parallel 0` because it’s disabled by default (see [Notes on encoding settings · Kagami/webm.py Wiki](https://github.com/Kagami/webm.py/wiki/Notes-on-encoding-settings)) +- Put number of CPU in variable and use it for `cpu-used` and `threads` +- Stick to default for `auto-alt-ref` +- Stick to default for `lag-in-frames` + + Q=32 + CPU=8 + ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -an -row-mt 1 -tile-columns 2 -tile-rows 2 -cpu-used $CPU -g 240 -pass 1 -f webm -threads $CPU /dev/null && + ffmpeg -y -i "$1" -c:v libvpx-vp9 -b:v 0 -crf $Q -c:a copy -row-mt 1 -tile-columns 2 -tile-rows 2 -cpu-used $CPU -pass 2 -g 240 -threads $CPU "$2" + +Other considerations: + +- We might want to tweak the time before keyframes (`-g`). + + +#### FFMpeg + +<https://img.ly/blog/ultimate-guide-to-ffmpeg/> + + +### DONE Figure out workflow for handling submitted prerecs + +We need time after the prerecs get submitted to: + +- convert the videos and check that they’ve been reencoded properly by watching the re-encoded ones all the way to the end +- caption videos +- capture any extra info +- follow up with missing prerecs + +Make changes in [As prerecorded talks come in](#prerec-process) + + +<a id="intro"></a> + +## DONE Make something to display between talks :akshay196: + +Goals: + +- Reassure people that they’re in the right stream for the talk that they’re looking for +- Direct them to the pad and Q&A for the talk + +What to show in between talks: + +- Previous talk: title, speaker, pronouns, talk page, Q&A information (if still live) +- Next talk: title, speaker, pronouns, talk page, Q&A information, countdown + +<https://media.emacsconf.org/2022/backstage/gen-in-between.pdf> +<https://media.emacsconf.org/2022/backstage/dev-in-between.pdf> + +- Good: Static image, maybe created with LaTeX +- Better: Video with unobtrusive sound so people can doublecheck that their audio works +- Best: Emacs thing so that we can have a dynamic timer and last-minute announcements, and so that it’s Emacs =) +- Even better than that: A compact view that can be overlaid on the Q&A session using OBS + +See break commercials +<https://www.collabmagazine.com/organizing-a-multi-track-virtual-conference-with-microsoft-teams-live-events-a-technical-playbook-and-lessons-learned/> + +OBS scenes (maybe?): + +- splash-screen when we’re on break +- scene when broadcasting a talk (where we might want a logo and a bar or surrounding to broadcast messages like time left in + recording); and +- Q&A scene with host-webcam, optional speaker-webcam, and pad with questions. +- Q&A scene focusing on shared screen from speaker +- Q&A scene with IRC and pad + +Nothing is urgent, blocking it, or being blocked by it, so you can +play around with ideas. + +We’re experimenting with two tracks this year, so we expect that some +people will join midway through a talk or Q&A session and +would like to reorient themselves. Some Q&A sessions may end +early, so we would like to reassure people that they’re in +the right spot for the next talk. Most Q&As will be done +live, but some Q&As will be done over IRC, so we need to +point people to the right place. + +and if there’s room for a little extra info like public e-mail +addresses or pronouns, that can help people when they discuss +things. That info will be in the pad and IRC, though, so it’s +also okay to omit it + +We can programmatically replace strings in +SVG from Emacs, so we can easily use that as an overlay. + +<zaeph> …Or, if you just want to focus on the look of +things, we can think of the content on our own. + +<sachac> oh yeah, totally, you can just focus on the design and use +placeholder text + +Overlay considerations: + +- talk videos will likely have subtitles; no subtitles for Q&A +- zaeph doesn’t like vertical text + + +### DONE Generate talk banners :sachac: + + +<https://gitlab.com/akshay196/emacsconf-artwork/-/blob/main/2022/overlays/src/> + + +### TODO Make a list of different things to plug during commercial breaks, like Mastodon :sachac: + + +### CANCELLED Create a version of in-between that we can use for Q&A, since it’s no longer “Coming Next” + + +## DONE Find volunteers for tech-checks :zaeph: + + +### DONE Add entry in 2022/volunteer.md + + +### DONE Write protocol for adding tech-checker volunteer + +- Invite volunteer to BBB (ask core organizers) +- Update <prepare.md> with new tech-checker info +- Coach tech-checker on the protocol + + +### DONE Write the tech-checking protocol (formerly referred to as “tech-checklist”) + +From previous years: + +> - Can you speak and be heard? Is there echo? +> - Can you hear the organizer? +> - Can you share your screen? Is the screen readable? +> - If you plan to show your keystrokes, is that display visible? +> - If you want to share your webcam (optional), can you enable it? Is it visible? Will there likely be distractions in the background? +> - Can you view the collaborative pad? Will you be comfortable reviewing questions on your own (perhaps by keeping it open beside your shared window), or will you need a volunteer to relay questions to you? +> - Can you share contact information (ex: phone number) so that we can get in touch with you in case of technical issues or scheduling changes? +> - Do you need help finding your way around IRC so that you can check into \`#emacsconf-org\`? What is your IRC nickname? + + +<a id="conforg"></a> + +## DONE Move conf.org management to orga@res.emacsconf.org :sachac: + +so that more people can work with it during the conference +See the publish role in the ansible playbook + + +## DONE Ask speakers for bios or support nudges to include on their talk pages :wiki: + +maybe after we get the prerecs +ex: liberapay, patreon, anyone looking for a job, etc. + + +## DONE Set up BBB rooms and update conf.org :sachac: + +1. Log on to bbb.emacsverse.org as an admin. +2. Create a room. Enable **Mute users when they join**. + + The code below doesn’t quite work, but might be a good starting point for future automation. + + (setq list (seq-drop (emacsconf-bbb-room-title-list) 3)) ; skip some if needed + (progn + (setq name (pop list)) + (kill-new (format "name=\"%s\";$('#create-room-block').click();$('#create-room-name').val(name);$('#room_mute_on_join').click();$('.create-room-button').click();\n" + name)) + (sleep-for 1) + (shell-command "xdotool key alt+Tab sleep 3 key ctrl+v sleep 1 key Return")) + +console.log(JSON.stringify([…document.querySelectorAll(’.delete-room’)].map((o) => { return { name: o.getAttribute(’data-name’), path: o.getAttribute(’data-path’) }}).filter((o) => o.name.match(*^ec22*)))) + +see conf.org for the rest of the process + + +### DONE Add volunteers to the BBB rooms + +- vetrivln: sat-am-dev, sun-am-dev +- FlowyCoder: sat-pm-gen, sun-pm-gen +- jman: sun-pm-gen + + +### DONE Doublecheck mute on join + +[Shifts](file:///home/sacha/proj/emacsconf/wiki/2022/organizers-notebook/index.md) + + list = [...document.querySelectorAll('.room-name-editable')].filter((o) => o.value.match(/^ec22-(sat|sun)/)); + list.reduce(async(prev, elem) => { + await prev; + if (!sessionStorage.getItem(elem.value)) { + return new Promise(async (resolve, reject) => { + card = elem.closest('.card-body'); + card.querySelector('.item-action.dropdown a').click(); + await new Promise(r => setTimeout(r, 1000)); + card.querySelector('.update-room').click(); + await new Promise(r => setTimeout(r, 1000)); + if (!document.querySelector('#room_mute_on_join').checked) { + document.querySelector('#room_mute_on_join').click(); + sessionStorage.setItem(elem.value, true); + await new Promise(r => setTimeout(r, 1000)); + document.querySelector('.update-only.create-room-button').click(); + } else { + sessionStorage.setItem(elem.value, true); + document.querySelector('#createRoomModal').click(); + } + resolve(true); + }); + } + }); + + +<a id="coordinate-volunteers"></a> + +## DONE Coordinate and help volunteers :sachac: + +- <../volunteer> +- Figure out what information volunteers need in order to feel + comfortable signing up for tasks. ex: + <https://wiki.debian.org/DebConf/21/VideoVolunteering> +- Encourage people to sign up for [Shifts](#shifts) + + +### DONE Plan training session(s), Q&A availability, recordings + + +### CANCELLED Hold Q&A session with volunteers + + +### TODO Respond to new volunteers + + +### SOMEDAY Subscribe volunteers to mailing list + + +<a id="streaming"></a> + +## DONE Investigate streaming options, maybe OBS in the cloud :sachac: + +Current status: + +- res.emacsconf.org seems to be able to handle 2x (OBS + TigerVNC + MPV, should test with Firefox as well) +- corwin and jman will stream gen from OBS on res +- bandali will stream dev from his laptop +- let sachac know if you want manual control or more autopilot for the gen stream + +Goals: + +- [X] Be able to start a VNC server with OBS, MPV, and Firefox, connect to it, and stream +- [X] Have another session with the sound isolated +- [-] Split the audio so that we can join the Q&A room before the MPV ends - handled by automatic scene switcher detecting mpv, but we can’t share just a window, so we might as well just wait +- [X] Control MPV from the commandline: track-mpv appears in the correct display, and it can also be controlled via the socket like this: echo ’{ “command”: [“loadfile”, “test2.webm”] }’ | socat - ~/mpv-socket-emacsconf-dev +- [ ] Share the window instead of the desktop? + +Prerequisites: + +- You need to be able to SSH out to res.emacsconf.org on port 46668 + and forward ports, so one of the main organizers needs to add your + SSH public key to the authorized\_keys file. Please e-mail your SSH + public key to sacha@sachachua.com and test that port 46668 is not + blocked. +- For streaming from OBS in VNC, you will need a VNC viewer like + tigervnc-viewer. +- For streaming from your local computer, you will need OBS and FFmpeg. + +During the conference, you will: + +- play the talk video (unless it’s automatically managed by the agenda) and update the overlays +- display intro/intermission information as needed +- open the Q&A windows, like the pad and the BBB room/IRC (unless it’s automatically managed by the agenda) +- adjust the volume if needed +- arrange windows and focus the BBB room on the speaker’s webcam if needed +- if you like, you can be responsible for managing the track from conf.org on orga@res.emacsconf.org + +Dry run checklist: + +- [ ] Connect to the server + ssh orga@res.emacsconf.org -p 46668 + emacsconf # runs emacsclient -c -a emacs +- [ ] Forward ports and connect via VNC +- [ ] Find the OBS or start it if it is not running +- [ ] Start recording +- [ ] Play a video +- [ ] Open two Firefox windows and arrange them +- [ ] Manage windows on the workspace +- [ ] Adjust the volume in OBS +- [ ] SSH to the server and play a video off-screen +- [ ] SSH to the server with X forwarding and adjust the volume off-screen + + +### Broadcasting from local OBS (option A) + +- You can copy the profile from your track or look inside it for the icecast mount point details: + - Gen: rsync -avze ’ssh -p 46668’ emacsconf-gen@res.emacsconf.org:~/.config/obs-studio/basic/profiles/ ~/.config/obs-studio/basic/profiles/ + - Dev: rsync -avze ’ssh -p 46668’ emacsconf-dev@res.emacsconf.org:~/.config/obs-studio/basic/profiles/ ~/.config/obs-studio/basic/profiles/ + +- Sacha will turn off the OBS recordings on res so that you can test streaming from your computer + - If you’re doing this independently, you can jump ahead to “Connecting to VNC” in order to stop the recording yourself + +- Verify with MPV: + + mpv https://live0.emacsconf.org/gen.webm + mpv https://live0.emacsconf.org/dev.webm + +- With luck, the 480p streams will be up automatically as well + + mpv https://live0.emacsconf.org/gen-480p.webm + mpv https://live0.emacsconf.org/dev-480p.webm + + +### Connecting to VNC (option B) + +1. Stop broadcasting locally if you were testing local OBS. + +2. Install a VNC viewer on your system (ex: tigervnc-viewer). + +3. Set up your local environment: + - gen: export TRACK=gen; export TRACK\_PORT=5905; export SSH\_PORT=46668 + - dev: export TRACK=dev; export TRACK\_PORT=5906; export SSH\_PORT=46668 + +4. Copy the password: + + scp emacsconf-$TRACK@res.emacsconf.org:~/.vnc/passwd vnc-passwd-$TRACK -p $SSH\_PORT + +5. Forward your local ports and connect via VNC viewer to the + appropriate forwarded port from your laptop: + + ssh emacsconf-$TRACK@res.emacsconf.org -N -L $TRACK_PORT:127.0.0.1:$TRACK_PORT -p $SSH_PORT & + sleep 5 # Give it time to establish the tunnels + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & + + (If this doesn’t find a VNC server to connect to, you can start it with `ssh emacsconf-$TRACK@res.emacsconf.org -p $SSH_PORT /home/emacsconf-$TRACK/bin/track-vnc`) + +6. Start **recording** (not streaming). If you don’t see OBS when you connect, it’s probably on workspace 2, so you can switch with Alt-2. If you still don’t see it there, you can open a terminal with Alt-Enter and then run `track-obs`. After you start recording, confirm that it is now broadcasting to the stream. + +7. Verify with MPV on your local system: + + mpv https://live0.emacsconf.org/$TRACK.webm & + +8. With luck, the 480p streams will be up automatically as well. On your local system: + + mpv https://live0.emacsconf.org/$TRACK-480p.webm & + +9. Play a video. It should display the video and update the overlays. If you need to update the overlays manually, you can copy files from `/data/emacsconf/overlays` onto `$HOME/other.png` and `$HOME/video.png`. + + You can play a video with `play video-id` (ex: `play meetups`), or you can specify the filename (ex: ~play ~/stream/emacsconf-2022-meetups\*.webm). + + termit: Ctrl-Shift-t makes a new tab + + i3 cheat sheet: + + - Alt-Enter creates a terminal + - Alt-d runs a command + - Alt-e toggles horizontal/vertical split + - Alt-f toggles full-screen + - Alt-w switches to tabbed view + - Alt-1 switches to workspace 1, Alt-2 switches to workspace 2 + - Alt-Shift-2 moves things to workspace 2 + - Alt-Shift-Left moves the current window to the left + - Alt-Shift-Right moves the current window to the right + +10. Test Q&A. You can either wait for the video to finish or quit it with “q”. + You can paste in the URLs or use + `firefox /data/emacsconf/2022/index-$TRACK.html` + +11. Test adjusting the audio + - `ssh emacsconf-$TRACK@res.emacsconf.org -p 46668` + - Then use `qa-louder`, `qa-quieter`, or `qa-vol vol%` (ex: `qa-vol 90%`) + +Other notes and tips: + +- You can use Emacs for emergency or ad-hoc announcements. +- Use OBS or `pavucontrol` to adjust the volume of BBB as needed. You might be able to manage `pavucontrol` off-screen with `ssh emacsconf-$TRACK@res.emacsconf.org -X -p $SSH_PORT pavucontrol`. +- You can also `ssh emacsconf-$TRACK@res.emasconf.org -p 46668` and start new processes from the command-line, such as using `track-mpv`. If you specify commands when you call SSH instead of using an interactive shell, you may need to also specify DISPLAY=:5 (for the gen track) or DISPLAY=:6 (for the dev track), since ssh won’t pick up the variables from `.bashrc`. +- If you have a Wayland-only desktop without any X11 compatibility layer (example: [Sway](https://swaywm.org) with `xwayland disable`) the suggested software (`tigervnc`) might no work. You can use instead for example `gnome-remote-desktop`. The password for the VNC connection can be retrieved from the file `vnc-passwd-$TRACK` (3DES encrypted). + + +### Managing the stream from the agenda (option B2) + +ssh orga@res.emacsconf.org -p $SSH\_PORT +emacsconf # runs emacsclient -c -a emacs + +You can then use + +- emacsconf-stream-play-video +- emacsconf-stream-open-qa-windows-on-change +- emacsconf-agenda-by-track +- emacsconf-agenda + +If things are going well, you can use C-c C-t on the agenda view to change a talk to PLAYING, CLOSED\_Q, or OPEN\_Q, and various things should happen in the background. If they don’t happen in the background, use emacsconf-add-org-after-todo-state-change-hook to add the todo state change hook, then try again. + +Task state shortcuts for C-c C-t: + +- **m (mpv):** PLAYING - -stream-play-video, emacsconf-stream-set-talk-info, publish the files to the media directory +- **q (Q&A):** CLOSED\_Q +- **o (open):** update the BBB redirect URLs to let people into the room +- u (unstreamed) +- r (to archive) + +You can leave the emacsclient with `C-x 5 0` + + +#### Do Q&A + +From the emacsclient on orga@res.emacsconf.org, you can open various talk-related things: + +- emacsconf-stream-open-pad +- emacsconf-stream-join-qa +- emacsconf-stream-join-chat + +Alternatively, you can switch to the VNC viewer and use the links in +<file:///data/emacsconf/2022/index-gen.html> or +<file:///data/emacsconf/2022/index-dev.html> . + +For Q&A, you may want to have the Etherpad on the left, the BBB Q&A or +IRC chat on the right, and the terminal and OBS windows on +workspace 2. + + +### Other tasks as needed + + +#### Display emergency news / announcements + +M-x emacsconf-stream-broadcast to send a message to both streams +or M-x emacsconf-stream-set-news to send a message to one stream. + +If that doesn’t work, edit the news file directly with: +`ssh emacsconf-$TRACK@res.emacsconf.org > ~/news.txt` + +If that doesn’t work, use the VNC session to switch to an Emacs window +and type your message in. + + +#### Kill the VNC server: + +ssh emacsconf-$TRACK@res.emacsconf.org “vncserver -kill” + +<table> + + +<colgroup> +<col class="org-left"> + +<col class="org-left"> +</colgroup> +<tbody> +<tr> +<td class="org-left">~/bin/track-obs</td> +<td class="org-left">start OBS with the track’s profile and scene collection</td> +</tr> + + +<tr> +<td class="org-left">~/bin/track-mpv file.webm</td> +<td class="org-left">play the file using the track’s sink</td> +</tr> +</tbody> +</table> + + +#### Making OBS scenes + +Making OBS scenes is pretty straightforward as you can move the +different blocks on your scene in the preview window. However, it’s +important to make sure that your video-captures and your overlays are +snapping properly to the edges of the view-port. To do this, make sure +to right-click on the block inside the preview window, and try the +different fitting options (fit by width, height, etc.) until you find +one that works best. + +We’ll probably be streaming at 720p, but since we’re also considering +a 1080p update, try to create your overlays in a format or a resolution +that would support resizing. + + +### Other notes + +There are sockets in the home directory for MPV control if you want to keep that process. +echo ’{ “command”: [“loadfile”, “test2.webm”] }’ | socat - ~/mpv-socket-emacsconf-dev + + +### DONE Test and document command-line way of managing audio :sachac: + + +### DONE Move my conf.org setup to res so that we can control everything from there + + +### DONE Set timers for changing todo state + + (defun emacsconf-schedule-test-buffer (info) + (mapcar (lambda (o) (plist-put o :buffer "1") o) info)) + (let ((emacsconf-schedule-strategies '(emacsconf-schedule-test-buffer))) + (emacsconf-stream-schedule-timers (emacsconf-schedule-prepare + (emacsconf-schedule-inflate-sexp + `(("Test gen" :start ,(format-time-string "%Y-%m-%d %H:%M" + (time-add (current-time) (seconds-to-time 60)))) + (journalism :time "1") + (school :time "2") + (handwritten :time "1") + ("Test dev" :start ,(format-time-string "%Y-%m-%d %H:%M" + (time-add (current-time) (seconds-to-time 60)))) + (treesitter :time "2") + (lspbridge :time "1") + (asmblox :time "1")))))) + +the dev one worked, but the gen one gets +Couldn’t find local shell prompt for /bin/sh +Tramp: Opening connection **Async Shell Command** for emacsconf-gen@res.emacsconf.org using ssh…failed + +Maybe I need to stagger them, or maybe I need to use a shell command. +Changed to call ssh directly instead of using tramp. + + +### DONE Figure out how to work with the layout + +<https://i3wm.org/docs/layout-saving.html> + + +### DONE Allow per-track configuration of todo hooks :sachac: + +emacsconf-todo-hooks + + +### CANCELLED Use xdotool to automate joining BBB in Firefox (signing in, clicking on listen only) + + +#### DONE Xdotool over ssh so that I can click things? + + +### CANCELLED Experiment with sharing part of the screen so that there’s space for us to work a little off-screen + +We might just have to rely on xdotool to move windows the way we want them +Window fixes that didn’t work + +- <https://obsproject.com/forum/threads/solved-window-capture-black-screen.47082/> +- <https://www.reddit.com/r/obs/comments/kas5ka/obs_window_capture_xcomposite_black_screen/> + + +### DONE Set up scenes and try them + + +### DONE Set up text source for URL + + +### DONE Create Ansible tasks for setting up sinks for MPV and Firefox for the streams, and adding the scenes appropriately + + +### DONE See if I can even Ansible-up the rest of the tasks + +like starting up Firefox and mpv and everything + + +### CANCELLED obs-websocket control of OBS on the server + +so that the streamer can adjust volume offscreen? + + +### DONE document such that someone else could use/fix it + + +### DONE recruit at least one more person to help operate the “video bouncer” + + +### Other notes + +- bandali doesn’t have much cognitive bandwidth at the moment, so we can keep things simple with OBS on laptops + +- Issue: zaeph was dropping frames and couldn’t pay attention to as many things as he wanted +- Issue: corwin needs assistance to not be locked in his chair for the whole conf. Premptively, zaeph can do it by broadcasting OBS scenes via the rtmp (instead of just his webcam). +- With a long day, we may want to be able to schedule hosts/streamers/publishers in shifts +- Ideal: Easy reproducible setup to spin up an OBS VM with scenes set up, allowing multiple users to connect to it at the same time. Maybe x2go or vnc? VMs with 8 vCPUs and a vGPU cost more, so it would be good to figure out what’s needed, spin it down, and then spin it up maybe the day before or something like that. +- Plus points if we can control the OBS via password-protected websocket so we can tell it to switch scenes (and even more points if we do so from Emacs, maybe via that obs-websocket.el ;) ). MPV is also controllable via IPC, so we can use the same MPV player and then switch videos around. Maybe mpvc? <https://unix.stackexchange.com/questions/664728/how-can-i-control-mpv-in-command-line> +- Probably Linode’s Dedicated 32 GB + RTX6000 GPU x1 at $1.50 an hour for 2-3 days + dev time, since live.emacsconf.org is in Linode as well +- We should also look into normalization across the board, especially if we have BBB participants. pipewire + easyeffects on the box might be the easiest way to do it. + +- <https://docs.vdo.ninja/> +- Live Streaming using low configuration vps <https://www.youtube.com/watch?v=3iBYYgkG1eM&t=953> +- <https://snowmix.sourceforge.io/Examples/input.html> +- <https://www.google.com/url?sa=t&source=web&rct=j&url=https://m.youtube.com/watch%3Fv%3D1y-DUYiECWQ&ved=2ahUKEwjPru_TqOv6AhVMkokEHXL9Dm4QtwJ6BAgqEAI&usg=AOvVaw17mbCEiFL6dGVY4YEBufcy> +- [OBS Studio 26.0 | Hacker News](https://news.ycombinator.com/item?id=24633139) +- <https://github.com/mviereck/x11docker#sound> +- <https://vcs.fsf.org/?p=streamdesktop.git;a=tree> +- <https://opensource.com/article/20/5/conference-free-software> +- <https://github.com/soonum/hubangl> +- <https://obsproject.com/forum/threads/run-obs-on-vm-in-the-cloud.122543/> + + +### DONE Automate in-between display? + +[Think about what to do with schedule gaps due to cancelled talks](file:///home/sacha/proj/emacsconf/wiki/2022/organizers-notebook/index.md) + +emacsconf-stream-display-clock-and-countdown + + +#### SOMEDAY Redo in-between slides + + +#### DONE Automatically display in-between slide if there’s no recorded intro + +Okay, what’s the tricky part here? + +todo status triggers playing, so things have to be non-interactive +intro needs to be manual + +- if manual intro + - open the in-between page + - streamer types “play slug” manually +- if recorded intro + +Gen: + +<table> + + +<colgroup> +<col class="org-left"> + +<col class="org-left"> + +<col class="org-left"> +</colgroup> +<tbody> +<tr> +<td class="org-left"> </td> +<td class="org-left">recorded intro</td> +<td class="org-left">live intro</td> +</tr> + + +<tr> +<td class="org-left">recorded talk</td> +<td class="org-left"><span title="(emacsconf-stream-play-intro "school")">school</span>; play automatically</td> +<td class="org-left"><span title="(emacsconf-stream-play-intro "workflows")">workflows</span>; show in-between, host intros over mumble, streamer types “play slug”</td> +</tr> + + +<tr> +<td class="org-left">live talk</td> +<td class="org-left"><span title="(emacsconf-stream-play-intro "journalism")">journalism</span>; play intro automatically, join bbb</td> +<td class="org-left"><span title="(emacsconf-stream-play-intro "survey")">survey</span>; join bbb, no in-between slide</td> +</tr> +</tbody> +</table> + +Dev: + +[async]((emacsconf-stream-play-intro "async")) + + +#### DONE Make sure recorded intros play + +<(emacsconf-stream-play-talk-on-change "school")> should play intro + video +<(emacsconf-stream-play-video "health")> should play video (no recorded intro) + +dev: +<(emacsconf-stream-play-talk-on-change "treesitter")> should play intro + video + + +### DONE Separate mumble audio so that panic button can still bring in our audio + + +### DONE Prepare for rms talk and Q&A with bandali + +Mumble? + + +#### DONE Reflow and edit VTT for RMS TEDx talk so that things are on one line + +<file:///home/sacha/proj/emacsconf/lisp/emacsconf-stream.el> + + +### DONE Add panic button to OBS settings + +Ctrl-Shift-M? + + +### DONE Add background music to server :emacsconf: + +zaeph suggests using shoshin’s music + +if ! screen -list | grep -q background; then + screen -S track-mpv ~/stream/background.wav & +fi + + +### DONE Make it easy to rebroadcast other track (ex: rms) - might need mpv with minimal configuration, switchable profiles + + +#### DONE make it easy to rebroadcast + + +<a id="caption-workflow"></a> + +## DONE Smoothen captioning workflow :sachac: + +It looks like OpenAPI needs a little less editing in terms of +capitalization and punctuation, but it produces longer captions +(likely a 30-second sliding window). I’ll try to upload both YT and +OpenAPI captions so that people can decide what they like. + +[Set up MPV for captions](#mpv-captions) + + +### DONE Make sure all the captioned files are marked so + + (seq-keep (lambda (o) + (when (and (string= (plist-get o :status) "TO_STREAM") + (or (null (plist-get o :captions-edited)) + (null (with-temp-buffer + (insert-file-contents + (expand-file-name (concat (plist-get o :video-slug) "--main.vtt") + emacsconf-cache-dir)) + (goto-char (point-min)) + (re-search-forward "captioned by" (line-end-position) t))))) + (plist-get o :slug) + )) + (emacsconf-get-talk-info)) + + +### DONE Edit survey captions + + +### DONE Edit dbus captions + + +### DONE Figure out why it’s choking on SRV2 + +Can I use aeneas for alignment instead? + +Reflow the .txt file and reupload to res if needed +call ../run-aeneas.sh from the directory with the opus or ogg and the txt file + +sachac@res-https://emacsconf.org/2022/talks/~/current/meetups$ python3 -m aeneas.tools.execute\_task emacsconf-2022-meetups–attending-and-organizing-emacs-meetups–bhavin-gandhi–main.opus reflowed.srt “task\_language=eng|os\_task\_file\_format=json|is\_text\_type=subtitles” output.json + +I might try out lhotse and torchaudio someday, but it’s low priority. aeneas seems to do a reasonable job of + + +### DONE Move publishing the backstage index to res so that we can trigger it after the files are uploaded + + +### DONE Compare large, medium, and small models + +12 threads + +Original file: 21:16 21 minutes + +<table> + + +<colgroup> +<col class="org-left"> + +<col class="org-right"> + +<col class="org-right"> + +<col class="org-left"> +</colgroup> +<tbody> +<tr> +<td class="org-left"> </td> +<td class="org-right">Hours</td> +<td class="org-right">Mult</td> +<td class="org-left">Notes</td> +</tr> + + +<tr> +<td class="org-left"><a href="https://media.emacsconf.org/2022/backstage/emacsconf-2022-sqlite--using-sqlite-as-a-data-source-a-framework-and-an-example--andrew-hyatt--large.vtt">Large</a></td> +<td class="org-right">2:49</td> +<td class="org-right">8</td> +<td class="org-left"> </td> +</tr> + + +<tr> +<td class="org-left"><a href="https://media.emacsconf.org/2022/backstage/emacsconf-2022-sqlite--using-sqlite-as-a-data-source-a-framework-and-an-example--andrew-hyatt--medium.vtt">Medium</a></td> +<td class="org-right">2:03</td> +<td class="org-right">5.9</td> +<td class="org-left"> </td> +</tr> + + +<tr> +<td class="org-left"><a href="https://media.emacsconf.org/2022/backstage/emacsconf-2022-sqlite--using-sqlite-as-a-data-source-a-framework-and-an-example--andrew-hyatt--small.vtt">Small</a></td> +<td class="org-right">0:40</td> +<td class="org-right">2</td> +<td class="org-left">More run-on sentences</td> +</tr> +</tbody> +</table> + +Large and medium might do better on a system with a GPU. I’ll default to the small model for now. + + +### DONE Commit subed-tsv so that people can try a cleaner output + + +### DONE Investigate more granular timestamps for the output from OpenAPI Whisper + +<https://git.emacsconf.org/emacsconf-ansible/tree/roles/caption/templates> + + +### DONE Upload srv2 from YouTube for word-level + + +### CANCELLED Compare with Google Cloud Speech API + +~/code/speech + + +### DONE E-mail for bringing new captioning volunteers onboard + + (defun emacsconf-mail-backstage-intro (volunteer &optional template) + (interactive (list (emacsconf-complete-volunteer))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "backstage-intro")) + (assoc-default "EMAIL" volunteer 'string=) + (list + :backstage "https://media.emacsconf.org/2022/backstage/" + :backstage-user "emacsconf" + :backstage-password emacsconf-backstage-password + :conf-name emacsconf-name + :year emacsconf-year + :name (assoc-default "NAME_SHORT" volunteer 'string=) + :email (assoc-default "EMAIL" volunteer 'string=)))) #### Template -Dear ${name}, +Hi ${name}! + +Thank you for volunteering for ${conf-name} ${year}! + +We’ve set up ${backstage} as the backstage area where you can view the +videos and resources uploaded so far. You can access it with the +username "${backstage-user}“ and the password ”${backstage-password}“. +Please keep the backstage password and other speakers’ talk resources +secret. + +For some ideas on ways to help, you can check out +<https://emacsconf.org/2022/volunteer/> . You can also suggest other +things you might be interested in. + +You can ask questions or chat with other volunteers by e-mailing the +mailing list at emacsconf-org@gnu.org or dropping by #emacsconf on the +libera.chat IRC network. You can also e-mail me or +emacsconf-org-private@gnu.org if you have private questions. + +Thank you again for your help! =) + +Sacha Chua + -We would love to have your talk "${title}" as part of EmacsConf -${year}, and we've allocated ${time} minutes for it. ${time-explanation} +### DONE E-mail for bringing new captioning volunteers onboard -Your talk is tentatively scheduled for ${scheduled}. The times -may move around a bit as we update the schedule, so we'll check in -with you if things change a lot. ${availability} + (defun emacsconf-mail-captioning-intro (volunteer &optional template) + (interactive (list (emacsconf-complete-volunteer) + (emacsconf-mail-merge-get-template "captioning-intro"))) + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "captioning-intro")) + (assoc-default "EMAIL" volunteer 'string=) + (list + :backstage "https://media.emacsconf.org/2022/backstage/" + :backstage-user "emacsconf" + :backstage-password emacsconf-backstage-password + :conf-name emacsconf-name + :year emacsconf-year + :name (assoc-default "NAME_SHORT" volunteer 'string=) + :email (assoc-default "EMAIL" volunteer 'string=)))) -${other-notes}Please plan to prerecord your ${time}-minute -talk(s) by Sunday ${prere-date} at the latest. If you can, please send -it in as early as possible. Submitting your video early lets us ask -volunteers to help caption the video, making your talk more accessible -and searchable. -You can check out <https://emacsconf.org/${year}/prepare/> for tips on -preparing and recording your talk. If you have questions or concerns, -please let us know. +#### Template -Thanks, +Hi ${name}! + +Thank you for volunteering to help with the captions for ${conf-name} +${year}! Last year, we were able to get almost all the talks captioned +in time for streaming. Participants found them very useful for +understanding different technical terms, names, accents, and so on. +We’d love to be able to pull that off again this year, and it would be +great to have you on board. + +We’ve set up ${backstage} as the backstage area where you can view the +videos and resources uploaded so far. You can access it with the +username "${backstage-user}“ and the password ”${backstage-password}“. +Please keep the backstage password and resources secret. If you see a +talk that you’d like to caption, you can e-mail me at +sacha@sachachua.com and I can reserve it for you. Then you can correct +any misrecognized words, fix capitalizations, remove filler words as +needed, and so on. + +You’ll probably want to work with either the VTT or the TXT versions +(VTT is WebVTT format and has timestamps), but you can check the other +talk resources in case the speaker has posted scripts or other useful +things. Both VTT and TXT are plain text, so feel free to use your +favourite text or subtitle editor. I’ve posted a brief demo of how I +edit captions at +<https://media.emacsconf.org/2022/backstage/editing-captions.html> , and +you can find more captioning tips at <https://emacsconf.org/captioning/> +. You can convert it to whatever format you like. If you prefer to +work with plain text, we can figure out the timestamps afterwards. + +Let me know if you want to reserve a talk for captioning or if you have +any questions or suggestions. We’re also in the #emacsconf-org channel +on the libera.chat IRC network, which you can connect to with your +favourite IRC client or through the web-based interface at +<https://chat.emacsconf.org/> . Sacha Chua -EmacsConf organization team -P.S. Please keep emacsconf-submit@gnu.org in To or Cc when replying. +### DONE Support cue IDs in subed-vtt.el + + +### CANCELLED jiwer · PyPI - measure error rate + +<https://pypi.org/project/jiwer/> + + +### SOMEDAY Think about flow for YouTube captions + +are they at the right length? + + +### DONE Check captions for rms talk + + +### TODO Try whisper.cpp + +commented out `-mavx` to get it to compile in Debian on res + +ffmpeg -y -i emacsconf-2022-rmsted–main.ogg -acodec pcm\_s16le -ac 1 -ar 16000 emacsconf-2022-rmsted–main.wav +/usr/src/whisper.cpp/main -f emacsconf-2022-rmsted–main.wav -m models/ggml-large.bin -ovtt -otxt + + +### DONE edit rms tedx captions, they’re not actually edited! + + +### DONE realign subtitles if needed, looks like aeneas options need tweaking + + (seq-keep + (lambda (file) + (let ((subtitles (subed-parse-file file)) + gaps) + (while (cdr subtitles) + (setq gaps (cons (- (elt (cadr subtitles) 1) (elt (car subtitles) 2)) + gaps)) + (setq subtitles (cdr subtitles))) + ;; if there are gaps more than + (let ((big-gaps (seq-filter (lambda (gap) (> gap 100)) gaps))) + (when big-gaps + (list (file-name-base file) + (length big-gaps) + (apply #'max big-gaps))))) + ) + (directory-files emacsconf-cache-dir t "--main.vtt$") + ) + + +### SOMEDAY ggerganov/whisper.cpp: Port of OpenAI’s Whisper model in C/C++ -### Acknowledge pre-rec submission +<https://github.com/ggerganov/whisper.cpp> - (defun emacsconf-acknowledge-submission () + +### TODO Move the captioning stuff to the public area + + +### TODO Look into getting the confidence intervals out of aeneas, maybe by getting it as an XML + +Also look into finetuneas + + +### SOMEDAY A Deep Dive Exploration Applying OpenAI’s Whisper ASR To A PBS NewsHour Broadcast – The GDELT Project + +<https://blog.gdeltproject.org/a-deep-dive-exploration-applying-openais-whisper-asr-to-a-pbs-newshour-broadcast/> + + +### SOMEDAY Confidence scores for each word? - Discussion #284 - openai/whisper + +<https://github.com/openai/whisper/discussions/284> + + +### SOMEDAY jianfch/stable-ts: Stabilizing timestamps of OpenAI’s Whisper outputs down to word-level + +<https://github.com/jianfch/stable-ts> + + +### SOMEDAY See if we can get confidence data out of whisper + + +### SOMEDAY Use bbb events to identify speaker changes and overlapping spans that might need closer attention + + +### SOMEDAY Getting Started with Bacalhau | Bacalhau Docs + +<https://docs.bacalhau.org/getting-started/installation> + + +### SOMEDAY Use OpenAI Whisper and Bacalhau to transcribe audio and video files | Nerd For Tech + +<https://medium.com/nerd-for-tech/how-to-use-bacalhau-and-openai-whisper-to-transcribe-a-youtube-video-7b6ee0135ce2> + + +### SOMEDAY A Deep Dive Exploration Applying OpenAI’s Whisper ASR To A Russian Television News Broadcast – The GDELT Project + +<https://blog.gdeltproject.org/a-deep-dive-exploration-applying-openais-whisper-asr-to-a-russian-television-news-broadcast/> + + +### SOMEDAY Benchmarks for T4 & V100 GPUs, comparison with human captioning, and deep dive on non-deterministic output · Discussion #395 · openai/whisper + +<https://github.com/openai/whisper/discussions/395> + + +### SOMEDAY Pointers for running this on a GPU via a cloud service? · Discussion #398 · openai/whisper + +<https://github.com/openai/whisper/discussions/398> + + +### SOMEDAY How to chunk text into paragraphs using python | by N Polovinkin | Medium + +<https://medium.com/@npolovinkin/how-to-chunk-text-into-paragraphs-using-python-8ae66be38ea6> + + +## DONE Find a way to accommodate a specific return-speaker + +We’re not sure if we’re going to get a presentation or a prerec for them +this year, but we need to keep this at the back of our minds. + +Note on how DebConf handled incidents: +<https://www.mail-archive.com/search?l=debconf-team@lists.debian.org&q=subject:%22Re%5C%3A+DebConf+21+Incident+Response%22&o=newest&f=1> + + +## DONE Write check-in email :sachac: + + +### DONE Switch all the rooms to allow anyone to start them - one less step for the check-in person + + //list = [...document.querySelectorAll('.room-name-editable')].filter((o) => o.value.match(/^ec22-(sat|sun)/)); + card = document.querySelector('a[href=\"%s\"] .card-body'); + card.querySelector('.item-action.dropdown a').click() + card.querySelector('.update-room').click() + if (!document.querySelector('#room_anyone_can_start').checked) { + document.querySelector('#room_anyone_can_start').click(); + } + document.querySelector('.update-only.create-room-button').click(); + +okay, next thing, it automatically refreshes. so I can’t run the whole Javascript, I need to xdotool it. + + (setq list (mapcar (lambda (o) (plist-get o :bbb-room)) (emacsconf-get-talk-info))) + (setq list (seq-drop list (seq-position list "https://bbb.emacsverse.org/b/sac-rvc-kd2-pev"))) + (progn + (setq item (pop list)) + (when (string-match "/b/\\(.*\\)" item) + (kill-new (format "card = document.querySelector('a[href=\"%s\"] .card-body'); + card.querySelector('.item-action.dropdown a').click() + card.querySelector('.update-room').click() + if (!document.querySelector('#room_anyone_can_start').checked) { + document.querySelector('#room_anyone_can_start').click(); + } + document.querySelector('.update-only.create-room-button').click(); + " + (match-string 0 item))) + (sleep-for 2) + (shell-command "xdotool key alt+Tab"))) + +Relying on xdotool seems a little fragile. Let’s just check the page +itself for the next one that needs to be done. + + list = [...document.querySelectorAll('.room-name-editable')].filter((o) => o.value.match(/^ec22-(sat|sun)/)); + list.reduce(async(prev, elem) => { + await prev; + if (!sessionStorage.getItem(elem.value)) { + return new Promise((resolve, reject) => { + card = elem.closest('.card-body'); + card.querySelector('.item-action.dropdown a').click(); + card.querySelector('.update-room').click(); + sessionStorage.setItem(elem.value, true); + setTimeout(function() { + if (!document.querySelector('#room_anyone_can_start').checked) { + document.querySelector('#room_anyone_can_start').click(); + document.querySelector('.update-only.create-room-button').click(); + } else { + document.querySelector('#createRoomModal').click(); + } + resolve(true); + }, 500); + }); + } + }); + + +### DONE Update checkin instructions + + +### Templates + +Goals: + +- Ask speaker verify their scheduled time + It has already been confirmed with them, but it might have changed slightly + - HOW: They should check the time at the top of their talk page on the day of the conference +- Double-check Q&A preference, encourage tech checks for live talks/Q&A + - If they are available: + - Direct to tech-checks via <https://emacsconf.org/${year}/prepare/> + - Inform them of the check-in process + - They come say hi to us 30’ before their session in #emacsconf-org or #emacsconf (they can use chat.emacsconf.org ) + - We get them set up in a room where they can wait until the end of the broadcast of their pretention + - They’re joined by the streamer and host. +- Warning about potential emergency changes + +Slightly more complex because of the conditionals + + (defun emacsconf-mail-checkin-instructions (group &optional template) + "Send checkin instructions. + GROUP is (email . (talk talk))" + (interactive (list (emacsconf-mail-complete-email-group + (seq-filter + (lambda (o) + (or + (string= (plist-get o :status) "CANCELLED") + (null (plist-get o :email)) + (string-match "after" (or (plist-get o :q-and-a) "")))) + (emacsconf-get-talk-info))))) + (let* ((talks (seq-remove + (lambda (o) + (or + (string= (plist-get o :status) "CANCELLED") + (null (plist-get o :email)) + (string-match "after" (or (plist-get o :q-and-a) "")) + (save-window-excursion + (emacsconf-with-talk-heading o + (re-search-forward "checkin instructions" (save-excursion (org-end-of-subtree)) t))))) + (cdr group))) + (waiting-talks (seq-find (lambda (o) (string= (plist-get o :status) "WAITING_FOR_PREREC")) talks))) + (when talks + (emacsconf-mail-prepare + (or template (emacsconf-mail-merge-get-template "checkin-at-conf")) + (car group) + (list + :year emacsconf-year + :base-url emacsconf-base-url + :conf-name emacsconf-name + :email (plist-get (car talks) :email) + :emergency emacsconf-emergency-contact + :plural (if (> (length (cdr group)) 1) "s" "") + :speakers-short (plist-get (car talks) :speakers-short) + :url (mapconcat (lambda (o) (concat emacsconf-base-url (plist-get o :url))) + talks" , ") + :waiting + (cond + ((> (length waiting-talks) 1) + " If you can upload your talk videos before the conference, I think that might be much less stressful for everyone than doing it live. =) Please note that we will turn off the web-based upload on Dec 1 to free up memory on the server, so please upload them as early as you can.${wrap}") + ((= (length waiting-talks) 1) + " If you can upload your talk video before the conference, I think that might be much less stressful for everyone than doing it live. =) Please note that we will turn off the web-based upload on Dec 1 to free up memory on the server, so please upload it as early as you can.${wrap}") + (t "")) + :checkin-info + (mapconcat + (lambda (o) + (let ((base-checkin (format-time-string "%b %-d %-l:%M %p" (plist-get o :checkin-time) emacsconf-timezone)) + (speaker-checkin (format-time-string "%b %-d %-l:%M %p" (plist-get o :checkin-time) (plist-get o :timezone)))) + (emacsconf-replace-plist-in-string + (append (list :base-url emacsconf-base-url + :check-in + (concat + "Before " + base-checkin " in " emacsconf-timezone + (if (string= base-checkin speaker-checkin) + "" + (concat + ", which is the same as " speaker-checkin " in " (plist-get o :timezone))) "\n" + " (this is " (plist-get o :checkin-label) ")") + :qa-info-speakers + (cond + ;; aaaaah, no prerec yet + ((string= (plist-get o :status) "WAITING_FOR_PREREC") + (concat "Talk and Q&A BigBlueButton room: " (plist-get o :bbb-room))) + ((null (plist-get o :q-and-a)) "") + ((string-match "live" (plist-get o :q-and-a)) (concat "Q&A BigBlueButton room: " (plist-get o :bbb-room))) + ((string-match "irc" (plist-get o :q-and-a)) (concat "Q&A: " (plist-get o :channel) " (" (plist-get o :webchat-url) ")")) + ((string-match "pad" (plist-get o :q-and-a)) "Q&A: On the pad") + (t "Q&A: After the event"))) + o) + "- ${title} + Info and sched: ${base-url}${url} + Check-in: ${check-in} + Pad: ${pad-url} + ${qa-info-speakers}"))) + talks "\n\n"))) + (mapc (lambda (o) + (emacsconf-mail-log-message-when-sent o "Sent checkin instructions")) + talks)))) + + +#### E-mail for speakers who are planning to be at the conference + +Hello, ${speakers-short}! + +We’re looking forward to having you join us at EmacsConf! + +We’ve updated the schedule based on the submissions and cancellations, +and we’ll probably update the schedule even on the day of the +conference. You can get a rough idea of your schedule on your talk +page${plural}. You might want to check your talk page${plural} some time next +week to get a rough sense of where it is, and then check it again on +the day of your talk${plural}. Please let me know if the times don’t +work for you. + +We’ll try our best to keep your talk in the same general timeslot (ex: +Saturday morning, Saturday afternoon, Sunday morning, Sunday +afternoon). We’ve done some dry-runs, but just in case it turns out +that running two tracks at the same time leaves us too frazzled, we +may drop back to one track with Q&A on an alternate stream, like last +year. If there are big changes to your schedule on the day of your +talk${plural}, you’ll get an e-mail from us with a subject like +“URGENT: EmacsConf 2022: …”.${wrap} + +Here’s your talk page URL and checkin information: + +${checkin-info} + +Please check in early so that we can deal with scheduling changes or +technical issues, and so that we don’t worry too much about whether +you’ll be ready to go for Q&A. =) You can find the check-in process at +${base-url}${year}/speakers/ .${waiting} + +If something comes up, please let us know as soon as you can. Here’s +my emergency contact information: ${emergency} + +Thank you for sharing your time and energy with the EmacsConf community! + +Sacha + +p.s. If you need to cancel, that’s okay too, life happens. Let me know +as soon as you can and I’ll try to shuffle things around. Thank you! + + +#### E-mail for speakers who are not planning to be around, but who have sent us their prerecs + +Hello, ${name}! + +Thank you so much for contributing a talk for EmacsConf ${year}! We’re +looking forward to collecting questions and forwarding them to you by +e-mail after the conference. We’ll also post the prerecording at the +time that it gets streamed, so people will be able to access it at +${url} once it has gone live. + +If it turns out that you can make it to the conference after all, feel +free to drop us a line at #emacsconf-org and we’ll let people know +you’re around. You can find the check-in process at +<https://emacsconf.org/${year}/speakers/> . + +Thank you again for being part of EmacsConf ${year}! + +Sacha + + +### CANCELLED Draft e-mail to send speakers who may need to do it live + + +### DONE Make sure IRC talks get BBB checkin information if they need to do it live :mail: + +survey, orgyear, lspbridge, eev, python + + +<a id="one-track"></a> + +## Plan in-case-of-emergency schedule for dropping back to one track after Saturday morning :sachac:derisk: + +We might be able to do it on a modular basis (Saturday afternoon, Sunday morning, or Sunday afternoon). +We need a quick way to notify the affected speakers, and we should give them a heads-up as well. +We also need a quick way to update the schedule. + + +### DONE Update conf.org and the wiki based on the selected emergency schedule + + +### DONE Give speakers a heads-up regarding schedule tweaks and the potential for bigger schedule changes + + +### DONE Draft the code for mailing all the affected speakers + + +### Saturday afternoon + +-  + + +### Sunday morning + +- rms: Ends at 12:15 after 12:00 +-  + + +### Sunday afternoon + +-  + + +### DONE Get the emergency schedule sorted out so that we can easily switch to it + +To change, set emacsconf-schedule-apply to t +M-x emacsconf-update-schedule +Commit the wiki and push it +Draft the e-mail for emergency schedule + + +### DONE Draft e-mail for emergency schedule + + (defun emacsconf-mail-emergency-update (group &optional template) + "Send emergency schedule update. + GROUP is (email . (talk talk))" + (interactive (list (emacsconf-mail-complete-email-group))) + (setq template (or template (emacsconf-mail-merge-get-template "emergency"))) + (emacsconf-mail-prepare + template + (car group) + (list + :urls (mapconcat (lambda (o) (plist-get o :absolute-url)) (cdr group) " , ") + :emergency emacsconf-emergency-contact + :conf-name emacsconf-name + :year emacsconf-year + :email (plist-get (cadr group) :email) + :plural (if (= (length (cdr group)) 1) "" "s") + :schedule + (mapconcat + (lambda (o) + (concat "Talk: " (plist-get o :title) "\n" + "URL: " (plist-get o :absolute-url) "\n" + "New start of talk: " + (format-time-string + "%b %-e %-I:%M %#p %Z" + (plist-get o :start-time) + emacsconf-timezone) + "\n" + (if (string= emacsconf-timezone (plist-get o :timezone)) + "" + (concat + "which is the same as " + (format-time-string + "%b %-e %-I:%M %#p %Z" + (plist-get o :start-time) + (plist-get o :timezone)))))) + (cdr group) + "\n\n")))) + + +#### Template + +Sorry about the last-minute change. We needed to update the schedule +because two tracks turned out to be too much for us to handle at the +moment. The new schedule will play all the talks on one stream, and +the other stream will handle Q&A. + +Here’s a copy of the updated schedule for your convenience: +${schedule} + +Please check in at least 30 minutes before your talk (or 60 minutes if +you’re going to do it live). <https://emacsconf.org/2022/speakers/> has +more details. + +You can also find the new schedule at the page URL${plural} above. +Please let me know if you can’t make it. We can collect the questions +and you can follow up afterwards. You can reach me by e-mail or in +\#emacsconf-org on IRC, or with this emergency contact info: +${emergency} + +Thank you for your patience! + +Sacha + + +## DONE Manage front0 and live0 size :bandali: + + +### DONE Resize front0 and live0 in the Linode administration console :bandali: + +[20:23:48] <bandali> aha okay thanks. yeah i think i’ll do at least 8gb or 16gb for front0, maybe even one or two larger +[20:24:19] <bandali> and for live0 probably the same as last year, maybe slightly larger + + +### CANCELLED Check fps after resize :sachac: + + +### DONE Back up dumps from live0 + +media.emacsconf.org:~/emacsconf-2021-stream-dumps/ +res.emacsconf.org:/data/emacsconf/2021/dumps/ + +Now there should be more space in case we want to enable dumping before the resize + + +### DONE Update ansible configuration :sachac: + +Waiting for resize +Clean up the media root + +in all.yml + +test\_mode: false + +then + +ansible-playbook -i inventory.yml prod-playbook.yml –tags media +ansible-playbook -i inventory.yml prod-playbook.yml –tags stream +ansible-playbook -i inventory.yml prod-playbook.yml –tags publish + +Confirm that + +- icecast dumps recordings +- <https://media.emacsconf.org/2022> is unprotected +- <https://media.emacsconf.org/2022/backstage> is protected + + +<a id="comms"></a> + +# Communications + + +## DONE Ask emacsconf-org-private for feedback on early submissions + +The EmacsConf 2022 CFP was extended to Sept 30 with notifications to +go out on Oct 15. We’ve got plenty of submissions and with any luck, +you’ve been reviewing them as they come in (assuming you have access to +emacsconf-submit@). + +As a courtesy to people who got their stuff together in a timely manner +and to give them extra time to prepare a prerecorded talk (which might +also translate into extra time for us to process and caption the talks), +I’d like to send acceptances and tentative time allotments by Sept 30. +I plan to offer a max of 20 minutes with a note that additional time may +be available for Q&A depending on how many additional submissions we get. + +Could everyone who wants a say in the program please add comments to +$url by ****Sept 26**** so that we can send out early acceptances? In +general, we try to say yes to everything, so here’s your chance to +raise any red flags or suggest ways to make things even better. +Thanks! + +Sacha + + +<a id="acceptance"></a> + +## DONE Acceptance :sachac: + +We can accept early or send people a note saying notification of acceptance will be on Oct 15, because of the extended CFP. +Right before this e-mail: + +- Publish the wiki pages + +Objectives for this e-mail: + +- Notify people of acceptance +- Tell them the number of minutes to plan for\* (might get more) +- Tell them about the target date +- Get them to reply +- Ask for public contact information or any changes to the wiki page + + + (defun emacsconf-draft-acceptance-for-email-group (group &optional template) + "GROUP is (email . (talk talk))." + (interactive (list (emacsconf-mail-complete-email-group))) + (let* ((template (or template (emacsconf-mail-merge-get-template "acceptance"))) + (talks (cdr group)) + (first (car talks)) + (reply-by-date (date-to-time "2022-10-08")) + (prerec-target (date-to-time "2022-11-04")) + (attrs `(:speakers-short + ,(plist-get first :speakers-short) + :plural + ,(if (= (length talks) 1) "" "s") + :email + ,(plist-get first :email) + :year + ,(or (plist-get first :year) emacsconf-year) + :reply-date + ,(format-time-string "%b %-e (%a)" reply-by-date) + :titles + ,(mapconcat (lambda (o) (format "\"%s\" (%s)" + (plist-get o :title) + (plist-get o :slug))) + talks " and ") + :prerec-target + ,(format-time-string "%b %-e (%a)" prerec-target) + :page-urls + ,(mapconcat (lambda (o) (concat "- " (plist-get o :url))) + talks "\n") + :irc + ,(if (plist-get first :irc) (concat (plist-get first :irc) "? ") "") + :acceptance-tasks + ,(concat + "* TODO Reply to acceptance e-mail in order to confirm e-mail communication :emacsconf: + DEADLINE: " (format-time-string "<%Y-%m-%d %a>" reply-by-date) "\n Please include any extra information you want (ex: public e-mail, IRC nick) on\n" + (mapconcat (lambda (o) (concat " " (plist-get o :url))) + talks "\n") "\n" + (mapconcat (lambda (o) (format "* TODO Record %s-minute talk for \"%s\" (%s) :emacsconf: + DEADLINE: %s\n https://emacsconf.org/%s/prepare/" + (plist-get o :time) + (plist-get o :title) + (plist-get o :slug) + (format-time-string "<%Y-%m-%d %a>" prerec-target) + (plist-get o :year))) + talks "\n")) + :talk-details-and-comments + ,(mapconcat + (lambda (o) + (format "%s minutes: %s\n%s\n\n%s" + (plist-get o :time) + (plist-get o :title) + (plist-get o :url) + (string-fill (emacsconf-replace-plist-in-string + (append o + (list + :prerec-target (format-time-string "%b %-e" prerec-target))) + (plist-get o :acceptance-comment)) 72))) + talks "\n---------------------------------------------------------------------\n")))) + (emacsconf-mail-prepare template (car group) attrs))) + + (defun emacsconf-draft-all-acceptances () (interactive) - (let ((files (directory-files "captions" t (regexp-quote (org-entry-get (point) "VIDEO_SLUG")))) - (page (format "https://emacsconf.org/%s/talks/%s" conf-year (org-entry-get (point) "SLUG"))) - (slug (org-entry-get (point) "VIDEO_SLUG"))) - (emacsconf-mail-speaker - "Thanks for sending us your prerecorded video for EmacsConf ${year}!" - (concat - "Hi! Just a quick note to let you know that I've downloaded your submission for \"" (org-entry-get (point) "ITEM") "\".\n" - (format "\nNow we have the following file%s starting with %s:\n%s" - (if (= (length files) 1) "" "s") - slug - (mapconcat (lambda (f) - (format "- %s (%s, md5: %s)\n" - (replace-regexp-in-string slug "" (file-name-nondirectory f)) - (file-size-human-readable (file-attribute-size (file-attributes f))) - (string-trim (shell-command-to-string (concat "md5sum " (shell-quote-argument f) " | cut -f 1 -d ' '"))))) - files "")) - (format "A quick check shows that it's about %d minutes long.\n" - (ceiling - (/ (compile-media-get-file-duration-ms - (seq-find (lambda (o) (member (file-name-extension o) subed-video-extensions)) - files)) - 60000.0))) - "\nWe'll be working on captioning it over the next few weeks. We'll e-mail again a little closer to the conference with schedule updates and other useful information. If you want to upload a new version, you can upload it the same way you did the previous one.\n\n" - "Please feel free to e-mail us at emacsconf-submit@gnu.org if you need help updating the talk wiki page at " page " or if you have other questions.\n\n" - "Thank you so much for all the work you put into preparing a talk for EmacsConf ${year}, and thank you for submitting the prerecorded video before the conference!\n\nSacha")))) + (let* ((emacsconf-talk-info-functions (append emacsconf-talk-info-functions '(emacsconf-get-talk-comments-from-subtree))) + (info (seq-filter (lambda (o) (string= (plist-get o :status) "TO_ACCEPT")) + (emacsconf-filter-talks (emacsconf-get-talk-info)))) + (grouped (seq-group-by (lambda (o) (plist-get o :email)) info)) + (template (emacsconf-mail-merge-get-template "acceptance"))) + (mapc (lambda (group) + (emacsconf-draft-acceptance-for-email-group group template)) + grouped))) + + +### Speaker acceptance + +Hi, ${speakers-short}! + +Summary: +,${acceptance-tasks} + +We’ve accepted your EmacsConf proposal${plural} for ${titles}! Thanks +for volunteering to share what you’re learning about. I know it takes +a fair bit of work to prepare a presentation, so I appreciate that +you’re taking the time to show what’s possible with Emacs and +encourage people to learn more. + +--- + +${talk-details-and-comments} + +--- + +You’ll have some time after your talk${plural} for Q&A, so the allocated time +can be just for your pre-recorded talk${plural}. Of course, if you like, you +can make it shorter. + +We’ve posted preparation tips at <https://emacsconf.org/${year}/prepare/> . +We’ll send you instructions on how to upload files once we get that +set up. + +Could you please plan to ****put your pre-rec${plural} together by +${prerec-target}**** (or even earlier if you want)? We’re going to try +to caption as many talks as possible again this year, and extra time +helps a lot. People found the captions really helpful while watching +the stream, and sending your talk in early will make it more likely +that we’ll be able to get your captions edited and reviewed before the +conference. + +****Please reply to this e-mail by ${reply-date}**** (doublechecking that +emacsconf-submit@gnu.org is in the To: or Cc:) so that we can confirm +that we’ve got the right email address for you and that messages can +get properly delivered. Also, would you like us to put ${email} as the +public contact information for you, or would you like us to add +something else to the talk page${plural}? + +${page-urls} + +If you have any questions, please e-mail us at +emacsconf-submit@gnu.org or pass by the #emacsconf-org IRC channel on +irc.libera.chat (Web-based: <https://chat.emacsconf.org/#/connect>). + +Thank you so much! + +Sacha Chua + + +## Future ### Captions for approval + +#### Template + Hi ${speakers-short}! -Because you sent in your video early, we were able to caption it so -that more people can find and enjoy your talk. ${captioner} -volunteered to caption your talk video, and here it is. I've attached -the caption text file in case you want to review it, suggest any -corrections, or use the text in a blog post or elsewhere. You can look -at the attached file or watch your video with closed captions at -${url} . Thanks again for your contribution! +Because you sent in your video before the conference, we were able to +caption it so that more people can find and enjoy your talk. +${captioner-volunteered} I’ve attached the caption text file in case +you want to review it, suggest any corrections, or use the text in a +blog post or elsewhere. You can look at the attached file or watch +your video with closed captions at ${url} . I’ve also included the +captions at the end of this e-mail for your convenience.${wrap} -Sacha +${chapters-note}${intro-note}Do you have a bio or social/donation links you’d like us +to add to the wiki page for your talk? + +Thanks again for your contribution! +${captioner-thanks}Sacha -### Speakers we haven't confirmed e-mail communications with +${captions} + + +### Speakers we haven’t confirmed e-mail communications with Hi, ${name}! -I think we haven't heard from you since we accepted your EmacsConf -${year} proposal for "${title}". EmacsConf coming up soon, so I wanted -to check in with you to see how you're doing. +I think we haven’t heard from you since we accepted your EmacsConf +${year} proposal for "${title}“. EmacsConf coming up soon, so I wanted +to check in with you to see how you’re doing. -Could you please e-mail us to let us know if you're still working on -your prerecorded video, if you're planning to present live, or if you -can't make it this year? No worries if other priorities have come up -and you don't have the time for a presentation. +Could you please e-mail us to let us know if you’re still working on +your prerecorded video, if you’re planning to present live, or if you +can’t make it this year? No worries if other priorities have come up +and you don’t have the time for a presentation. -If you've been working on a presentation, fantastic! When you're +If you’ve been working on a presentation, fantastic! When you’re ready, you can upload it following the instructions at <https://emacsconf.org/${year}/prepare/> (ideally before ${prerec-date} so that we have time to download it, doublecheck, etc.). If you plan to present live, please go through the self-check at <https://test.bigbluebutton.org/> . Some speakers have encountered -technical issues with BigBlueButton that they didn't have with Zoom or +technical issues with BigBlueButton that they didn’t have with Zoom or Google Meet, so this is something we definitely want to look into earlier rather than later. If that works for you, please e-mail us back so that I can keep your timeslot. The tentative schedule for your talk is on the talk page at ${url} . -**Please e-mail us your plans before ${date}.** I'm +**Please e-mail us your plans before ${date}.** I’m planning to shift the schedule around to give more time to confirmed -speakers for Q&A and possibly live demos. If I don't hear from you by +speakers for Q&A and possibly live demos. If I don’t hear from you by then (maybe an over-enthusiastic spam filter has been swallowing up -all our mail?), I'll probably reallocate the ${time} minutes that had +all our mail?), I’ll probably reallocate the ${time} minutes that had been set aside for your talk. We might be able to squeeze it back in afterwards or play a video from you at the end of the conference day, but it would be nice to get the schedule sorted out instead of @@ -1536,9 +7930,9 @@ Sacha Chua Hi ${speakers}, -EmacsConf is in a few days and I don't think we have your prerecorded -video yet, so I'm getting miiiildly stressed about the schedule. And -you're probably stressing out about it too, so let's go figure out how +EmacsConf is in a few days and I don’t think we have your prerecorded +video yet, so I’m getting miiiildly stressed about the schedule. And +you’re probably stressing out about it too, so let’s go figure out how we can make this work. Option A: If you happen to have the prerecording or can get it done by @@ -1548,11 +7942,11 @@ ftp-upload.emacsconf.org by following the instructions in your favourite file-sharing service (especially if FTP is giving you problems). -Option B: If you want to present live, it might be an option. I'm a little -worried about the potential for technical issues, since we've had +Option B: If you want to present live, it might be an option. I’m a little +worried about the potential for technical issues, since we’ve had problems with that in previous EmacsConfs. The tight schedule means -there's not a lot of time to figure things out, and it can be hard to -make something as focused as a prerecorded video when you're doing it +there’s not a lot of time to figure things out, and it can be hard to +make something as focused as a prerecorded video when you’re doing it live. We will definitely want to make sure that: - your self-serve tech check works: <https://test.bigbluebutton.org> @@ -1564,12 +7958,12 @@ live. We will definitely want to make sure that: <https://emacsconf.org/${year}/schedule/> on the day of the conference. If there are technical issues or your talk runs a little over time, we -might have to stop streaming it on the main stream when it's time for +might have to stop streaming it on the main stream when it’s time for the next talk. We may be able to continue streaming it on the alternate stream. If so, people can continue watching it there if they wish to. -Option C: If you can't make it, that's okay. Life gets crazy +Option C: If you can’t make it, that’s okay. Life gets crazy sometimes. Please let us know and we can update the wiki. If you happen to be able to make a prerecorded video afterwards, we can add that to the wiki, playlists, and announcements. We hope you can join @@ -1577,8 +7971,8 @@ us next year. Since EmacsConf is **this weekend** (aaaaaaah), please let us know by tomorrow noon EST (Friday; 9AM PST, 5PM GMT, 6PM CET) so that we can -keep the time allocated for you in the schedule. If we don't hear from -you, we'll probably reallocate the ${time} minutes reserved for you so +keep the time allocated for you in the schedule. If we don’t hear from +you, we’ll probably reallocate the ${time} minutes reserved for you so that other talks can have longer Q&A. If you can still make it, check in early and let us know so that we can try to work out an alternate stream for you. Hope to hear from you soon! @@ -1586,123 +7980,6 @@ stream for you. Hope to hear from you soon! Sacha -### Check-in instructions - -Goals: - -- Ask speaker verify their scheduled time - It has already been confirmed with them, but it might have changed slightly (give-or-take 30' - - HOW: They should check the time at the top of their talk page on the day of the conference -- Double-check Q&A preference, encourage tech checks for live talks/Q&A - - If they are available: - - Direct to tech-checks via <https://emacsconf.org/${year}/prepare/> - - Inform them of the check-in process - - They come say hi to us 30' before their session in #emacsconf-org or #emacsconf (they can use chat.emacsconf.org ) - - We get them set up in a room where they can wait until the end of the broadcast of their pretention - - They’re joined by the streamer and host. - - -#### Code - -Slightly more complex because of the conditionals - - (defun emacsconf-mail-checkin-instructions () - (interactive) - (seq-map - (lambda (list) - (let ((template (with-current-buffer (find-file-noselect emacsconf-org-file) - (emacsconf-mail-merge-get-template (car list))))) - (seq-map - (lambda (email-list) - (let* ((email (car email-list)) - (talks (cdr email-list)) - (combined-info (emacsconf-combine-plist talks " , ")) - (for-mail - (list - :name (or (car (plist-get combined-info :speakers)) "???") - :url (or (string-join (plist-get combined-info :url) " , ") "???") - :email (car (plist-get combined-info :email)))) - (body (when (plist-get for-mail :email) (emacsconf-replace-plist-in-string for-mail (plist-get template :body)))) - (subject (when (plist-get for-mail :email) (emacsconf-replace-plist-in-string for-mail (plist-get template :subject))))) - (when (plist-get for-mail :email) - (compose-mail - (plist-get for-mail :email) - subject - `(("Reply-To" . ,(plist-get template :reply-to)) - ("Mail-Followup-To" . ,(plist-get template :mail-followup-to)) - ("Cc" . ,(plist-get template :cc)))) - (message-goto-body) - (save-excursion - (insert body))))) - (cdr list)))) - ;; Group by e-mail - (seq-map - (lambda (list) - (cons (car list) (seq-group-by (lambda (o) (plist-get o :email)) (cdr list)))) - ;; Group by q-and-a pref - (seq-group-by - (lambda (o) - (pcase (plist-get o :q-and-a) - ('nil "checkin-unknown") - ((pred (string-match "after")) "checkin-after") - ((pred (string-match "live\\|irc\\|pad")) "checkin-at-conf") - (_ "checkin-unknown"))) - (emacsconf-filter-talks (emacsconf-get-talk-info)))))) - - (defun emacsconf-cancel-mail-merge () - (interactive) - (mapc (lambda (buffer) - (when (string-match "unsent" (buffer-name buffer)) - (let ((buffer-modified-p nil)) (kill-buffer buffer)))) - (buffer-list))) - - -#### E-mail for speakers who are planning to be at the conference - -Hello, ${name}! - -We're looking forward to having you join us at EmacsConf! - -We'll probably keep updating the schedule even on the day of the -conference. You can get a rough idea of when your talk is scheduled at -${url}. You might want to check it some time next week to get a rough -sense of where it is, and then check it again on the day of your talk. - -Please check in at least 30 minutes before the scheduled start of your -prerecorded talk so that we can deal with small scheduling changes or -technical issues. You can find the check-in process at -<https://emacsconf.org/${year}/speakers/> . - -If something comes up, please let us know as soon as you can. Here's -our emergency contact information: - -${emergency} - -Looking forward to seeing you soon! - -Sacha - - -#### E-mail for speakers who are not planning to be around, but who have sent us their prerecs - -Hello, ${name}! - -Thank you so much for contributing a talk for EmacsConf ${year}! We're -looking forward to collecting questions and forwarding them to you by -e-mail after the conference. We'll also post the prerecording at the -time that it gets streamed, so people will be able to access it at -${url} once it has gone live. - -If it turns out that you can make it to the conference after all, feel -free to drop us a line at #emacsconf-org and we'll let people know -you're around. You can find the check-in process at -<https://emacsconf.org/${year}/speakers/> . - -Thank you again for being part of EmacsConf ${year}! - -Sacha - - ### Last email before the conference > Friends, emacsians, hackers, lend me your ears! @@ -1758,17 +8035,17 @@ Sacha Hi ${speakers-short}! Thank you so much for being part of EmacsConf ${year}! Hundreds of people -enjoyed it, and I'm sure even more will come across the videos in the +enjoyed it, and I’m sure even more will come across the videos in the days to follow. Your prerecorded video is available on the talk page at ${url} , and -we've added the questions and comments that we've collected from +we’ve added the questions and comments that we’ve collected from IRC/BBB/Etherpad. ${qa-note} -We've also uploaded your talk video to ToobNix (a PeerTube +We’ve also uploaded your talk video to ToobNix (a PeerTube instance) at ${toobnix-url} and YouTube at ${youtube-url} . If you want to reupload the video to your own channel, feel free to do so. -${subtitle-note} If you let me know where you've uploaded +${subtitle-note} If you let me know where you’ve uploaded it, I can switch our playlist to include your version of the video instead. That way, it might be easier for you to respond to comments on videos. @@ -1795,11 +8072,11 @@ how to send in your proposal(s), or chat with us about them and about other ways of participating and volunteering around EmacsConf via our main IRC channel #emacsconf on the Libera.Chat network. -If you're considering submitting a proposal but think the remaining +If you’re considering submitting a proposal but think the remaining time may not be enough, please reach out to me off-list as soon as possible so we could work something out. -I'll close this portion of the email with a thank you to all of the +I’ll close this portion of the email with a thank you to all of the folks who have submitted session proposals or expressed interest in volunteering with EmacsConf. We look forward to reading and reviewing all of your messages and proposals, and getting back to you about them @@ -1810,7 +8087,7 @@ amin P.S. please direct any replies to this post either to myself or to the emacsconf-discuss list, so as to help avoid generating extra off-topic -chatter in the other lists cc'd on this message. Thank you. +chatter in the other lists cc’d on this message. Thank you. ### DONE First announcement: CFP @@ -1830,7 +8107,7 @@ and running the conference, including reviewing session proposals and streaming parallel tracks. To get involved, please come by our IRC channel or one of our public mailing lists (see below) and introduce yourself and tell us about your interests, or contact myself or one of -the other organizers directly if you're feeling a bit shy; we hope to +the other organizers directly if you’re feeling a bit shy; we hope to hear from you! :) Best, @@ -1838,7 +8115,7 @@ amin P.S. please direct any replies for this message either to me or to the emacsconf-discuss list, so as to help avoid generating extra off-topic -chatter in the other lists Cc'd on this message. Thank you. +chatter in the other lists Cc’d on this message. Thank you. <a id="code"></a> @@ -1883,6 +8160,9 @@ chatter in the other lists Cc'd on this message. Thank you. "Protect user from dangerous FORMS by skipping them." `(emacsconf-danger--shield nil ,@forms)) + ;; Make it easy to jump and refile + (setq-local org-refile-targets '((nil . (:maxlevel . 5)))) + (message "General setup has been loaded") (emacsconf-danger-shield @@ -1891,7 +8171,6 @@ chatter in the other lists Cc'd on this message. Thank you. (message "No longer asking for confirmation in this buffer") (setq-local emacsconf-danger-allow-dangerous-stuff t) - (org-babel-ref-resolve "elisp-no-confirmation()") (message "Now allowing dangerous stuff. Buckle up, buckaroo!") @@ -1900,10 +8179,155 @@ chatter in the other lists Cc'd on this message. Thank you. (kill-local-variable 'emacsconf-danger-asked) (kill-local-variable 'org-confirm-babel-evaluate) (kill-local-variable 'org-confirm-elisp-link-function) + (kill-local-variable 'org-refile-targets) (message "Back to safety. Phew!") +## Prerecs + + +### Receive notification when new prerecs are available + + #!/usr/bin/env sh + + set -eu + + sleep_duration=600 + + data="$(basename "$0" ".sh").data" + + plural () { + if [ "$2" = 1 ] || [ "$2" = -1 ]; then + echo "${1}" + else + case $1 in + "is" ) + echo "are" + ;; + * ) + echo "${1}s" + esac + fi + } + + current_time() { + date +"[%T]" + } + + log() { + printf "%s $1\n" "$(current_time)" + } + + color_green="\e[32m" + color_white="\e[0m" + + log2() { + log "${color_green}$1${color_white}" + } + + notify() { + log2 "$1" + notify-send -t 0 "EmacsConf" "$(log "$1")" + } + + _sleep() { + log "Checking again in ${sleep_duration}s" + sleep "$sleep_duration" + } + + fetch() { + TERM=xterm ssh orga@media.emacsconf.org -- ls -1 /srv/upload | wc -l + } + + clean() { + rm -f "$data" + log "Data file has been cleaned" + } + + if [ "$#" -gt 0 ]; then + command="$1" + if [ "$command" = "clean" ]; then + clean + exit 0 + fi + + if [ "$command" = "clean-start" ]; then + clean + fi + fi + + touch "$data" + + log2 "Currently waiting for prerec" + + while true; do + prerecs_number_past=$(cat "$data") + diff=0 + + while true; do + log "Checking..." + prerecs_number_current="$(fetch)" + diff=$((prerecs_number_current - prerecs_number_past)) + if [ $diff -gt 0 ]; then + break + fi + log "No new prerec" + _sleep + done + + notify "$diff new $(plural "prerec" $diff) $(plural "is" $diff) available!" + + echo "$prerecs_number_current" > "$data" + + _sleep + done + + +### Fetch upload data + + #!/usr/bin/env sh + + set -eu + + current_time() { + date +"[%T]" + } + + log() { + printf "%s $1\n" "$(current_time)" + } + + if [ -t 0 ]; then + log "Fetching data..." + fi + + TERM=xterm ssh orga@media.emacsconf.org -- cat /srv/upload/*/*json + + +### Fetch new talk data formatted + + #!/usr/bin/env sh + + set -eu + + echo "Fetching data..." + data_raw="$(./fetch-upload-data.sh)" + + echo + + echo "$data_raw" | awk "$(cat << EOF + func dewrap(a) {gsub(/^ *".*": "|",$/, "", a); return a}; + BEGIN {i=0}; + /^ "sid"/ { a[0] = dewrap(\$0); }; + /^ "name"/ { a[2] = sprintf("%s\t", dewrap(\$0)) }; + /^ "comment"/ { a[3] = sprintf("%s\t", dewrap(\$0)); if (a[3] == "\t"){a[3] = "No comment"} }; + /^ "key"/ { a[1] = dewrap(\$0); }; + /^\}/ { printf "[%d]\t%s\t%s\t%s\n\t%s\n\n", i, a[0], a[1], a[2], a[3]; i=i+1}; + EOF + )" + + ## Publish this page (defun emacsconf-org-publish-this-page () @@ -1965,25 +8389,27 @@ chatter in the other lists Cc'd on this message. Thank you. (message "Hook is no longer active")) -## Process review comments from pad +## Review agenda -1. `curl https://etherpad.wikimedia.org/p/[REDACTED]/export/html` -2. Open curl’d html into browser -3. Copy just the text from the page (i.e. not the html) -4. Paste in Emacs buffer + (defcustom emacsconf-org-tag nil "Tag for your nick, for easier agenda filtering" + :group 'emacsconf + :type 'string) -Inside emacs: + (defun emacsconf-show-my-agenda () + (interactive) + (let* ((org-agenda-files (list (buffer-file-name))) + (tag-filter (if emacsconf-org-tag (concat "+" emacsconf-org-tag) "")) + (org-agenda-tag-filter-preset (list (when emacsconf-org-tag (concat "+" emacsconf-org-tag)))) + (org-agenda-custom-commands `(("a" "Agenda" + ((agenda ,tag-filter) + (tags-todo ,(concat tag-filter "-SCHEDULED={.+}-DEADLINE={.+}"))) + ((org-agenda-span 14)))))) + (org-agenda nil "a"))) -1. C-s Comments for -2. C-M-s ^[a-z0-9] -3. M-< -4. C-x 3 -5. C-x b comments.org (new buffer) -6. C-x o -7. Run following kmacro (eval then M-x pad-comments, then C-x e until completion) - (defalias 'emacsconf-pad-comments - (kmacro "C-s C-s <return> C-a C-SPC C-n C-M-s M-p <return> <return> C-b M-w C-x o C-y C-u -- C-x o")) +## Process review comments from pad + +see emacsconf-import-comments-from-etherpad-text <a id="lessons"></a> @@ -1993,19 +8419,20 @@ Inside emacs: ## From previous years -- [ ] Shorter CFP, longer recording time -- [ ] Ask for talk title to be subject in submission +- [X] Shorter CFP, longer recording time +- [X] Ask for talk title to be subject in submission - [X] Fresh eyes can doublecheck that all the talks are included and that availability properties have been set/followed - [X] Putting ‘availability’ towards the top of the submission template would make it harder for us to miss it during reviews, and it shouldn’t change anything for speakers. - [X] All the personalised messages we’ve sent during the scheduling campaign should probably be kept in a repo so that it’s less work for those who will be in charge of it next. -- [ ] Since people kept running into ftp problems, we might want to set up a web-frontend next year to minimise problems. +- [X] Since people kept running into ftp problems, we might want to set up a web-frontend next year to minimise problems. - [X] Might be a good idea to avoid Thanksgiving weekend, as lots of people travel then -- [ ] Tech-checks haven’t been really popular this year, but there are so many ways we could make them more useful. On the <span class="timestamp-wrapper"><span class="timestamp">[2021-11-16 Tue]</span></span>, 10 days prior the conf, we thought that it could be nice to use them as recording sessions for late-prerecs, and that’s only one example. +- [X] Tech-checks haven’t been really popular this year, but there are so many ways we could make them more useful. On the <span class="timestamp-wrapper"><span class="timestamp">[2021-11-16 Tue]</span></span>, 10 days prior the conf, we thought that it could be nice to use them as recording sessions for late-prerecs, and that’s only one example. - [X] Having the NO\_NEWS / WAITING\_FOR\_PREREC contrast from the start of `conf.org` might have made it easier for us to ping speakers who were late to the party this year. Rather than sending the personalised 10 days prior to the conference, we might have sent it a week after the submission of the anticipated scheduled (where we ask speakers if their allocated time is okay, based on their availability). -- [ ] Move first dry run earlier (maybe one month before?) to give us more time for process tweaks +- [X] Move first dry run earlier (maybe one month before?) to give us more time for process tweaks - [ ] Dropping talks one week before the conf might allow us to have a near-fixed schedule to announce early. + - or we can plan for live or gaps, that’s cool too - [ ] CRM - - [ ]zaeph: Implementing a variable for `automatic-emails` would make it easier to suppress user-hooks for message-mode + - [ ] zaeph: Implementing a variable for `automatic-emails` would make it easier to suppress user-hooks for message-mode - [ ]zaeph: Even though we’re sending emails automatically, we might want to keep trace of them in our `Sent` IMAP folder. notmuch does it with `Fcc:` in the header, so we might need a user-customisable var here as well. - [ ] less tiring lighting - [ ] split host and streamer? @@ -2014,11 +8441,13 @@ Inside emacs: - [ ] Tight opening-remarks, possible pre-rec. - [X] Asking pronunciation of name as soon as application with SA-cha CHEW-ah pattern would be good. Not a lot of diligence with it this year. - [ ] People need to specify their IRC handle on application (potentially forcing nick and/or first-name/last-name. + - suggested, but not everyone has IRC, so that’s okay. We’ll manage. Walk new speakers through it? - [ ] We might want to figure out an ffmpeg workflow for noise-suppressing on top of normalisation. Take inspiration from Audacity macros. - [ ] Having a more relaxed Saturday might give us time to adjust to tech-stack. -- [ ] Creating BBB rooms in anticipation and/or automatically, before or during, might make for smoother check-in; right now, people keep wanting to check in via email even though we told them to use chat +- [X] Creating BBB rooms in anticipation and/or automatically, before or during, might make for smoother check-in; right now, people keep wanting to check in via email even though we told them to use chat + - One BBB room per talk - [ ] Pre-recs were a little blocky wrt encoding; we might want to bump the bitrate next year -- [ ] we can see if bot + pads + merging will help next year, and we can also experiment with multiple streams if there are enough people to pull it off so that speakers don't feel like they've just been dropped in a room and left to their own devices :) +- [ ] we can see if bot + pads + merging will help next year, and we can also experiment with multiple streams if there are enough people to pull it off so that speakers don’t feel like they’ve just been dropped in a room and left to their own devices :) ## Lessons learned for next year @@ -2035,10 +8464,10 @@ Inside emacs: format makes it harder not only for the organizers, but also for the speakers themselves (since they will have to rethink their presentation). Maybe we can have an e-mail template for a quick - reply that says something like "Just in case we need to squeeze + reply that says something like “Just in case we need to squeeze talks into shorter times, could you please also propose an outline for a possible 10-minute talk that could get people interested in - your topic and point them to where they can find out more?" + your topic and point them to where they can find out more?” - Two people is the sweet number of reviewers to have for the proposals before sending the notifications, and there’d be diminishing returns with more. Two is enough to release the pressure @@ -2058,4 +8487,47 @@ Inside emacs: they intend their talks to be 10′ or 20′. We should change the wording on the CFP to ask them to only provide alternatives for shorter formats, not longer. +- It was hard to squeeze all the org/hyperbole talk on day-1. + Generally, the people who submit these kinds of talk come from all + over the world, and US mornings are more accommodating than US + evenings when it comes to timezones. We might consider having two org + **mornings** rather than an org **day**; it would give us more flexibility + with those talks. +- We’re starting to reach critical mass on the org-talks. We might want + to consider splitting the org-talks and the dev-talks into two + distinct events to allow them to grow independently. +- We should associate time-of-day with CFP-deadline; otherwise, the + scheduler has to be on edge until the very end of the day. It’s worse + this year because we made CFP-end coincide with speaker-notif, so this + might not be as much of a problem next year. +- It’s easier for us to extend beyond 5pm than to go before 9am + (especially for the West coast). Extending beyond 5pm puts strain on + European organizers and volunteers, though. +- Sometimes, ikiwiki on front0 took a lot of time to process the new + commits. sachac assumed this is due to a faulty regex parsing. We + should be able to find out more by looking at the logs from ikiwiki + after a slow commit. +- Ask for preferred timezone in CFP +- Check with John Wiegley re: schedule - we always happen to coincide with his work trips + + +### When processing prerecs + +- We should flesh out the prepare.md section on audio-recording because + some speakers have annoying coil-whines when recording from their + laptop’s microphone which are particularly hard to remove. We should + ask speaker to record some silence, listen to it in isolation, and + gauge how silent it actually is. It’s not a biggie though, since we + can usually degrade the audio quality for the sake of removing the + noise. +- We can ask for silence in a separate recording so that we don’t have to worry about cutting it out. + + +## Possible big projects for next year + + +### Prolog’ing the schedule + + +### Designing the EmacsConf suite (to make it easier for people other us to run their own versions) |