From fb74be4f3270f81f95e5f590a2119c01e5066ffc Mon Sep 17 00:00:00 2001 From: Sacha Chua Date: Mon, 30 Oct 2023 19:23:19 -0400 Subject: update schedule --- 2023/organizers-notebook.md | 712 ++++++++++++++++++++++++++++++++++++-------- 1 file changed, 589 insertions(+), 123 deletions(-) (limited to '2023/organizers-notebook.md') diff --git a/2023/organizers-notebook.md b/2023/organizers-notebook.md index adb62394..dd466ac3 100644 --- a/2023/organizers-notebook.md +++ b/2023/organizers-notebook.md @@ -5,7 +5,7 @@ This file is automatically exported from [/2023/organizers-notebook/index.org](/ Help wanted: -- [Figure out a better way to handle 480p stream](#lowres) +- [Find volunteers for audio processing (normalization, noise reduction) and document the process](#audio) Help wanted: @@ -26,9 +26,9 @@ Help wanted: - [Distribute CFP](#distrib-cfp) - [Process submissions](#submission-process) - [Draft schedule](#draft-schedule) - - [Prepare infrastructure](#check-infra) - - [Prepare assets](#prepare-assets) - - [Coordinate volunteers](#coordinate-volunteers) + - [Prepare for the conference](#status) + - [Get ready for production](#go-live) + - [Volunteers](#coordinate-volunteers) - [Progress reports](#progress) - [E-mail templates](#templates) - [Review](#review) @@ -570,7 +570,7 @@ Sacha These times are in EST (GMT-5). - Graphical view of the schedule Schedule for Saturday Saturday 9:00- 9:10 Saturday opening remarks sat-open 9:10- 9:20 An Org-Mode based text adventure game for learning the basics of Emacs, inside Emacs, written in Emacs Lisp adventure 9:30- 9:50 Authoring and presenting university courses with Emacs and a full libre software stack uni 10:05-10:25 Teaching computer and data science with literate programming tools teaching 10:40-10:50 Who needs Excel? Managing your students qualifications with org-table table 11:05-11:15 Taming things with Org Mode taming 11:30-11:50 one.el: the static site generator for Emacs Lisp Programmers one 1:00- 1:10 Emacs turbo-charges my writing writing 1:25- 1:35 Why Nabokov would use Org-Mode if he were writing today nabokov 1:50- 2:10 Collaborative data processing and documenting using org-babel collab 2:20- 2:40 How I play TTRPGs in Emacs solo 2:55- 3:15 Org-Mode workflow: informal reference tracking ref 3:25- 3:35 (Un)entangling projects and repos unentangling 3:45- 3:55 Emacs development updates devel 4:05- 4:45 Emacs core development: how it works core 5:00- 5:10 Saturday closing remarks sat-close 10:00-10:10 MatplotLLM, iterative natural language data visualization in org-babel matplotllm 10:20-10:40 Improving access to AI-assisted literate programming with voice control voice 10:55-11:15 LLM clients in Emacs, functionality and standardization llm 1:00- 1:20 Improving compiler diagnostics with Overlays overlay 1:35- 1:45 Editor Integrated REPL Driven Development for all languages eval 2:00- 2:40 REPLs in strange places: Lua, LaTeX, LPeg, LPegRex, TikZ repl 2:50- 3:10 EmacsConf.org: How we use Org Mode and TRAMP to organize and run a multi-track conference emacsconf 9 AM 10 AM 11 AM 12 PM 1 PM 2 PM 3 PM 4 PM 5 PM Schedule for Sunday Sunday 9:00- 9:05 Sunday opening remarks sun-open 9:05- 9:25 Top 10 ways Hyperbole amps up Emacs hyperamp 9:40-10:00 Using Koutline for stream of thought journaling koutline 10:10-10:20 Parallel Text Replacement: Does P = NP? parallel 10:35-10:45 Eat and Eat powered Eshell, fast featureful terminal inside Emacs eat 11:00-11:20 The browser in a buffer poltys 11:35-11:55 Speedcubing in Emacs cubing 1:00- 1:40 Emacs MultiMedia System (EMMS) emms 1:55- 2:25 Programming at 200 wpm steno 2:35- 2:45 Mentoring VS-Coders as an Emacsian (or How to show not tell people about the wonders of Emacs) mentor 3:00- 3:10 The many ways to browse Hacker News from Emacs hn 3:25- 4:05 Emacs saves the Web web 4:20- 4:40 Sharing Emacs is Caring Emacs: Emacs education and why I embraced video sharing 4:55- 5:05 Sunday closing remarks sun-close 10:00-10:20 Bringing joy to Scheme programming scheme 10:35-10:55 What I learned by writing test cases for GNU Hyperbole test 11:10-11:30 GNU Emacs: A World of Possibilities world 11:45-11:55 A modern Emacs look-and-feel without pain flat 1:00- 1:20 emacs-gc-stats: Does garbage collection actually slow down Emacs? gc 1:35- 2:15 hyperdrive.el: Peer-to-peer filesystem in Emacs hyperdrive 2:30- 2:40 Writing a language server in OCaml for Emacs, fun, and profit lspocaml 2:55- 3:35 Windows into Freedom windows 3:50- 4:10 The Emacsen family, the design of an Emacs and the importance of Lisp emacsen 9 AM 10 AM 11 AM 12 PM 1 PM 2 PM 3 PM 4 PM 5 PM + Graphical view of the schedule Schedule for Saturday Saturday 9:00- 9:10 Saturday opening remarks sat-open 9:10- 9:20 An Org-Mode based text adventure game for learning the basics of Emacs, inside Emacs, written in Emacs Lisp adventure 9:30- 9:50 Authoring and presenting university courses with Emacs and a full libre software stack uni 10:05-10:25 Teaching computer and data science with literate programming tools teaching 10:40-10:50 Who needs Excel? Managing your students qualifications with org-table table 11:05-11:15 Taming things with Org Mode taming 11:30-11:50 one.el: the static site generator for Emacs Lisp Programmers one 1:00- 1:10 Emacs turbo-charges my writing writing 1:25- 1:35 Why Nabokov would use Org-Mode if he were writing today nabokov 1:50- 2:10 Collaborative data processing and documenting using org-babel collab 2:20- 2:40 How I play TTRPGs in Emacs solo 2:55- 3:15 Org-Mode workflow: informal reference tracking ref 3:25- 3:35 (Un)entangling projects and repos unentangling 3:45- 3:55 Emacs development updates devel 4:10- 4:50 Emacs core development: how it works core 5:05- 5:15 Saturday closing remarks sat-close 10:00-10:10 MatplotLLM, iterative natural language data visualization in org-babel matplotllm 10:20-10:40 Improving access to AI-assisted literate programming with voice control voice 10:55-11:15 LLM clients in Emacs, functionality and standardization llm 1:00- 1:20 Improving compiler diagnostics with Overlays overlay 1:35- 1:45 Editor Integrated REPL Driven Development for all languages eval 2:00- 2:40 REPLs in strange places: Lua, LaTeX, LPeg, LPegRex, TikZ repl 2:50- 3:10 EmacsConf.org: How we use Org Mode and TRAMP to organize and run a multi-track conference emacsconf 9 AM 10 AM 11 AM 12 PM 1 PM 2 PM 3 PM 4 PM 5 PM Schedule for Sunday Sunday 9:00- 9:05 Sunday opening remarks sun-open 9:05- 9:25 Top 10 ways Hyperbole amps up Emacs hyperamp 9:40-10:00 Using Koutline for stream of thought journaling koutline 10:10-10:20 Parallel Text Replacement: Does P = NP? parallel 10:35-10:45 Eat and Eat powered Eshell, fast featureful terminal inside Emacs eat 11:00-11:20 The browser in a buffer poltys 11:35-11:55 Speedcubing in Emacs cubing 1:00- 1:40 Emacs MultiMedia System (EMMS) emms 1:55- 2:25 Programming at 200 wpm steno 2:35- 2:45 Mentoring VS-Coders as an Emacsian (or How to show not tell people about the wonders of Emacs) mentor 3:10- 3:50 Emacs saves the Web web 4:05- 4:25 Sharing Emacs is Caring Emacs: Emacs education and why I embraced video sharing 4:40- 4:50 Sunday closing remarks sun-close 10:00-10:20 Bringing joy to Scheme programming scheme 10:35-10:55 What I learned by writing test cases for GNU Hyperbole test 11:10-11:30 GNU Emacs: A World of Possibilities world 11:45-11:55 A modern Emacs look-and-feel without pain flat 1:00- 1:20 emacs-gc-stats: Does garbage collection actually slow down Emacs? gc 1:35- 2:15 hyperdrive.el: Peer-to-peer filesystem in Emacs hyperdrive 2:30- 2:40 Writing a language server in OCaml for Emacs, fun, and profit lspocaml 2:55- 3:35 Windows into Freedom windows 3:50- 4:10 The Emacsen family, the design of an Emacs and the importance of Lisp emacsen 9 AM 10 AM 11 AM 12 PM 1 PM 2 PM 3 PM 4 PM 5 PM - Legend: dashed line means non-BBB Q&A; light gray means penciled-in talk; yellow means video already submitted and being processed @@ -596,9 +596,9 @@ These times are in EST (GMT-5). - 2023-12-02 Sat 14:50-15:10 [emacsconf](https://emacsconf.org/2023/talks/emacsconf "EmacsConf.org: How we use Org Mode and TRAMP to organize and run a multi-track conference"): EmacsConf.org: How we use Org Mode and TRAMP to organize and run a multi-track conference (Sacha Chua) - 2023-12-02 Sat 14:55-15:15 - >= 13:00 - [ref](https://emacsconf.org/2023/talks/ref "Org-Mode workflow: informal reference tracking"): Org-Mode workflow: informal reference tracking (Christopher Howard) - 2023-12-02 Sat 15:25-15:35 - between 15:00-16:00 - [unentangling](https://emacsconf.org/2023/talks/unentangling "(Un)entangling projects and repos"): (Un)entangling projects and repos (Alexey Bochkarev) -- 2023-12-02 Sat 15:45-15:55 - no live Q&A - [devel](https://emacsconf.org/2023/talks/devel "Emacs development updates"): Emacs development updates (John Wiegley) -- 2023-12-02 Sat 16:05-16:45 [core](https://emacsconf.org/2023/talks/core "Emacs core development: how it works"): Emacs core development: how it works (Stefan Kangas) -- 2023-12-02 Sat 17:00-17:10 [sat-close](https://emacsconf.org/2023/talks/sat-close "Saturday closing remarks"): Saturday closing remarks +- 2023-12-02 Sat 15:45-15:55 - >= 12:00 - [devel](https://emacsconf.org/2023/talks/devel "Emacs development updates"): Emacs development updates (John Wiegley) +- 2023-12-02 Sat 16:10-16:50 [core](https://emacsconf.org/2023/talks/core "Emacs core development: how it works"): Emacs core development: how it works (Stefan Kangas) +- 2023-12-02 Sat 17:05-17:15 [sat-close](https://emacsconf.org/2023/talks/sat-close "Saturday closing remarks"): Saturday closing remarks - 2023-12-03 Sun 09:00-09:05 [sun-open](https://emacsconf.org/2023/talks/sun-open "Sunday opening remarks"): Sunday opening remarks - 2023-12-03 Sun 09:05-09:25 - <= 12:00 - [hyperamp](https://emacsconf.org/2023/talks/hyperamp "Top 10 ways Hyperbole amps up Emacs"): Top 10 ways Hyperbole amps up Emacs (Robert Weiner) - 2023-12-03 Sun 09:40-10:00 [koutline](https://emacsconf.org/2023/talks/koutline "Using Koutline for stream of thought journaling"): Using Koutline for stream of thought journaling (Matthew Jorgensen (PlasmaStrike)) @@ -608,7 +608,7 @@ These times are in EST (GMT-5). - 2023-12-03 Sun 10:35-10:55 - <= 12:00 - [test](https://emacsconf.org/2023/talks/test "What I learned by writing test cases for GNU Hyperbole"): What I learned by writing test cases for GNU Hyperbole (Mats Lidell) - 2023-12-03 Sun 11:00-11:20 - <= 13:00 - [poltys](https://emacsconf.org/2023/talks/poltys "The browser in a buffer"): The browser in a buffer (Michael Bauer) - 2023-12-03 Sun 11:10-11:30 - <= 11:30 - [world](https://emacsconf.org/2023/talks/world "GNU Emacs: A World of Possibilities"): GNU Emacs: A World of Possibilities (Anand Tamariya) -- 2023-12-03 Sun 11:35-11:55 - <= 17:00 - [cubing](https://emacsconf.org/2023/talks/cubing "Speedcubing in Emacs"): Speedcubing in Emacs (Vasilij “wasamasa” Schneidermann) +- 2023-12-03 Sun 11:35-11:55 - <= 17:00 - [cubing](https://emacsconf.org/2023/talks/cubing "Speedcubing in Emacs"): Speedcubing in Emacs (wasamasa) - 2023-12-03 Sun 11:45-11:55 - between 11:00-13:00 - [flat](https://emacsconf.org/2023/talks/flat "A modern Emacs look-and-feel without pain"): A modern Emacs look-and-feel without pain (Pedro A. Aranda) - 2023-12-03 Sun 13:00-13:20 - <= 14:00 - [gc](https://emacsconf.org/2023/talks/gc "emacs-gc-stats: Does garbage collection actually slow down Emacs?"): emacs-gc-stats: Does garbage collection actually slow down Emacs? (Ihor Radchenko) - 2023-12-03 Sun 13:00-13:40 [emms](https://emacsconf.org/2023/talks/emms "Emacs MultiMedia System (EMMS)"): Emacs MultiMedia System (EMMS) (Yoni Rabkin) @@ -617,11 +617,10 @@ These times are in EST (GMT-5). - 2023-12-03 Sun 14:30-14:40 [lspocaml](https://emacsconf.org/2023/talks/lspocaml "Writing a language server in OCaml for Emacs, fun, and profit"): Writing a language server in OCaml for Emacs, fun, and profit (Austin Theriault) - 2023-12-03 Sun 14:35-14:45 [mentor](https://emacsconf.org/2023/talks/mentor "Mentoring VS-Coders as an Emacsian (or How to show not tell people about the wonders of Emacs)"): Mentoring VS-Coders as an Emacsian (or How to show not tell people about the wonders of Emacs) (Jeremy Friesen) - 2023-12-03 Sun 14:55-15:35 [windows](https://emacsconf.org/2023/talks/windows "Windows into Freedom"): Windows into Freedom (Corwin Brust) -- 2023-12-03 Sun 15:00-15:10 - >= 15:00 - [hn](https://emacsconf.org/2023/talks/hn "The many ways to browse Hacker News from Emacs"): The many ways to browse Hacker News from Emacs (Mickael Kerjean) -- 2023-12-03 Sun 15:25-16:05 - >= 15:00 - [web](https://emacsconf.org/2023/talks/web "Emacs saves the Web"): Emacs saves the Web (Yuchen Pei) +- 2023-12-03 Sun 15:10-15:50 - >= 15:00 - [web](https://emacsconf.org/2023/talks/web "Emacs saves the Web"): Emacs saves the Web (Yuchen Pei) - 2023-12-03 Sun 15:50-16:10 - no live Q&A - [emacsen](https://emacsconf.org/2023/talks/emacsen "The Emacsen family, the design of an Emacs and the importance of Lisp"): The Emacsen family, the design of an Emacs and the importance of Lisp (Fermin) -- 2023-12-03 Sun 16:20-16:40 [sharing](https://emacsconf.org/2023/talks/sharing "Sharing Emacs is Caring Emacs: Emacs education and why I embraced video"): Sharing Emacs is Caring Emacs: Emacs education and why I embraced video (Jacob Boxerman) -- 2023-12-03 Sun 16:55-17:05 [sun-close](https://emacsconf.org/2023/talks/sun-close "Sunday closing remarks"): Sunday closing remarks +- 2023-12-03 Sun 16:05-16:25 [sharing](https://emacsconf.org/2023/talks/sharing "Sharing Emacs is Caring Emacs: Emacs education and why I embraced video"): Sharing Emacs is Caring Emacs: Emacs education and why I embraced video (Jacob Boxerman) +- 2023-12-03 Sun 16:40-16:50 [sun-close](https://emacsconf.org/2023/talks/sun-close "Sunday closing remarks"): Sunday closing remarks ### Schedule notes @@ -707,15 +706,199 @@ When do we want to do this? We don’t have to worry too much, because we can offer them the option of doing it live, and we can have space in the schedule if they cancel last-minute. - + + +## Prepare for the conference + + + + +++ ++ ++ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
ITEMTODOSTATUS
UploadDONEReady to go
PrerecDONEReady to go
CaptionsINPROGRESSReady to go; waiting for videos and captions
BackstageDONEReady to go
Test assetsDONEtest videos generated
BBB redirects created, confirmed; next: e-mail speakers testing/checkin instructions
VNCDONEconfirmed access to emacsconf-gen and emacsconf-dev
OBSDONEconfirmed that gen and dev can stream
IcecastDONEgen and dev confirmed with MPV
MPVDONEconfirmed that mpv can watch both streams
Watch pageDONEupdated for 2023
Status pageDONEready to go
Public mediaDONEconfirmed, set to protected so that we can test publishing live
MumbleDONEconfirmed gen and dev can connect, receive audio
EtherpadDONEReady to go, pads created
Pad proxyDONEReady to go, pad.emacsconf.org works
OverlaysDONEgenerated and uploaded
IntrosINPROGRESSall intros recorded, should send them to speakers for review
IRC channels Not yet started
IRC talk info Not yet started
Announcements Not yet started
Publishing updates live Not yet started
Autopilot Not yet started
YouTube Not yet started
Peertube Not yet started
480p Delegated to corwin
Audio processing Help wanted
-## Prepare infrastructure +### DONE Upload -### DONE Get access to media.emacsconf.org so that we can set up the upload service and the backstage area +#### DONE Get access to media.emacsconf.org so that we can set up the upload service and the backstage area -#### DONE Decide what to do for backstage area and upload service :decision: +##### DONE Decide what to do for backstage area and upload service :decision: - [2023-10-13 Fri]: Got access to media.emacsconf.org, set up the backstage area @@ -728,9 +911,159 @@ and we can have space in the schedule if they cancel last-minute. - access to media.emacsconf.org might be sorted out by [2023-10-13 Fri] - not in a big rush yet -### TODO Double-check OBS setup and streaming on res +### DONE Prerec + + +##### Set up for the new year + +As orga@res: + +- mkdir /data/emacsconf/$year +- rm ~/current +- ln -s /data/emacsconf/$year current +- ln -s /data/emacsconf/$year $year + +When we receive files + +- change the TODO status to PROCESSING +- mkdir ~/current/$slug +- copy the files to there +- rename-original $slug $file +- process-prerec $video +- Copy the files to the res:~/cache, laptop:~/proj/emacsconf/2023/cache, and media:~/backstage +- emacsconf-cache-all-video-data +- emacsconf-publish-info-pages +- emacsconf-publish-backstage-index + + +(check that the reencode.sh process has kicked off; if not, call reencode.sh $video $prefix–reencoded.webm) + +### INPROGRESS Captions + +- OpenAI Whisper SaaS () limits audio files to 25MB, so it’s probably easier to do it ourselves + +#### TODO E-mail previous captioning volunteers to see if they’re interested in helping out + +#### DONE E-mail captioning volunteers the backstage instructions + +#### DONE E-mail current caption volunteers backstage information, captioning process, etc. + +I’ll wait a few days for Yoni to get back to us about whether he wants +to caption his own talk and/or seeing if other speakers will get their +talks in. + +`emacsconf-mail-backstage-info` + + + +Hi ${name}! + +You’re getting this e-mail because you have volunteered to help out +with captions for ${conf-name} ${year}. (Thank you so much!) + +I’m so excited! =) We’re starting to get recorded talks, which means +it’s time to get captions going. People really appreciate the +captions, especially when the captions have been lovingly edited by +volunteers who change things like “Emax” to “Emacs” and “metaX” to +“M-x”. + +Just like last year, we’re using OpenAI Whisper to give us a +reasonable starting point for transcripts. If working from scratch +works better for you, you’re welcome to do that too. + +We’ve set up ${backstage} as the backstage area where you can view the +videos and resources uploaded so far. You can access it with the +username "${backstage-user}“ and the password ”${backstage-password}“. +Please keep the backstage password and other speakers’ talk resources +secret. ${backstage-use} + +To call dibs on a video to caption, just send a message to me at +sacha@sachachua.com and I can update the page so that it’s assigned to +you. You can e-mail me the edited captions when you’re done. Don’t +worry too much about timestamps; we can re-align the text with the +audio afterwards. If life gets suddenly busy and you can’t see it all +the way through, no worries. Just e-mail me what you’ve got and I’ll +put it back in the pool. Every little bit helps! + +Thank you! + +Sacha Chua + +#### TODO E-mail the emacsconf-org mailing list the announcement and the invitation to volunteer -### TODO Generate BBB rooms +#### TODO Try out Deepgram, play around with it for last-minute submissions? + +#### DONE Get the autocaptions for emms up in the backstage area + +#### Captions lessons learned :lessons: + +- OpenAI had a breaking API change, need to call `whisper.utils.get_writer` + - + vtt_writer = whisper.utils.get_writer('vtt', os.path.dirname(new_file)) + txt_writer = whisper.utils.get_writer('txt', os.path.dirname(new_file)) + vtt_writer(result, work['audio'], {'max_line_width': 60, 'max_line_count': None, 'highlight_words': None}) + txt_writer(result, work['audio'], {'max_line_width': 60, 'max_line_count': None, 'highlight_words': None}) + +#### Reencoding + +### DONE Backstage + + + +### DONE Test assets + + + +#### DONE Generate test videos + +#### Try autopilot + + (let* ((offset-seconds 60) + (start-time (time-add (current-time) offset-seconds)) + (emacsconf-schedule-validation-functions nil) + (emacsconf-schedule-default-buffer-minutes 1) + (emacsconf-schedule-default-buffer-minutes-for-live-q-and-a 1) + (emacsconf-schedule-strategies '(emacsconf-schedule-allocate-buffer-time + emacsconf-schedule-copy-previous-track)) + (schedule (emacsconf-schedule-prepare + (emacsconf-schedule-inflate-sexp + `(("GEN" + :start ,(format-time-string "%Y-%m-%d %H:%M" start-time) + :set-track "General") + (sat-open :time 1) + (adventure :time 1) ; pad Q&A + (uni :time 1) ; live Q&A + (teaching :time 1) + (table :time 1) + (taming :time 1) + (one :time 1) + (cubing :time 1) ; IRC + ("DEV" + :start + ,(format-time-string "%Y-%m-%d %H:%M" (time-add start-time 60)) + :set-track "Development") + (matplotllm :time 1) + (gc :time 1) ; pad + (repl :time 1) ; IRC + (voice :time 1) + (llm :time 1) + (overlay :time 1) + (eval :time 1) + (emacsconf :time 1)))))) + (emacsconf-stream-crontabs t schedule)) + +### BBB + +Generate them for possibly live presentations as well? We’ll see. + +#### DONE Generate redirects + +We use redirects for Q&A sessions with BBB web conferences so that people can easily join the web conference. + +- : generate static redirects +- + +#### DONE Generate BBB rooms BBB name convention from last year @@ -794,152 +1127,183 @@ Creating new rooms (dolist (group groups) (emacsconf-spookfox-create-bbb group))) -### TODO Double-check icecast +#### TODO Possibly generate BBB rooms for live presentations? - +#### TODO Send testing instructions -### TODO Figure out a better way to handle 480p stream :corwin: +### DONE VNC -It kept dropping last year and sachac didn’t have the mental bandwidth to figure it out. -Might need another node so that we don’t risk it getting killed for memory reasons? +We use VNC to connect to the X servers on res.emacsconf.org so that we can stream from it. -Corwin has volunteered to take this on +Success: +- [X] Confirm that you can connect to emacsconf-gen via VNC +- [X] Confirm that you can connect to emacsconf-dev via VNC -### BLOCKED Create pads for all the talks +Setting up +- -Because the pads refer to the next and previous talks and include the talk titles, this is best done after the schedule has settled down. + -### TODO Doublecheck prerec processing workflow +#### Instructions +NOTE: VNC+OBS doesn’t work well if you have a window manager that +automatically resizes windows, like i3. Please configure your window +manager so that the VNC window is not resized. -#### Process +1. Install a VNC viewer on your system (ex: tigervnc-viewer). +2. Set up your local environment: + + - gen: export TRACK=gen; export TRACK\_PORT=5905; export SSH\_PORT=46668 + - dev: export TRACK=dev; export TRACK\_PORT=5906; export SSH\_PORT=46668 -##### Set up for the new year +3. Copy the password: + + scp emacsconf-$TRACK@res.emacsconf.org:~/.vnc/passwd vnc-passwd-$TRACK -p $SSH\_PORT -As orga@res: +4. Forward your local ports and connect via VNC viewer to the + appropriate forwarded port from your laptop: + + ssh emacsconf-$TRACK@res.emacsconf.org -N -L $TRACK_PORT:127.0.0.1:$TRACK_PORT -p $SSH_PORT & + sleep 5 # Give it time to establish the tunnels + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & -- mkdir /data/emacsconf/$year -- rm ~/current -- ln -s /data/emacsconf/$year current -- ln -s /data/emacsconf/$year $year +If you get the following error: -When we receive files + channel 2: open failed: connect failed: Connection refused + CConn: End of stream + CConn: The connection was dropped by the server before the session could + be established. -- change the TODO status to PROCESSING -- mkdir ~/current/$slug -- copy the files to there -- rename-original $slug $file -- process-prerec $video -- Copy the files to the res:~/cache, laptop:~/proj/emacsconf/2023/cache, and media:~/backstage -- emacsconf-cache-all-video-data -- emacsconf-publish-info-pages -- emacsconf-publish-backstage-index +then the VNC server hasn’t started yet. You can start it with + ssh emacsconf-$TRACK@res.emacsconf.org -p $SSH_PORT /home/emacsconf-$TRACK/bin/track-vnc -(check that the reencode.sh process has kicked off; if not, call reencode.sh $video $prefix–reencoded.webm) +and then connect with: -#### Captions + xvncviewer 127.0.0.1:$TRACK_PORT -shared -geometry 1280x720 -passwd vnc-passwd-$TRACK & -- OpenAI Whisper SaaS () limits audio files to 25MB, so it’s probably easier to do it ourselves +#### TODO Ask bandali or zaeph to share their window manager configuration :bandali:zaeph: -##### TODO E-mail current caption volunteers backstage information, captioning process, etc. +### DONE OBS -I’ll wait a few days for Yoni to get back to us about whether he wants -to caption his own talk and/or seeing if other speakers will get their -talks in. +We use OBS to stream to Icecast on live.emacsconf.org. -`emacsconf-mail-backstage-info` +Success: Confirm that you can stream +- [X] gen +- [X] dev +New year: reprovision with + ansible-playbook -i inventory.yml prod-playbook.yml --tags obs -Hi ${name}! +so that the year is updated in the shell scripts. -You’re getting this e-mail because you have volunteered to help out -with captions for ${conf-name} ${year}. (Thank you so much!) + -I’m so excited! =) We’re starting to get recorded talks, which means -it’s time to get captions going. People really appreciate the -captions, especially when the captions have been lovingly edited by -volunteers who change things like “Emax” to “Emacs” and “metaX” to -“M-x”. +#### Instructions -Just like last year, we’re using OpenAI Whisper to give us a -reasonable starting point for transcripts. If working from scratch -works better for you, you’re welcome to do that too. +1. [Connect to the VNC session for the track.](#vnc-instructions) -We’ve set up ${backstage} as the backstage area where you can view the -videos and resources uploaded so far. You can access it with the -username "${backstage-user}“ and the password ”${backstage-password}“. -Please keep the backstage password and other speakers’ talk resources -secret. ${backstage-use} +2. Start **recording** (not streaming). If you don’t see OBS when you connect, it’s probably on workspace 2, so you can switch with Alt-2. If you still don’t see it there, you can open a terminal with Alt-Enter and then run `track-obs`. After you start recording, confirm that it is now broadcasting to the stream. -To call dibs on a video to caption, just send a message to me at -sacha@sachachua.com and I can update the page so that it’s assigned to -you. You can e-mail me the edited captions when you’re done. Don’t -worry too much about timestamps; we can re-align the text with the -audio afterwards. If life gets suddenly busy and you can’t see it all -the way through, no worries. Just e-mail me what you’ve got and I’ll -put it back in the pool. Every little bit helps! +3. Verify with MPV on your local system: + + mpv https://live0.emacsconf.org/$TRACK.webm & -Thank you! +#### DONE Double-check OBS setup and streaming on res -Sacha Chua +### DONE Icecast -##### TODO E-mail the emacsconf-org mailing list the announcement and the invitation to volunteer +Success: You can use [OBS+VNC to record](#obs-instructions), and the results can be viewed by mpv. +- [X] Gen +- [X] Dev -##### TODO Try out Deepgram, play around with it for last-minute submissions? +New year: reprovision with -##### DONE Get the autocaptions for emms up in the backstage area + ansible-playbook -i inventory.yml prod-playbook.yml --tags stream -##### Captions lessons learned :lessons: +so that the year is updated in the configuration. -- OpenAI had a breaking API change, need to call `whisper.utils.get_writer` - - - vtt_writer = whisper.utils.get_writer('vtt', os.path.dirname(new_file)) - txt_writer = whisper.utils.get_writer('txt', os.path.dirname(new_file)) - vtt_writer(result, work['audio'], {'max_line_width': 60, 'max_line_count': None, 'highlight_words': None}) - txt_writer(result, work['audio'], {'max_line_width': 60, 'max_line_count': None, 'highlight_words': None}) +This is on live.emacsconf.org and can be restarted with `/etc/init.d/emacsconf restart`. -#### Reencoding +#### DONE Double-check icecast -### TODO Find volunteers for audio processing and document the process :helpwanted: +### DONE MPV -- audio normalization -- noise reduction +### DONE Watch page -### TODO Write something for merging in information from previous years if not specified +live.emacsconf.org is on the front0.emacsconf.org server. -- availability -- timezone -- name -- short name -- pronouns +To set up for the year: - +1. Create directories and update the Nginx configuration + ansible-playbook -i inventory.yml prod-playbook.yml --tags live -## Prepare assets +2. Generate the pages + (emacsconf-publish-watch-pages) +3. Add the $year/watch to the wiki. -### TODO Generate intro slides and overlays +4. Create a $year/watch.md manually. -We generate intro slides to display in between talks so that people -can find out information about the previous talk and learn about the -next talk. It includes talk titles, speaker names, URLs, and Q&A -methods. The image will also be used for an introduction video if we -can record one before the conference. +### DONE Status page -We also generate overlays that show talk information during the talk -itself. +Manually maintained -SVGs don’t support line-wrapping, so it helps to do a quick pass to -make sure all the talks are displayed properly. +/ssh:front0.emacsconf.org:/var/www/status.emacsconf.org/index.html + +### DONE Public media + +Start of year: + +1. Set `media_protect_root` to true in Ansible `group_vars/all.yml`. +2. `ansible-playbook -i inventory.yml prod-playbook.yml --tags media` +3. Generate the index with `emacsconf-publish-update-media` + +Confirm by setting a submitted talk to `PLAYING` and testing with + . The public media +directory should have the files and the entry should be in the index. +Switching it back to `TO_STREAM` and calling + should remove it. + +#### TODO Switch public media to unprotected root before the conference + +1. Clear public media directory. +2. Set `media_protect_root` to false in Ansible `group_vars/all.yml`. +3. `ansible-playbook -i inventory.yml prod-playbook.yml --tags media` + +You can generate the index with `emacsconf-publish-update-media`. + +### DONE Mumble + +If you see `Server connection rejected: Wrong certificate or password.`, use **Certificate Wizard** to reimport the .p12 file in that user’s home directory. + +### DONE Etherpad + + + +#### DONE Create pads for all the talks + +Because the pads refer to the next and previous talks and include the talk titles, this is best redone after the schedule has settled down. + +### DONE Pad proxy + +### DONE Overlays + + -### BLOCKED Generate redirects +### INPROGRESS Intros -We use redirects for Q&A sessions with BBB web conferences so that people can easily join the web conference. This is blocked while waiting for media.emacsconf.org. +Intro slides -### TODO Write 1-2 sentence intros for all the talks + + +[elisp:emacsconf-subed-intro-subtitles](emacsconf-subed-intro-subtitles) + + + +#### CANCELLED Write 1-2 sentence intros for all the talks We do a brief introduction before each talk so that people know the topic of the next talk, the pronunciation of the speaker’s name, the @@ -964,14 +1328,18 @@ Actually recording the introductions can wait until closer to the conference because talk titles and Q&A methods can change. We can verify speaker name pronunciations at that time. -#### Intros :levels: +Hmm… Actually, we can go ahead and record all of these so that +speakers can doublecheck pronunciations, and then we’ll re-record them +in case someone wants to get fancier about intros. + +##### Intros :levels: - Good: Use the same template as before: In this talk, SPEAKER shares TITLE OR SUMMARY. Afterwards, PRONOUN will handle questions over Q&A METHOD. - Better: Include some more biographical information to give listeners some context. -#### DONE Do we want to use honorifics like Dr.? :decision: +##### DONE Do we want to use honorifics like Dr.? :decision: DECISION: Include in the intro-review email: > We will usually introduce you by your first name (or handle, if you @@ -996,18 +1364,110 @@ use it when recording the intros. - OPTION: Using honorifics based on e-mail signatures and intros: - Recognizes credentials -### BLOCKED Record intro videos with 1-2 sentence intros for all the talks +#### DONE Record intro videos with 1-2 sentence intros for all the talks - +#### DONE Record the rest of the intros + +#### DONE Generate intro slides + +We generate intro slides to display in between talks so that people +can find out information about the previous talk and learn about the +next talk. It includes talk titles, speaker names, URLs, and Q&A +methods. The image will also be used for an introduction video if we +can record one before the conference. + +We also generate overlays that show talk information during the talk +itself. + +SVGs don’t support line-wrapping, so it helps to do a quick pass to +make sure all the talks are displayed properly. + +Hmm… Maybe I should take the names and pronouns off the video +overlay? Then there’s less worry about wrapping, and people can always +go to the URL to get more information. + + + +#### TODO Ask speakers to review intros + +after they’ve uploaded their videos, since we might be able to check the pronunciation ourselves + +### IRC channels -## Coordinate volunteers +- /opall +- /conftopic +- /deopall +#### TODO Confirm that the emacsconf user can connect -### DONE E-mail captioning volunteers the backstage instructions +I think I had that on orga@res.emacsconf.org -### TODO E-mail previous captioning volunteers to see if they’re interested in helping out +### IRC talk info -### TODO Prepare shift calendar +### Announcements + +### Publishing updates live + +### Autopilot + +### YouTube + +### Peertube + +### 480p + +Consider increasing memory/cpu configuration on live? + + + +#### TODO Figure out a better way to handle 480p stream :corwin: + +It kept dropping last year and sachac didn’t have the mental bandwidth to figure it out. +Might need another node so that we don’t risk it getting killed for memory reasons? + +Corwin has volunteered to take this on + +### Audio processing + + + + +#### TODO Find volunteers for audio processing (normalization, noise reduction) and document the process :helpwanted: + +- audio normalization +- noise reduction + +### TODO Write something for merging in information from previous years if not specified + +- availability +- timezone +- name +- short name +- pronouns + + + +## Get ready for production + + +### A day or two before + +group_vars/all.yml: + + test_mode: false + media_protect_root: false + + ansible-playbook -i inventory.ml prod-playbook.yml --tags stream + ansible-playbook -i inventory.ml prod-playbook.yml --tags media + +Resize the nodes + + + +## Volunteers + + +### TODO Prepare shift calendar, ask people to sign up @@ -1015,7 +1475,7 @@ AM: 9-12 PM EST, PM: 1-5 PM EST (plus a little extra for setup/transition) Saturday Dec 2 2023 - +
@@ -1089,7 +1549,7 @@ Saturday Dec 2 2023 Sunday Dec 3 2023 -
+
@@ -1348,6 +1808,8 @@ Note: Let’s see if we can decide on this by Graphical view of the schedule Schedule for Saturday Saturday 9:00- 9:10 Saturday opening remarks sat-open 9:10- 9:20 An Org-Mode based text adventure game for learning the basics of Emacs, inside Emacs, written in Emacs Lisp adventure 9:30- 9:50 Authoring and presenting university courses with Emacs and a full libre software stack uni 10:05-10:25 Teaching computer and data science with literate programming tools teaching 10:40-10:50 Who needs Excel? Managing your students qualifications with org-table table 11:05-11:15 Taming things with Org Mode taming 11:30-11:50 one.el: the static site generator for Emacs Lisp Programmers one 1:00- 1:10 Emacs turbo-charges my writing writing 1:25- 1:35 Why Nabokov would use Org-Mode if he were writing today nabokov 1:50- 2:10 Collaborative data processing and documenting using org-babel collab 2:20- 2:40 How I play TTRPGs in Emacs solo 2:55- 3:15 Org-Mode workflow: informal reference tracking ref 3:25- 3:35 (Un)entangling projects and repos unentangling 3:45- 3:55 Emacs development updates devel 4:10- 4:50 Emacs core development: how it works core 5:05- 5:15 Saturday closing remarks sat-close 10:00-10:10 MatplotLLM, iterative natural language data visualization in org-babel matplotllm 10:20-10:40 Improving access to AI-assisted literate programming with voice control voice 10:55-11:15 LLM clients in Emacs, functionality and standardization llm 1:00- 1:20 Improving compiler diagnostics with Overlays overlay 1:35- 1:45 Editor Integrated REPL Driven Development for all languages eval 2:00- 2:40 REPLs in strange places: Lua, LaTeX, LPeg, LPegRex, TikZ repl 2:50- 3:10 EmacsConf.org: How we use Org Mode and TRAMP to organize and run a multi-track conference emacsconf 9 AM 10 AM 11 AM 12 PM 1 PM 2 PM 3 PM 4 PM 5 PM Schedule for Sunday Sunday 9:00- 9:05 Sunday opening remarks sun-open 9:05- 9:25 Top 10 ways Hyperbole amps up Emacs hyperamp 9:40-10:00 Using Koutline for stream of thought journaling koutline 10:10-10:20 Parallel Text Replacement: Does P = NP? parallel 10:35-10:45 Eat and Eat powered Eshell, fast featureful terminal inside Emacs eat 11:00-11:20 The browser in a buffer poltys 11:35-11:55 Speedcubing in Emacs cubing 1:00- 1:40 Emacs MultiMedia System (EMMS) emms 1:55- 2:25 Programming at 200 wpm steno 2:35- 2:45 Mentoring VS-Coders as an Emacsian (or How to show not tell people about the wonders of Emacs) mentor 3:10- 3:50 Emacs saves the Web web 4:05- 4:25 Sharing Emacs is Caring Emacs: Emacs education and why I embraced video sharing 4:40- 4:50 Sunday closing remarks sun-close 10:00-10:20 Bringing joy to Scheme programming scheme 10:35-10:55 What I learned by writing test cases for GNU Hyperbole test 11:10-11:30 GNU Emacs: A World of Possibilities world 11:45-11:55 A modern Emacs look-and-feel without pain flat 1:00- 1:20 emacs-gc-stats: Does garbage collection actually slow down Emacs? gc 1:35- 2:15 hyperdrive.el: Peer-to-peer filesystem in Emacs hyperdrive 2:30- 2:40 Writing a language server in OCaml for Emacs, fun, and profit lspocaml 2:55- 3:35 Windows into Freedom windows 3:50- 4:10 The Emacsen family, the design of an Emacs and the importance of Lisp emacsen 9 AM 10 AM 11 AM 12 PM 1 PM 2 PM 3 PM 4 PM 5 PM + What if we have three tracks instead? - Two-track advantages as in EmacsConf 2022: @@ -1365,6 +1827,8 @@ What if we have three tracks instead? - Allows us to have 20 minutes between talks instead of 15 - Might be easier to test the idea for just one part of the conference + Graphical view of the schedule Schedule for Saturday Saturday 9:00- 9:10 Saturday opening remarks sat-open 9:10- 9:20 An Org-Mode based text adventure game for learning the basics of Emacs, inside Emacs, written in Emacs Lisp adventure 9:40-10:00 Authoring and presenting university courses with Emacs and a full libre software stack uni 10:30-10:40 Who needs Excel? Managing your students qualifications with org-table table 11:15-11:35 Teaching computer and data science with literate programming tools teaching 1:00- 1:20 Collaborative data processing and documenting using org-babel collab 1:40- 2:00 Watch Over Our Folders woof 2:20- 2:40 How I play TTRPGs in Emacs solo 3:00- 3:10 The many ways to browse Hacker News from Emacs hn 3:30- 4:10 Emacs saves the Web web 4:30- 4:40 Saturday closing remarks sat-close 9:40-10:00 one.el: the static site generator for Emacs Lisp Programmers one 10:30-10:50 The browser in a buffer poltys 11:15-11:25 Taming things with Org Mode taming 1:00- 1:10 Emacs turbo-charges my writing writing 1:40- 1:50 Why Nabokov would use Org-Mode if he were writing today nabokov 2:20- 2:50 Programming at 200 wpm steno 3:30- 3:50 The Emacsen family, the design of an Emacs and the importance of Lisp emacsen 9:40- 9:50 MatplotLLM, iterative natural language data visualization in org-babel matplotllm 10:30-10:50 Improving access to AI-assisted literate programming with voice control voice 11:15-11:35 LLM clients in Emacs, functionality and standardization llm 1:00- 1:20 Improving compiler diagnostics with Overlays overlay 1:40- 1:50 Editor Integrated REPL Driven Development for all languages eval 2:20- 3:00 REPLs in strange places: Lua, LaTeX, LPeg, LPegRex, TikZ repl 3:30- 3:50 EmacsConf.org: How we use Org Mode and TRAMP to organize and run a multi-track conference emacsconf 9 AM 10 AM 11 AM 12 PM 1 PM 2 PM 3 PM 4 PM 5 PM Schedule for Sunday Sunday 9:00- 9:10 Sunday opening remarks sun-open 9:10- 9:30 Top 10 ways Hyperbole amps up Emacs hyperamp 10:00-10:20 Using Koutline for stream of thought journaling koutline 11:00-11:20 What I learned by writing test cases for GNU Hyperbole test 1:00- 1:40 Emacs MultiMedia System (EMMS) emms 2:00- 2:10 Emacs development updates devel 2:30- 2:40 Mentoring VS-Coders as an Emacsian (or How to show not tell people about the wonders of Emacs) mentor 3:00- 3:20 Sharing Emacs is Caring Emacs: Emacs education and why I embraced video sharing 4:00- 4:10 Sunday closing remarks sun-close 10:00-10:10 Parallel Text Replacement: Does P = NP? parallel 10:30-10:40 Eat and Eat powered Eshell, fast featureful terminal inside Emacs eat 11:00-11:20 emacs-gc-stats: Does garbage collection actually slow down Emacs? gc 1:00- 1:40 hyperdrive.el: Peer-to-peer filesystem in Emacs hyperdrive 2:00- 2:20 Org-Mode workflow: informal reference tracking ref 3:00- 3:10 (Un)entangling projects and repos unentangling 10:00-10:20 Bringing joy to Scheme programming scheme 11:00-11:10 Writing a language server in OCaml for Emacs, fun, and profit lspocaml 11:30-11:40 A modern Emacs look-and-feel without pain flat 1:00- 1:40 Windows into Freedom windows 2:00- 2:20 Speedcubing in Emacs cubing 3:00- 3:20 GNU Emacs for electronics, note-taking, and as lightweight IDE extending 9 AM 10 AM 11 AM 12 PM 1 PM 2 PM 3 PM 4 PM 5 PM + ### Three tracks for Sunday morning? @@ -1373,3 +1837,5 @@ What if we have three tracks instead? - world: Ends at 16:20 after 11:30 - Missing talks: core + Graphical view of the schedule Schedule for Saturday Saturday 9 AM 10 AM 11 AM 12 PM 1 PM 2 PM 3 PM 4 PM 5 PM Schedule for Sunday Sunday 9 AM 10 AM 11 AM 12 PM 1 PM 2 PM 3 PM 4 PM 5 PM + -- cgit v1.2.3