update harvest task

1 files changed, 108 insertions, 82 deletions

diff --git a/2022/organizers-notebook/index.org b/2022/organizers-notebook/index.org
index ca463ff1..423a20f9 100644
--- a/2022/organizers-notebook/index.org
+++ b/2022/organizers-notebook/index.org
@@ -81,31 +81,32 @@ scramble to do in order to get the conference off the ground. *bold*
 is our current goal. Feel free to volunteer for anything that
 interests you!
 
-|                        | Good                                    | Better                               | Best                                                         |
-|------------------------+-----------------------------------------+--------------------------------------+--------------------------------------------------------------|
-| [[#conforg][conf.org management]]    | on sachac's laptop                      | S: on res.emacsconf.org              | *DONE S/Z: other people know how to work with it*            |
-| [[#prepare-prerec-process][prerec]]                 | convert to webm                         | normalize audio                      | *[[#mastering][DONE Z: reduce noise]]*                                       |
-| [[#publish-live][talk pages]]             | DONE S: link to stream, pad, IRC        | *S: link to prerec when live*        | embed stream, pad, IRC, prerec                               |
-| [[#sched-decision][schedule]]               | one track                               | *DONE S: two tracks*                 | aligned times, full roster                                   |
-| [[#upload][upload]]                 | FTP                                     | *DONE S: web-based*                  | auto-encoded, preview (SReview?)                             |
-| [[#streaming][streaming]]              | ffmpeg from computer                    | OBS                                  | *DONE: OBS in cloud, switchable hosts*                       |
-| [[#other-streams][other streams]]          | 480p                                    | + Toobnix                            | *S: + YouTube*                                               |
-| [[#coordinate-volunteers][volunteer coordination]] | ad-hoc                                  | *DONE playbook*                      | training meetings + recordings                               |
-| BBB rooms              | about 5 rooms that we cycle through     |                                      | *DONE S: one room per speaker*                               |
-| host                   | no host, speaker reads pad              | *host reads pad*                     | host monitors IRC and helps with BBB as well                 |
-| BBB Q&A                | none                                    | *DONE open to community*             | moderated by speaker and host                                |
-| BBB Q&A start          | awkward silence while waiting           | *speaker can demo a little*          | host has prepared questions just in case no one shows up     |
-| [[#write-viewing][watch page]]             | tracks                                  | + IRC                                | *DONE S: + talk info*, maybe even current/recent/next        |
-| [[#etherpad][pad]]                    | one pad for conf                        | one pad per talk, wikimedia          | *DONE S: one pad per talk, self-hosted* so we can access API |
-| [[#irc][IRC]]                    | #emacsconf, -org                        | *DONE #emacsconf, -gen, -dev, -org*  | IRC volunteer copying to pads; maybe even IRC bots           |
-| [[#irc-announce][IRC announcements]]      | ERC commands                            | *DONE S: hook-based*                 | timer-based                                                  |
-| [[#publishing-sched][sched update]]           | *DONE S: publish at start*              | update main sched                    | update talk pages                                            |
-| [[#video-platforms][other platforms]]        | *S: Toobnix & YT after event*           |                                      | S: Toobnix + YT when live                                    |
-| schedule view          | text table                              | imagemap fallback                    | *DONE S: interactive SVG*                                    |
-| [[#caption-workflow][caption workflow]]       | YT autosubs                             | Whisper autosubs                     | *DONE: Whisper + more granular timestamps*                   |
-| [[#wiki-design][wiki]]                   | plain text, markdown                    | *DONE S: some JS and CSS enrichment* | more JS and CSS, embeds, videoplayer                         |
-| [[#ansible][ansible]]                | none                                    | *DONE S: some automation*            | comprehensive, can also work against containers              |
-| [[#intro][intro and exit]]         | *DONE: slide on screen, host on Mumble* | per-talk video, recorded voiceover   | Emacs thing so we can display info, countdowns, IRC          |
+|                        | Good                                      | Better                               | Best                                                         |
+|------------------------+-------------------------------------------+--------------------------------------+--------------------------------------------------------------|
+| [[#harvest][harvesting talks & Q&A]] | *recordings trimmed if needed, published* | chapter markers                      | edited transcripts                                           |
+| [[#conforg][conf.org management]]    | on sachac's laptop                        | S: on res.emacsconf.org              | *DONE S/Z: other people know how to work with it*            |
+| [[#prepare-prerec-process][prerec]]                 | convert to webm                           | normalize audio                      | *[[#mastering][DONE Z: reduce noise]]*                                       |
+| [[#publish-live][talk pages]]             | DONE S: link to stream, pad, IRC          | *S: link to prerec when live*        | embed stream, pad, IRC, prerec                               |
+| [[#sched-decision][schedule]]               | one track                                 | *DONE S: two tracks*                 | aligned times, full roster                                   |
+| [[#upload][upload]]                 | FTP                                       | *DONE S: web-based*                  | auto-encoded, preview (SReview?)                             |
+| [[#streaming][streaming]]              | ffmpeg from computer                      | OBS                                  | *DONE: OBS in cloud, switchable hosts*                       |
+| [[#other-streams][other streams]]          | 480p                                      | + Toobnix                            | *S: + YouTube*                                               |
+| [[#coordinate-volunteers][volunteer coordination]] | ad-hoc                                    | *DONE playbook*                      | training meetings + recordings                               |
+| BBB rooms              | about 5 rooms that we cycle through       |                                      | *DONE S: one room per speaker*                               |
+| host                   | no host, speaker reads pad                | *host reads pad*                     | host monitors IRC and helps with BBB as well                 |
+| BBB Q&A                | none                                      | *DONE open to community*             | moderated by speaker and host                                |
+| BBB Q&A start          | awkward silence while waiting             | *speaker can demo a little*          | host has prepared questions just in case no one shows up     |
+| [[#write-viewing][watch page]]             | tracks                                    | + IRC                                | *DONE S: + talk info*, maybe even current/recent/next        |
+| [[#etherpad][pad]]                    | one pad for conf                          | one pad per talk, wikimedia          | *DONE S: one pad per talk, self-hosted* so we can access API |
+| [[#irc][IRC]]                    | #emacsconf, -org                          | *DONE #emacsconf, -gen, -dev, -org*  | IRC volunteer copying to pads; maybe even IRC bots           |
+| [[#irc-announce][IRC announcements]]      | ERC commands                              | *DONE S: hook-based*                 | timer-based                                                  |
+| [[#publishing-sched][sched update]]           | *DONE S: publish at start*                | update main sched                    | update talk pages                                            |
+| [[#video-platforms][other platforms]]        | *S: Toobnix & YT after event*             |                                      | S: Toobnix + YT when live                                    |
+| schedule view          | text table                                | imagemap fallback                    | *DONE S: interactive SVG*                                    |
+| [[#caption-workflow][caption workflow]]       | YT autosubs                               | Whisper autosubs                     | *DONE: Whisper + more granular timestamps*                   |
+| [[#wiki-design][wiki]]                   | plain text, markdown                      | *DONE S: some JS and CSS enrichment* | more JS and CSS, embeds, videoplayer                         |
+| [[#ansible][ansible]]                | none                                      | *DONE S: some automation*            | comprehensive, can also work against containers              |
+| [[#intro][intro and exit]]         | *DONE: slide on screen, host on Mumble*   | per-talk video, recorded voiceover   | Emacs thing so we can display info, countdowns, IRC          |
 
 * Projects and other long-running tasks
 :PROPERTIES:
@@ -113,12 +114,77 @@ interests you!
 :END:
 
 #+TOC: headlines 1 local
-** Archive live talks and Q&A
+** Harvest live talks and Q&A
 :PROPERTIES:
 :CUSTOM_ID: harvest
 :END:
+*** DONE Document this phase of the conference
+CLOSED: [2022-12-08 Thu 20:54]
+:PROPERTIES:
+:CREATED:  [2022-12-08 Thu 19:33]
+:END:
+
+We're now in the harvesting phase of the conference, where we work on
+collecting the ideas that people shared in the Q&A sessions as well as
+any talks that were not available as pre-recorded videos. It's a great
+way to help speakers get stuff out of their heads and into a form we
+can all learn from. =)
+
+Status of talks and Q&A sessions:
+
+- All talks except for the new version of grail should now be
+  available at https://media.emacsconf.org/2022/ and on talk pages
+- Links to the BBB playbacks and to the various BBB resources (--bbb-*
+  for each talk) are now in the backstage area for speakers and/or
+  volunteers to review
+- RMS Q&A audio has been uploaded (--questions.ogg)
+- grail talk will be reuploaded by the speaker
+- IRC logs have been copied to the backstage area; see the links at
+  the top of the backstage area
+- Etherpads have been converted to Markdown and included on the talk pages
+- BBB chats have been converted to Markdown and included on the talk pages
+  
+Here's a good/better/best scale for stuff we can do during this phase:
+
+- Good:
+  - Look at IRC log at the top of the backstage area and copy
+    anonymized questions/answers/feedback to the wiki pages as well,
+    if they weren't already on the page
+    - Somewhat manual because of overlapping conversations; might be
+      easier to have one volunteer do all the talks in one shift
+      (Saturday morning gen, Saturday morning dev, Saturday afternoon
+      gen, etc.), so you can e-mail to call dibs if you like. We
+      usually remove names from the public log as well. Most of the
+      conversations should be in the track-specific channels, but some
+      might have ended up in #emacsconf as well. You can check the
+      talk page to see if the questions are already there. If you're
+      already set up to edit the wiki or you can figure out the
+      slightly complicated setup for editing, feel free to edit the
+      page directly. If not, you can email a Markdown or Org Mode
+      snippet to emacsconf-submit@gnu.org and let me know what page to
+      put it on.
+- Better:
+  - Review the BBB recording to check if there's anything that needs
+    to be deleted from the recording before we publish it so that
+    people can listen to things themselves; publish the recording or
+    excerpts of it
+    - Might be easier with the transcript, but can also be done
+      without one. asmblox, async, buttons, dbus, detached, and eshell
+      have --bbb-webcams.vtt as the autogenerated Whisper transcripts.
+- Even better than that:
+  - Make chapter markers for the Q&A recording so that people can jump
+    to the question they're particularly interested in. You can write
+    them in the form:
+    mm:ss text goes here
+    mm:ss more text
+    and I can turn those into chapter headings.
+- Totally awesome:
+  - Edited captions/transcripts for the Q&A
+  - Answers copied into the Q&A section, possibly with linked timestamps
+
 *** TODO Prepare groundwork for volunteers to help
-**** TODO Document IRC/pad/BBB chat extraction tasks
+**** CANCELLED Document IRC/pad/BBB chat extraction tasks
+CLOSED: [2022-12-08 Thu 20:35]
 
 Experience level: no technical background needed; slightly easier if you've set up your computer for editing the wiki, which needs ssh and git
 
@@ -131,8 +197,10 @@ You can see the 2021 talks (ex: https://emacsconf.org/2021/talks/frownies/ , htt
 To avoid duplicating work, maybe we can use this Etherpad to call dibs on talks to process. You can write your name or nick next to the talk(s) you're archiving.
 
 If you're already set up to edit the wiki or you can figure out the slightly complicated setup for editing, feel free to edit the page directly. If not, you can email a Markdown or Org Mode snippet to emacsconf-submit@gnu.org and let me know what page to put it on.
-*** TODO Check duration of Q&A BBB recordings
+*** DONE Check duration of Q&A BBB recordings
+CLOSED: [2022-12-08 Thu 20:35]
 
+About 15 hours total
 #+begin_src emacs-lisp :eval no
 (format-seconds "%h:%.2m:%.2s"
 								(/ (apply '+
@@ -203,10 +271,12 @@ for SLUG in *; do
   )
 done
 #+end_src
-*** TODO Extract RMS Q&A from dump
+*** DONE Extract RMS Q&A from dump
+CLOSED: [2022-12-08 Thu 20:35]
 17:48 of current
 
-**** SOMEDAY Ffmpeg
+**** DONE Ffmpeg
+CLOSED: [2022-12-08 Thu 20:35]
 :PROPERTIES:
 :CREATED:  [2022-12-04 Sun 20:18]
 :END:
@@ -216,7 +286,8 @@ done
 [19:29] <bandali> a reminder that the stream dumps shouldn't be used as-is, and should first be remuxed using ffmpeg to fix the timestamps
 [19:30] <bandali> using something like this: ffmpeg -i myfile.webm -acodec copy -vcodec copy myfile-remuxed.webm >> myfile.log 2>&1
 
-*** TODO Extract orgvm talk
+*** DONE Extract orgvm talk
+CLOSED: [2022-12-08 Thu 20:35]
 *** DONE Post IRC logs to backstage so that volunteers can split them up
 CLOSED: [2022-12-06 Tue 09:55]
 
@@ -234,14 +305,16 @@ See links at the top of backstage
 :CREATED:  [2022-12-04 Sun 20:38]
 :END:
 
-*** SOMEDAY Collect recordings from bbb
+*** DONE Collect recordings from bbb
+CLOSED: [2022-12-08 Thu 20:36]
 :PROPERTIES:
 :CREATED:  [2022-12-04 Sun 20:38]
 :END:
 
-*** TODO Back up all the pads
-SCHEDULED: <2022-12-05 Mon>
-*** STARTED Extract bbb chat and add to backstage
+*** DONE Back up all the pads
+CLOSED: [2022-12-08 Thu 20:35] SCHEDULED: <2022-12-05 Mon>
+*** DONE Extract bbb chat and add to backstage
+CLOSED: [2022-12-08 Thu 20:35]
 :PROPERTIES:
 :CREATED:  [2022-12-06 Tue 12:04]
 :Effort:   0:30
@@ -274,53 +347,6 @@ To avoid duplicating work, maybe we can use this Etherpad to call dibs on talks
 
 If you're already set up to edit the wiki or you can figure out the slightly complicated setup for editing, feel free to edit the page directly. If not, you can email a Markdown or Org Mode snippet to emacsconf-submit@gnu.org and let me know what page to put it on.
 
-*** SOMEDAY Document this phase of the conference
-:PROPERTIES:
-:CREATED:  [2022-12-08 Thu 19:33]
-:END:
-
-We're now in the harvesting phase of the conference, where we work on
-collecting the ideas that people shared in the Q&A sessions as well as
-any talks that were not available as pre-recorded videos.
-
-Status of talks and Q&A sessions:
-- All talks except for the new version of grail should now be available at https://media.emacsconf.org/2022/ and on talk pages
-- Links to the BBB playbacks and to the various BBB resources (--bbb-* for each talk)
-  are now in the backstage area for speakers and/or volunteers to
-  review
-- RMS Q&A audio has been uploaded (--questions.ogg)
-- grail talk will be reuploaded by the speaker
-- IRC logs have been copied to the backstage area; see the links at the top
-- Etherpads have been exported to HTML and converted to pads; see --pad.txt for each talk
-
-Here's a good/better/best scale for stuff to do during this phase:
-
-- Good:
-  - Add Etherpad text to wiki pages for talks
-    - The text is pretty structured, so this might even be somewhat
-      automatable
-  - Look at the BBB text chat copy anonymized questions/answers/feedback to
-    the wiki pages as well, if they weren't already on the page
-    - The text is split up by room and tends to be pretty short, so
-      this might be something I can quickly whip up
-  - Look at IRC log and copy anonymized questions/answers/feedback to
-    the wiki pages as well, if they weren't already on the page
-    - Slightly more manual because of overlapping conversations
-- Better:
-  - Review the BBB recording to check if there's anything that needs
-    to be deleted from the recording before we publish it so that
-    people can listen to things themselves; publish the recording or
-    excerpts of it
-    - Might be easier with the transcript, but can also be done without one
-- Even better than that:
-  - Make chapter markers for the Q&A recording so that people can jump
-    to the question they're particularly interested in
-- Totally awesome:
-  - Edited captions/transcripts for the Q&A
-  - Answers copied into the Q&A section, possibly with timestamps
-
-
-
 ** TODO Send thanks
 :PROPERTIES:
 :CUSTOM_ID: thanks