update tasks

1 files changed, 219 insertions, 219 deletions

diff --git a/2022/organizers-notebook/index.org b/2022/organizers-notebook/index.org
index a3e7b779..490f41d0 100644
--- a/2022/organizers-notebook/index.org
+++ b/2022/organizers-notebook/index.org
@@ -266,58 +266,6 @@ Sacha Chua
 #+TOC: headlines 1 local
 
 Ordered by importance.
-** DONE [#A] Figure out web-based file upload   :needsowner:sachac:ansible:
-CLOSED: [2022-10-19 Wed 09:20] SCHEDULED: <2022-10-18 Tue>
-:PROPERTIES:
-:CUSTOM_ID: upload
-:END:
-zaeph: I can work on it, but I’m not experienced in this domain, so I’d prefer to be a back-up.
-task is currently with bandali
-
-Lesson learned from last year: "Since people kept running into ftp
-problems, we might want to set up a web-frontend next year to minimise
-problems."
-
-Maybe we could ask some of the volunteers who wanted to help us with
-the infra? It shouldn’t be complicated to deploy a ready-made
-solution.
-
-"file drop" is a common keyword for looking for information.
-Considerations:
-- Probably run it on media.emacsconf.org
-- Bonus features:
-  - password-protected or hidden behind some kind of authentication or hidden behind some kind of URL, so we don't have to worry too much about spam
-  - extra points for sending speakers links to upload to specific folders so that we can separate resources by talk
-  - Resumable uploads would be good, since some speakers had a hard time with unreliable connections
-- What other conferences do:
-  - LibrePlanet uses plain FTP and recommends FileZilla https://libreplanet.org/wiki/Video_upload_instructions
-  - FOSSDEM uses Pentabarf to receive uploads  https://archive.fosdem.org/2022/manuals/program/speaker/
-  - DebConf uses SReview(?)
-  - FOSSGIS uses Seafile https://vmx.cx/cgi-bin/blog/index.cgi/video-uploads-for-an-online-conference%3A2021-06-12%3Aen%2Cconference%2Cgeo
-- Some options:
-
-  | Project                                      | Docker   | Buster | Base      | Notes                              |
-  | https://www.projectsend.org/                 |          |        | php+mysql |                                    |
-  | https://github.com/pomf/pomf                 |          |        | php+mysql |                                    |
-  | https://github.com/psi-4ward/psitransfer     | official |        | node      | can set upload password, resumable; data volume needs uid 1000 |
-  | https://github.com/epoupon/fileshelter       | official | ppa    | C++       |                                    |
-  | https://github.com/mickael-kerjean/filestash | official |        |           | general FTP client                 |
-  | https://gitlab.com/moejo42/Jirafeau          | official |        | php       |                                    |
-  | https://github.com/YouTransfer/YouTransfer   | official |        | node      | looking for maint                  |
-  | https://github.com/dutchcoders/transfer.sh/  |          |        |           |                                    |
-  | https://github.com/eikek/sharry              |          |        |           |                                    |
-  - NextCloud
-
-  anon FTP upload currently goes to /srv/ftp/anon/ on media.emacsconf.org
-
-  [[file:/ssh:media|sudo::/etc/vsftpd.conf]]
-
-  Maybe I'll do psitransfer as a direct install
-    
-*** DONE Create 2022/upload.md with the same workflow as last year for a start
-CLOSED: [2022-10-18 Tue 14:37]
-*** DONE Implement new workflow
-CLOSED: [2022-10-18 Tue 14:37]
 ** TODO Coordinate and help volunteers                              :sachac:
 :PROPERTIES:
 :CUSTOM_ID: coordinate-volunteers
@@ -405,129 +353,6 @@ We need time after the prerecs get submitted to:
 
 Make changes in [[#prerec-process]]
   
-** INPROGRESS Plan Etherpad use and hosting                 :sachac:ansible:
-DEADLINE: <2022-10-15 Sat>
-:PROPERTIES:
-:CUSTOM_ID: etherpad
-:END:
-
-- Relevant links:
-  - Per-pad, nicely structured info with abstract, watching information, etc. CarpentryCon 2022 Schedule • CarpentryCon 2022 https://2022.carpentrycon.org/
-  - One pad per session: https://meta.wikimedia.org/wiki/Arctic_Knot_Conference_2021/Program#Friday,_June_25th
-  - [[https://community.jitsi.org/t/tutorial-etherpad-integration-in-jitsi-meetings/99697][Etherpad integration in Jitsi ]]
-
-- Good: One pad per session
-- Better: Some kind of monitoring so that we can link to the pads or embed
-  the pads even before the conference starts while not risking too
-  much vandalism
-- Best:
-  - Pad can be easily regenerated from Emacs Lisp with a check to see if people have been adding to it
-  - Pad links to next talks
-
-Where should we host this?
-- live0: gets scaled up the most, lots of people connect to it for the conference, didn't hit performance constraints last time
-- front0: lower risk of interfering with stream
-- bbb: will already be put on strain with the concurrent streams (test showed it was stable with up to 10 concurrent video streams and 40 total participants)
-- opal’s: no news from owner, but beefy server that we used for reencode last  year
-- new Linode (probably 4GB or 8GB shared CPU): can easily be spun up, yay Ansible
-    
-[[#ansible][Ansible notes]]
-
-Consider if we need extra scaling beyond being on a beefy live0?
-- Scale calculator: https://scale.etherpad.org/
-  - assuming 3 concurrent authors, 100 lurkers per pad, 3 concurrent pads
-  - 1 core, 4GB RAM, bandwidth Mb/s: 7.488
-- https://mclear.co.uk/2021/09/08/deploying-etherpad-at-scale-in-one-minute/
-- https://github.com/ether/etherpad-load-test
-
-Will need to try this again when we resize nodes. Probably just the extra memory will be enough and the CPU use from node won't step on the streaming, but not sure
-
-*** DONE Use the API to create pages based on all the slugs
-CLOSED: [2022-10-11 Tue 20:41]
-*** CANCELLED Figure out monitoring; maybe get everything daily and commit to git repo?
-CLOSED: [2022-10-12 Wed 20:31]
-History or regeneration will be fine. We'll probably link to it shortly before the event, and we can also turn off the service until we're ready.
-*** DONE Generate talk-specific pad content
-CLOSED: [2022-10-12 Wed 20:31]
-*** DONE Set up nginx reverse proxy
-CLOSED: [2022-10-13 Thu 12:19]
-*** DONE Load-test
-CLOSED: [2022-10-13 Thu 12:32]
-
-tl;dr: Either a separate 4GB Linode or being on live0 will probably be
-okay, but I'm not 100% sure due to the limitations of my load-testing
-setup. I don't know if we need to shard by pad.
-
-It looks like etherpad-load-test tends to max out at ~40 connections
-on a specific node. I used GNU Parallel to run the loadtesting tool
-against a 4GB Linode instance (shared CPU) from five nodes at the same
-time (my X220, my 2GB Linode instance, front0, and the node with the
-pad), and they all reached about 35-45 clients before failure (not
-updating within 100ms).
-
-#+begin_src sh :eval no
-echo 'node node_modules/etherpad-load-test/app.js http://170.187.195.5:9001 -d 120 > ~/output.txt' | parallel -J loadtest -j 1 --onall --verbose --tag
-#+end_src
-
-#+begin_src sh :eval no :results output replace
-echo 'grep Local ~/output.txt | tail -1' | parallel -J loadtest -j 1 --onall --tag
-#+end_src
-
-#+RESULTS:
-:results:
-:	Local Clients Connected: 43
-front	Local Clients Connected: 43
-live	Local Clients Connected: 44
-root@170.187.195.5	Local Clients Connected: 38
-web	Local Clients Connected: 42
-:end:
-
-Files were created at roughly the same time, so the max loads probably
-overlapped. It would be good to have finer control over the
-etherpad-load-test tool. Haven't figured out how to properly use ~-l~
-and ~-a~ yet.
-
-#+begin_src sh :eval no :results output replace
-echo 'stat -c %y ~/output.txt' | parallel -J loadtest -j 1 --onall --tag
-#+end_src
-
-#+RESULTS:
-:results:
-:	2022-10-13 12:42:32.212744774 -0400
-front	2022-10-13 16:42:34.466605650 +0000
-live	2022-10-13 16:38:46.818016379 +0000
-root@170.187.195.5	2022-10-13 16:39:01.738965567 +0000
-web	2022-10-13 12:39:14.417086960 -0400
-:end:
-
-CPU graph went only up to 5%. Network max was 2.36 Mb/s in, 1.25 Mb/s out.
-looking at top, CPU seems to go only up to about 12% or so.
-*** DONE Set up pad.emacsconf.org to point to live0.emacsconf.org :bandali:
-CLOSED: [2022-10-17 Mon 00:31] DEADLINE: <2022-11-12 Sat>
-*** DONE Set up letsencrypt
-CLOSED: [2022-10-16 Sun 14:42]
-Waiting for DNS
-add to /etc/dehydrated/domains.txt
-sudo sh -x /etc/cron.daily/renew-https-cert-local
-*** TODO Link to pad from talk page
-SCHEDULED: <2022-11-15 Tue>
-*** DONE Add links to general conference pad
-CLOSED: [2022-10-19 Wed 09:22]
-for collecting feedback
-*** TODO Prototype shift pads for easier scrolling
-if we can get the anchor plugin
-*** DONE Be able to fall back to wikimedia if necessary, maybe with nginx redirects
-CLOSED: [2022-10-13 Thu 13:55]
-*** DONE Export pad initial content HTML to make it easier to reimport into wikimedia or elsewhere
-CLOSED: [2022-10-13 Thu 13:46]
-~emacsconf-pad-export-initial-content-for-all-talks~
-** DONE Update IRC instructions because of multiple tracks 
-CLOSED: [2022-10-16 Sun 17:39]
-:PROPERTIES:
-:CUSTOM_ID: irc
-:END:
-
-Added to watch pages
 ** TODO Investigate streaming options, maybe OBS in the cloud :corwin:
 DEADLINE: <2022-11-20 Sun>
 :PROPERTIES:
@@ -609,25 +434,6 @@ pads
 See break commercials
 https://www.collabmagazine.com/organizing-a-multi-track-virtual-conference-with-microsoft-teams-live-events-a-technical-playbook-and-lessons-learned/
 
-** DONE Move scheduling and publishing code to Emacs on a VPS so that other people can help out :sachac:
-:PROPERTIES:
-:CUSTOM_ID: publishing-sched
-:END:
-Ideal:
-- Update pages with watching information, additional resources, etc. as talks go live
-- Update the schedule as needed (cancelled or reordered talks, etc.)
-
-Where:
-- front? my own VPS?
-
-  Nice if there's an Ansible playbook
-  
-  sachac's notes:
-  [[file:~/code/docker/emacsconf-publish/]]
-- probably good to set it up on front
-
-It's now on front. 
-
 ** TODO Create protocol for live Q&A                                 :zaeph:
 :PROPERTIES:
 :CUSTOM_ID: live-protocol
@@ -637,31 +443,6 @@ Objective:
 
 Comments:
 - It would be nice to have a protocol with speakers to tell us that they’re uncomfortable with a question, just so that we can find a smooth way to skip it.
-** DONE Set up BBB rooms and update conf.org                        :sachac:
-CLOSED: [2022-10-17 Mon 21:40]
-:PROPERTIES:
-:CUSTOM_ID: create-bbb
-:END:
-
-1. Log on to bbb.emacsverse.org as an admin.
-2. Create a room. Enable *Mute users when they join*.
-
-   The code below doesn't quite work, but might be a good starting point for future automation.
-   
-   #+begin_src emacs-lisp :eval no
-(setq list (seq-drop (emacsconf-bbb-room-title-list) 3)) ; skip some if needed
-(progn
-  (setq name (pop list))
-  (kill-new (format "name=\"%s\";$('#create-room-block').click();$('#create-room-name').val(name);$('#room_mute_on_join').click();$('.create-room-button').click();\n"
-                    name))
-  (sleep-for 1)
-  (shell-command "xdotool key alt+Tab sleep 3 key ctrl+v sleep 1 key Return"))
-#+end_src
-
-console.log(JSON.stringify([...document.querySelectorAll('.delete-room')].map((o) => { return { name: o.getAttribute('data-name'), path: o.getAttribute('data-path') }}).filter((o) => o.name.match(/^ec22/))))
-
-see conf.org for the rest of the process
-
 ** STANDBY Add nice-to-have stuff to prepare.md                      :zaeph:
 :PROPERTIES:
 :CUSTOM_ID: extra-prepare
@@ -844,6 +625,147 @@ SCHEDULED: <2022-12-14 Wed>
 :PROPERTIES:
 :CUSTOM_ID: upload-off
 :END:
+** INPROGRESS [#C] Plan Etherpad use and hosting            :sachac:ansible:
+DEADLINE: <2022-10-15 Sat>
+:PROPERTIES:
+:CUSTOM_ID: etherpad
+:END:
+
+- Relevant links:
+  - Per-pad, nicely structured info with abstract, watching information, etc. CarpentryCon 2022 Schedule • CarpentryCon 2022 https://2022.carpentrycon.org/
+  - One pad per session: https://meta.wikimedia.org/wiki/Arctic_Knot_Conference_2021/Program#Friday,_June_25th
+  - [[https://community.jitsi.org/t/tutorial-etherpad-integration-in-jitsi-meetings/99697][Etherpad integration in Jitsi ]]
+
+- Good: One pad per session
+- Better: Some kind of monitoring so that we can link to the pads or embed
+  the pads even before the conference starts while not risking too
+  much vandalism
+- Best:
+  - Pad can be easily regenerated from Emacs Lisp with a check to see if people have been adding to it
+  - Pad links to next talks
+
+Where should we host this?
+- live0: gets scaled up the most, lots of people connect to it for the conference, didn't hit performance constraints last time
+- front0: lower risk of interfering with stream
+- bbb: will already be put on strain with the concurrent streams (test showed it was stable with up to 10 concurrent video streams and 40 total participants)
+- opal’s: no news from owner, but beefy server that we used for reencode last  year
+- new Linode (probably 4GB or 8GB shared CPU): can easily be spun up, yay Ansible
+    
+[[#ansible][Ansible notes]]
+
+Consider if we need extra scaling beyond being on a beefy live0?
+- Scale calculator: https://scale.etherpad.org/
+  - assuming 3 concurrent authors, 100 lurkers per pad, 3 concurrent pads
+  - 1 core, 4GB RAM, bandwidth Mb/s: 7.488
+- https://mclear.co.uk/2021/09/08/deploying-etherpad-at-scale-in-one-minute/
+- https://github.com/ether/etherpad-load-test
+
+Will need to try this again when we resize nodes. Probably just the extra memory will be enough and the CPU use from node won't step on the streaming, but not sure
+
+*** DONE Use the API to create pages based on all the slugs
+CLOSED: [2022-10-11 Tue 20:41]
+*** CANCELLED Figure out monitoring; maybe get everything daily and commit to git repo?
+CLOSED: [2022-10-12 Wed 20:31]
+History or regeneration will be fine. We'll probably link to it shortly before the event, and we can also turn off the service until we're ready.
+*** DONE Generate talk-specific pad content
+CLOSED: [2022-10-12 Wed 20:31]
+*** DONE Set up nginx reverse proxy
+CLOSED: [2022-10-13 Thu 12:19]
+*** DONE Load-test
+CLOSED: [2022-10-13 Thu 12:32]
+
+tl;dr: Either a separate 4GB Linode or being on live0 will probably be
+okay, but I'm not 100% sure due to the limitations of my load-testing
+setup. I don't know if we need to shard by pad.
+
+It looks like etherpad-load-test tends to max out at ~40 connections
+on a specific node. I used GNU Parallel to run the loadtesting tool
+against a 4GB Linode instance (shared CPU) from five nodes at the same
+time (my X220, my 2GB Linode instance, front0, and the node with the
+pad), and they all reached about 35-45 clients before failure (not
+updating within 100ms).
+
+#+begin_src sh :eval no
+echo 'node node_modules/etherpad-load-test/app.js http://170.187.195.5:9001 -d 120 > ~/output.txt' | parallel -J loadtest -j 1 --onall --verbose --tag
+#+end_src
+
+#+begin_src sh :eval no :results output replace
+echo 'grep Local ~/output.txt | tail -1' | parallel -J loadtest -j 1 --onall --tag
+#+end_src
+
+#+RESULTS:
+:results:
+:	Local Clients Connected: 43
+front	Local Clients Connected: 43
+live	Local Clients Connected: 44
+root@170.187.195.5	Local Clients Connected: 38
+web	Local Clients Connected: 42
+:end:
+
+Files were created at roughly the same time, so the max loads probably
+overlapped. It would be good to have finer control over the
+etherpad-load-test tool. Haven't figured out how to properly use ~-l~
+and ~-a~ yet.
+
+#+begin_src sh :eval no :results output replace
+echo 'stat -c %y ~/output.txt' | parallel -J loadtest -j 1 --onall --tag
+#+end_src
+
+#+RESULTS:
+:results:
+:	2022-10-13 12:42:32.212744774 -0400
+front	2022-10-13 16:42:34.466605650 +0000
+live	2022-10-13 16:38:46.818016379 +0000
+root@170.187.195.5	2022-10-13 16:39:01.738965567 +0000
+web	2022-10-13 12:39:14.417086960 -0400
+:end:
+
+CPU graph went only up to 5%. Network max was 2.36 Mb/s in, 1.25 Mb/s out.
+looking at top, CPU seems to go only up to about 12% or so.
+*** DONE Set up pad.emacsconf.org to point to live0.emacsconf.org :bandali:
+CLOSED: [2022-10-17 Mon 00:31] DEADLINE: <2022-11-12 Sat>
+*** DONE Set up letsencrypt
+CLOSED: [2022-10-16 Sun 14:42]
+Waiting for DNS
+add to /etc/dehydrated/domains.txt
+sudo sh -x /etc/cron.daily/renew-https-cert-local
+*** TODO Link to pad from talk page
+SCHEDULED: <2022-11-15 Tue>
+*** DONE Add links to general conference pad
+CLOSED: [2022-10-19 Wed 09:22]
+for collecting feedback
+*** TODO Prototype shift pads for easier scrolling
+if we can get the anchor plugin
+*** DONE Be able to fall back to wikimedia if necessary, maybe with nginx redirects
+CLOSED: [2022-10-13 Thu 13:55]
+*** DONE Export pad initial content HTML to make it easier to reimport into wikimedia or elsewhere
+CLOSED: [2022-10-13 Thu 13:46]
+~emacsconf-pad-export-initial-content-for-all-talks~
+** DONE Set up BBB rooms and update conf.org                        :sachac:
+CLOSED: [2022-10-17 Mon 21:40]
+:PROPERTIES:
+:CUSTOM_ID: create-bbb
+:END:
+
+1. Log on to bbb.emacsverse.org as an admin.
+2. Create a room. Enable *Mute users when they join*.
+
+   The code below doesn't quite work, but might be a good starting point for future automation.
+   
+   #+begin_src emacs-lisp :eval no
+(setq list (seq-drop (emacsconf-bbb-room-title-list) 3)) ; skip some if needed
+(progn
+  (setq name (pop list))
+  (kill-new (format "name=\"%s\";$('#create-room-block').click();$('#create-room-name').val(name);$('#room_mute_on_join').click();$('.create-room-button').click();\n"
+                    name))
+  (sleep-for 1)
+  (shell-command "xdotool key alt+Tab sleep 3 key ctrl+v sleep 1 key Return"))
+#+end_src
+
+console.log(JSON.stringify([...document.querySelectorAll('.delete-room')].map((o) => { return { name: o.getAttribute('data-name'), path: o.getAttribute('data-path') }}).filter((o) => o.name.match(/^ec22/))))
+
+see conf.org for the rest of the process
+*** TODO Add volunteers to the BBB rooms
 * Projects to bear in mind but which are not actual
 :PROPERTIES:
 :CUSTOM_ID: maybe-projects
@@ -2658,6 +2580,84 @@ CLOSED: [2022-10-19 Wed 18:46]
 
 It would be nice to have track-specific icals as well.
 
+** DONE [#A] Figure out web-based file upload    :needsowner:sachac:ansible:
+CLOSED: [2022-10-19 Wed 09:20] SCHEDULED: <2022-10-18 Tue>
+:PROPERTIES:
+:CUSTOM_ID: upload
+:END:
+zaeph: I can work on it, but I’m not experienced in this domain, so I’d prefer to be a back-up.
+task is currently with bandali
+
+Lesson learned from last year: "Since people kept running into ftp
+problems, we might want to set up a web-frontend next year to minimise
+problems."
+
+Maybe we could ask some of the volunteers who wanted to help us with
+the infra? It shouldn’t be complicated to deploy a ready-made
+solution.
+
+"file drop" is a common keyword for looking for information.
+Considerations:
+- Probably run it on media.emacsconf.org
+- Bonus features:
+  - password-protected or hidden behind some kind of authentication or hidden behind some kind of URL, so we don't have to worry too much about spam
+  - extra points for sending speakers links to upload to specific folders so that we can separate resources by talk
+  - Resumable uploads would be good, since some speakers had a hard time with unreliable connections
+- What other conferences do:
+  - LibrePlanet uses plain FTP and recommends FileZilla https://libreplanet.org/wiki/Video_upload_instructions
+  - FOSSDEM uses Pentabarf to receive uploads  https://archive.fosdem.org/2022/manuals/program/speaker/
+  - DebConf uses SReview(?)
+  - FOSSGIS uses Seafile https://vmx.cx/cgi-bin/blog/index.cgi/video-uploads-for-an-online-conference%3A2021-06-12%3Aen%2Cconference%2Cgeo
+- Some options:
+
+  | Project                                      | Docker   | Buster | Base      | Notes                              |
+  | https://www.projectsend.org/                 |          |        | php+mysql |                                    |
+  | https://github.com/pomf/pomf                 |          |        | php+mysql |                                    |
+  | https://github.com/psi-4ward/psitransfer     | official |        | node      | can set upload password, resumable; data volume needs uid 1000 |
+  | https://github.com/epoupon/fileshelter       | official | ppa    | C++       |                                    |
+  | https://github.com/mickael-kerjean/filestash | official |        |           | general FTP client                 |
+  | https://gitlab.com/moejo42/Jirafeau          | official |        | php       |                                    |
+  | https://github.com/YouTransfer/YouTransfer   | official |        | node      | looking for maint                  |
+  | https://github.com/dutchcoders/transfer.sh/  |          |        |           |                                    |
+  | https://github.com/eikek/sharry              |          |        |           |                                    |
+  - NextCloud
+
+  anon FTP upload currently goes to /srv/ftp/anon/ on media.emacsconf.org
+
+  [[file:/ssh:media|sudo::/etc/vsftpd.conf]]
+
+  Maybe I'll do psitransfer as a direct install
+    
+*** DONE Create 2022/upload.md with the same workflow as last year for a start
+CLOSED: [2022-10-18 Tue 14:37]
+*** DONE Implement new workflow
+CLOSED: [2022-10-18 Tue 14:37]
+** DONE Update IRC instructions because of multiple tracks 
+CLOSED: [2022-10-16 Sun 17:39]
+:PROPERTIES:
+:CUSTOM_ID: irc
+:END:
+
+Added to watch pages
+** DONE Move scheduling and publishing code to Emacs on a VPS so that other people can help out :sachac:
+:PROPERTIES:
+:CUSTOM_ID: publishing-sched
+:END:
+Ideal:
+- Update pages with watching information, additional resources, etc. as talks go live
+- Update the schedule as needed (cancelled or reordered talks, etc.)
+
+Where:
+- front? my own VPS?
+
+  Nice if there's an Ansible playbook
+  
+  sachac's notes:
+  [[file:~/code/docker/emacsconf-publish/]]
+- probably good to set it up on front
+
+It's now on front. 
+
 * Communications
 :PROPERTIES:
 :CUSTOM_ID: comms