path: root/2023/captions/emacsconf-2023-hyperdrive--hyperdriveel-peertopeer-filesystem-in-emacs--joseph-turner--answers.vtt

WEBVTT


00:00:12.660 --> 00:00:13.160
[Speaker 0]: I guess we are now live.

00:00:15.360 --> 00:00:15.860
So Joseph, thanks for being here.

00:00:16.960 --> 00:00:17.460
Thanks for talking to the hyperdrive.

00:00:22.240 --> 00:00:22.440
We already had some, or we already have a lot

00:00:24.360 --> 00:00:24.619
of questions here. And I guess I would start

00:00:26.040 --> 00:00:26.540
with, let's call it the difficult,

00:00:29.119 --> 00:00:29.439
the most difficult 1. So when you were

00:00:30.820 --> 00:00:31.320
developing hyperdrive for your colleague,

00:00:34.760 --> 00:00:34.920
what do you, or what have you learned the

00:00:34.920 --> 00:00:35.420
most?

00:00:43.080 --> 00:00:43.320
[Speaker 1]: I have learned how much faster and more

00:00:46.360 --> 00:00:46.620
enjoyable the development of this project can

00:00:51.540 --> 00:00:52.040
be with talented people working by my side,

00:00:55.960 --> 00:00:56.260
like Jonas and Adam and Prat and Mo,

00:00:58.100 --> 00:00:58.260
it's been really a pleasure to work with

00:00:58.440 --> 00:00:58.940
these folks.

00:01:04.959 --> 00:01:05.140
[Speaker 0]: So you have started at first on your own and

00:01:07.400 --> 00:01:07.760
then probably pushed it somewhere in open

00:01:10.320 --> 00:01:10.820
source or how did it develop,

00:01:11.740 --> 00:01:12.240
your development experience?

00:01:15.920 --> 00:01:16.160
[Speaker 1]: A few years ago, we started looking into

00:01:21.960 --> 00:01:22.200
using peer-to-peer technology for sharing all

00:01:25.080 --> 00:01:25.360
kinds of information. And we came across Move

00:01:29.280 --> 00:01:29.440
SignWeaver, who was recommended to us by a

00:01:32.560 --> 00:01:32.720
mutual friend. And we started working with

00:01:33.840 --> 00:01:34.340
Move, and then about a year ago,

00:01:37.060 --> 00:01:37.560
we started looking into using Emacs,

00:01:40.020 --> 00:01:40.460
the peer-to-peer software,

00:01:43.520 --> 00:01:43.780
so that we could make use of all of the

00:01:46.340 --> 00:01:46.500
powerful things that Emacs already does with

00:01:47.780 --> 00:01:48.280
org mode and other packages.

00:01:51.560 --> 00:01:51.760
And then we started working with Adam and

00:01:52.320 --> 00:01:52.820
Pratt and Jonas.

00:01:54.280 --> 00:01:54.780
[Speaker 2]: Yes.

00:01:59.880 --> 00:02:00.380
[Speaker 0]: So we are skipping to the next question.

00:02:03.700 --> 00:02:04.200
So to read it out, I use multiple computers

00:02:06.200 --> 00:02:06.480
and my partner also would like access to my

00:02:08.680 --> 00:02:09.139
notes. So, 2 questions at first.

00:02:12.440 --> 00:02:12.720
First 1, how well would this work with using

00:02:15.060 --> 00:02:15.300
this to edit my Zettelkasten hyperdrive using

00:02:15.660 --> 00:02:16.160
multiple computers?

00:02:21.260 --> 00:02:21.760
[Speaker 1]: Hyperdrive is single writer currently.

00:02:24.140 --> 00:02:24.280
So what that means is that if you have a

00:02:25.080 --> 00:02:25.580
hyperdrive that you've created,

00:02:28.320 --> 00:02:28.820
you're the only 1 who can make changes to it.

00:02:31.560 --> 00:02:32.060
And that's limited right now to editing 1

00:02:33.240 --> 00:02:33.740
hyperdrive from 1 machine.

00:02:38.240 --> 00:02:38.740
In theory, you could use the same private key

00:02:40.240 --> 00:02:40.680
and write to it from multiple machines,

00:02:43.520 --> 00:02:44.020
but you would have to make sure that you sync

00:02:46.300 --> 00:02:46.520
it on both machines and didn't make

00:02:48.160 --> 00:02:48.480
concurrent writes because then you would fork

00:02:49.840 --> 00:02:50.340
the history of your hyperdrive,

00:02:51.020 --> 00:02:51.520
and that would be bad.

00:02:57.740 --> 00:02:57.980
But we've spent a lot of time making links to

00:02:59.780 --> 00:03:00.280
hyperdrives work well,

00:03:02.160 --> 00:03:02.360
relative links within hyperdrives to other

00:03:03.560 --> 00:03:03.840
files inside of your drive.

00:03:05.520 --> 00:03:06.020
So you should be able to,

00:03:10.120 --> 00:03:10.520
with some exceptions, just take your personal

00:03:13.360 --> 00:03:13.780
information management set of org files or

00:03:14.760 --> 00:03:15.260
whatever it is that you have,

00:03:18.160 --> 00:03:18.260
and upload them into a hyperdrive if all of

00:03:22.740 --> 00:03:23.100
that is publicly available or would be good

00:03:27.260 --> 00:03:27.400
to share publicly. And you can make that

00:03:28.940 --> 00:03:29.440
available for other people to link to.

00:03:30.640 --> 00:03:30.840
So you can have multiple different

00:03:32.040 --> 00:03:32.540
hyperdrives that link to 1 another.

00:03:35.600 --> 00:03:36.100
[Speaker 0]: So it's like a huge network of hyperdrives

00:03:38.000 --> 00:03:38.500
connected to each other in some way.

00:03:39.140 --> 00:03:39.640
[Speaker 1]: Yeah.

00:03:41.120 --> 00:03:41.620
[Speaker 0]: So that's kind of neat and kind of cool.

00:03:44.240 --> 00:03:44.480
There was a follow-up question or the second

00:03:46.780 --> 00:03:47.100
part of the question. Okay,

00:03:48.860 --> 00:03:49.200
then using the same hyperdrive is probably

00:03:51.820 --> 00:03:52.060
not possible, but interlinking would be the

00:03:57.500 --> 00:03:57.840
best way to do it. There was a question

00:03:59.540 --> 00:03:59.820
concerning how they should install it.

00:04:01.160 --> 00:04:01.440
So What would be a good way of getting

00:04:03.580 --> 00:04:04.080
hyperdrives if you do not want to install npm

00:04:06.460 --> 00:04:06.740
and have a binary? Could you compile it with

00:04:08.300 --> 00:04:08.800
denner or rusk or zig or go?

00:04:10.960 --> 00:04:11.120
CLI alternative tool, I would prefer to

00:04:11.840 --> 00:04:12.340
download a single binary.

00:04:17.420 --> 00:04:17.720
[Speaker 1]: There's something that Jonas was playing

00:04:20.459 --> 00:04:20.800
around with using Geeks to install Hyper

00:04:22.860 --> 00:04:23.360
Gateway. So the way that HyperDrive.el,

00:04:26.880 --> 00:04:27.380
the Emacs package, works right now is similar

00:04:30.300 --> 00:04:30.720
to the way that the transmission Emacs client

00:04:34.200 --> 00:04:34.640
for BitTorrent works, where you have a client

00:04:37.320 --> 00:04:37.480
in Emacs that connects to a daemon that is a

00:04:39.120 --> 00:04:39.280
separate process that's running on your

00:04:41.820 --> 00:04:42.320
machine, the transmission daemon.

00:04:43.500 --> 00:04:44.000
But in this case, we have HyperGateway,

00:04:46.060 --> 00:04:46.560
which is running as a daemon on your machine.

00:04:48.180 --> 00:04:48.680
And then hyperdrive.el

00:04:51.020 --> 00:04:51.520
connects to that daemon and sends requests,

00:04:53.520 --> 00:04:53.620
and all of the hyperdrive stuff under the

00:04:55.880 --> 00:04:56.380
hood happens with her gateway.

00:04:57.940 --> 00:04:58.440
But so that package can,

00:05:00.280 --> 00:05:00.460
or hypergateway, the program can be

00:05:02.900 --> 00:05:03.080
installed, The easiest way is to just

00:05:04.400 --> 00:05:04.900
download it from the GitHub releases.

00:05:07.060 --> 00:05:07.560
You could also use NPM to install it.

00:05:09.520 --> 00:05:09.680
And then the third option that we've been

00:05:12.920 --> 00:05:13.040
playing around with is Jonas was writing a

00:05:14.540 --> 00:05:15.040
little script to install it using Geeks,

00:05:18.340 --> 00:05:18.840
since Geeks now comes with Node 18.

00:05:20.740 --> 00:05:20.940
And so you should be able to install it using

00:05:20.940 --> 00:05:21.440
Geeks.

00:05:25.320 --> 00:05:25.520
[Speaker 0]: Right, thank you. We have 2 people here

00:05:26.100 --> 00:05:26.600
joined with microphone.

00:05:30.240 --> 00:05:30.560
Do we have now any question to Joseph or just

00:05:32.060 --> 00:05:32.560
here for chilling out.

00:05:41.820 --> 00:05:42.260
I guess it's a no. Plasma,

00:05:42.260 --> 00:05:42.760
yeah.

00:05:46.120 --> 00:05:46.260
[Speaker 3]: What about using, having some of the

00:05:47.960 --> 00:05:48.460
information being private in the hyperdrives.

00:05:54.240 --> 00:05:54.400
[Speaker 1]: That's not what we have been focusing on at

00:05:55.240 --> 00:05:55.640
this point. At this point,

00:05:57.340 --> 00:05:57.660
what we've been working on is mainly using

00:06:02.180 --> 00:06:02.680
hyperdrives for a public forum type tool.

00:06:06.420 --> 00:06:06.560
But you could encrypt those files if you

00:06:09.340 --> 00:06:09.840
wanted to. You can also just,

00:06:13.660 --> 00:06:14.160
a poor man's security would just be to share

00:06:16.660 --> 00:06:16.960
your HyperDrive link only with those people

00:06:19.060 --> 00:06:19.560
that you want to have access to your drive.

00:06:21.820 --> 00:06:22.240
But the way that it works right now is anyone

00:06:23.800 --> 00:06:24.280
who has the link to a hyperdrive can access

00:06:26.040 --> 00:06:26.420
its content. So long as there are peers

00:06:28.740 --> 00:06:28.900
available on the network who can serve it to

00:06:28.900 --> 00:06:29.400
you.

00:06:37.440 --> 00:06:37.660
[Speaker 0]: Any follow up question from your side,

00:06:37.660 --> 00:06:38.160
Plasma?

00:06:46.720 --> 00:06:47.220
[Speaker 3]: I had 1, I'll just have to re-remember it.

00:06:55.240 --> 00:06:55.600
[Speaker 0]: If you remember it, just feel free to

00:06:56.000 --> 00:06:56.500
interrupt me.

00:06:58.980 --> 00:06:59.220
[Speaker 3]: What about working? I've looked at this

00:07:03.120 --> 00:07:03.480
before. What about, if I remember correctly,

00:07:04.920 --> 00:07:05.220
it doesn't do as well with large files,

00:07:09.060 --> 00:07:09.520
so if you're going to store 200 gigs of video

00:07:12.180 --> 00:07:12.520
files, stuff like IPFS works a lot better,

00:07:15.200 --> 00:07:15.480
or BitTorrent. This is,

00:07:17.120 --> 00:07:17.620
are you, were you using the,

00:07:21.980 --> 00:07:22.300
any way of using multiple protocols for stuff

00:07:25.560 --> 00:07:25.800
like that? Or what were you doing with,

00:07:27.340 --> 00:07:27.480
or were you just doing the small files with

00:07:28.680 --> 00:07:29.180
the same protocol? Or

00:07:34.440 --> 00:07:34.920
[Speaker 1]: I would love to see an IPFS client in Emacs

00:07:37.260 --> 00:07:37.700
as well that could interface with Kubo or

00:07:40.040 --> 00:07:40.240
some other IPFS daemon and I think that those

00:07:41.120 --> 00:07:41.620
could work really well together.

00:07:45.680 --> 00:07:45.860
We mostly have been playing around with

00:07:47.240 --> 00:07:47.740
sharing relatively small files,

00:07:52.120 --> 00:07:52.240
up to hundreds of megabytes or maybe a

00:07:55.240 --> 00:07:55.640
gigabyte. We haven't played around yet with

00:07:57.380 --> 00:07:57.880
hyperdrive.el, the Emacs client,

00:07:59.240 --> 00:07:59.740
testing that with HyperGateway.

00:08:04.020 --> 00:08:04.160
But there may be other experiments that have

00:08:05.880 --> 00:08:06.380
been done that show that that works well.

00:08:10.880 --> 00:08:11.320
The main thing is that IPFS uses content

00:08:14.820 --> 00:08:15.060
addressability to reduce duplication of the

00:08:16.620 --> 00:08:17.120
content. Whereas in HyperDrive,

00:08:20.140 --> 00:08:20.320
if you upload the same file with the same

00:08:23.160 --> 00:08:23.620
contents twice, now you have double the

00:08:25.120 --> 00:08:25.580
content being stored in your HyperDrive.

00:08:26.040 --> 00:08:26.540
It's not deduplicated.

00:08:30.800 --> 00:08:31.300
You can always clear out part of the history

00:08:36.340 --> 00:08:36.659
of your hyperdrive But IPFS has really good

00:08:39.140 --> 00:08:39.640
built-in deduplication whereas hyperdrive

00:08:39.860 --> 00:08:40.360
does not

00:08:44.159 --> 00:08:44.540
[Speaker 4]: I have a question.

00:08:47.440 --> 00:08:47.580
[Speaker 3]: What about like commenting on other like if

00:08:50.140 --> 00:08:50.600
you have a couple of different Hypercore

00:08:53.900 --> 00:08:54.220
blogs, what about like commenting between

00:08:56.680 --> 00:08:57.040
them? Like you have some people who have a

00:08:59.280 --> 00:08:59.640
commenting form on Reddit for their blog

00:08:59.640 --> 00:09:00.140
posts.

00:09:04.640 --> 00:09:04.760
[Speaker 1]: So Move SignWeaver has been doing a lot of

00:09:07.880 --> 00:09:08.380
work recently with the distributed press API

00:09:12.040 --> 00:09:12.540
to integrate ActivityPub with these

00:09:14.120 --> 00:09:14.620
peer-to-peer technologies.

00:09:17.980 --> 00:09:18.240
Move can give you more information about

00:09:22.120 --> 00:09:22.440
that. But there is another feature that we'd

00:09:23.400 --> 00:09:23.900
like to add to hyperdrive.el,

00:09:29.140 --> 00:09:29.640
which is peer discovery using the swarming

00:09:30.600 --> 00:09:31.100
feature that HyperCore,

00:09:34.600 --> 00:09:35.100
HyperSWARM offers, where you'd be able to say

00:09:38.500 --> 00:09:38.660
that my node, my peer-to-peer node is

00:09:41.640 --> 00:09:41.840
interested in Emacs and free software as

00:09:43.100 --> 00:09:43.320
topics. And those would be 2 different

00:09:45.060 --> 00:09:45.300
topics. I would advertise on the network that

00:09:46.240 --> 00:09:46.740
I'm interested in those topics.

00:09:49.120 --> 00:09:49.480
And I would be able to discover other peers

00:09:52.040 --> 00:09:52.200
on the network who have also advertised that

00:09:53.440 --> 00:09:53.940
they're interested in those same topics.

00:09:56.040 --> 00:09:56.320
And then they would tell me,

00:09:59.260 --> 00:09:59.760
hey, here's the public key of my hyperdrive.

00:10:01.820 --> 00:10:02.320
Come check it out. I have posted information

00:10:04.300 --> 00:10:04.540
about those topics. And so in that way,

00:10:06.860 --> 00:10:07.360
you'd be able to, in a distributed fashion,

00:10:09.660 --> 00:10:09.800
discover other peers on the network who are

00:10:11.240 --> 00:10:11.600
interested in topics that you're interested

00:10:11.600 --> 00:10:12.100
in.

00:10:16.780 --> 00:10:16.960
[Speaker 3]: Something that would be useful in addition to

00:10:19.600 --> 00:10:20.100
that idea is like if you had your emacs

00:10:25.560 --> 00:10:25.680
Zettelkasten Publish like let's say you have

00:10:27.860 --> 00:10:28.140
some private data You make sure that that's

00:10:29.800 --> 00:10:30.060
scrubbed out before it goes to your hyper

00:10:31.760 --> 00:10:32.260
core and then you have another part of it

00:10:35.540 --> 00:10:35.940
that gets turned into a website for it's also

00:10:38.040 --> 00:10:38.240
given to other hyper core clients but you'd

00:10:40.120 --> 00:10:40.620
rather get the emacs users the org documents

00:10:44.760 --> 00:10:44.920
then you also publish some of them on a

00:10:48.680 --> 00:10:48.840
website so everybody as much people can get

00:10:53.560 --> 00:10:53.960
it as possible. And then a way of figuring

00:10:55.640 --> 00:10:56.140
out who you'd want to do,

00:10:57.780 --> 00:10:58.180
or if you're an Emacs user,

00:10:59.860 --> 00:11:00.040
maybe figure out that they're all related to

00:11:01.440 --> 00:11:01.640
each other, but you want to get the art mode

00:11:03.080 --> 00:11:03.580
documents because you're using EMAX.

00:11:05.900 --> 00:11:06.400
Yeah.

00:11:10.360 --> 00:11:10.760
[Speaker 0]: Maybe a side note, we have 4 minutes here on

00:11:12.040 --> 00:11:12.400
before we switch into the next track,

00:11:13.200 --> 00:11:13.700
just to let you know.

00:11:17.900 --> 00:11:18.400
[Speaker 1]: Thank you. So the hyper drive mirror feature

00:11:21.220 --> 00:11:21.720
that we added, would allow you to selectively

00:11:24.840 --> 00:11:24.960
choose which files you want to share in a

00:11:28.500 --> 00:11:28.780
hyperdrive. So, with Prot's denote file

00:11:30.660 --> 00:11:31.000
naming scheme or Carl Voigt's file tags

00:11:33.600 --> 00:11:33.760
naming scheme, you could just specify a

00:11:35.940 --> 00:11:36.140
regular expression. And you could say,

00:11:40.140 --> 00:11:40.460
I want to share out of my directory of org

00:11:42.560 --> 00:11:42.740
files, I want to share only those files that

00:11:44.220 --> 00:11:44.720
have been tagged as public,

00:11:47.320 --> 00:11:47.520
or only those files that have been tagged as

00:11:49.680 --> 00:11:49.840
emacs and then only those ones would get

00:11:50.720 --> 00:11:51.220
uploaded into your hyperdrive

00:11:54.280 --> 00:11:54.560
[Speaker 3]: or exclude all in any of the ones that say

00:11:54.560 --> 00:11:55.060
private

00:12:01.620 --> 00:12:02.120
[Speaker 0]: yep mike had a question

00:12:05.220 --> 00:12:05.720
[Speaker 4]: yeah I have a question for the hyperdrive.

00:12:08.520 --> 00:12:08.940
So I just maybe I missed it and you haven't

00:12:09.340 --> 00:12:09.840
put a link.

00:12:16.200 --> 00:12:16.700
[Speaker 1]: Oh, Mikhail, we can't hear you.

00:12:22.660 --> 00:12:23.160
[Speaker 3]: Heard you for a second.

00:12:28.440 --> 00:12:28.940
[Speaker 1]: Yes?

00:12:29.640 --> 00:12:30.040
[Speaker 4]: Can someone hear me? Okay,

00:12:31.200 --> 00:12:31.400
I have no idea what happened to my

00:12:32.480 --> 00:12:32.980
microphone, but now it's back.

00:12:34.760 --> 00:12:34.920
[Speaker 3]: Now we can. You can see the microphone on the

00:12:35.840 --> 00:12:36.340
top of the screen. So

00:12:38.940 --> 00:12:39.080
[Speaker 4]: yes, thank you. Okay. I have a question to

00:12:41.520 --> 00:12:41.720
hyperdrive. Is the hyperdrive a find on the

00:12:46.160 --> 00:12:46.320
hole punch point, point T O hole Or is it

00:12:47.020 --> 00:12:47.520
just another hyperdrive?

00:12:51.260 --> 00:12:51.760
[Speaker 1]: That's exactly the project that we're using.

00:12:54.520 --> 00:12:55.020
So the HolePunch team has released hyperdrive

00:12:59.340 --> 00:12:59.620
and other hyper core libraries as free

00:13:01.880 --> 00:13:02.380
software libraries that you can use.

00:13:03.940 --> 00:13:04.440
And so MoV SignWeaver,

00:13:07.080 --> 00:13:07.440
the project that MoV is working on,

00:13:11.120 --> 00:13:11.620
HyperGateway, depends on those libraries and

00:13:15.520 --> 00:13:15.880
it makes it easy for you to build other

00:13:17.200 --> 00:13:17.700
clients like hyperdrive.el

00:13:20.600 --> 00:13:21.100
which connect to the hyperdrive network.

00:13:22.800 --> 00:13:23.300
I hope that answers your question.

00:13:25.140 --> 00:13:25.440
[Speaker 4]: Yes it does, thank you.

00:13:28.380 --> 00:13:28.620
And what did make you choose hyperdrive for

00:13:29.380 --> 00:13:29.880
this Emacs project?

00:13:34.400 --> 00:13:34.900
[Speaker 1]: Mainly the fact that the drives are mutable,

00:13:37.660 --> 00:13:38.160
which makes it distinct from IPFS or

00:13:40.800 --> 00:13:41.020
BitTorrent, where when you share some piece

00:13:44.760 --> 00:13:45.060
of content, you're stuck with that static

00:13:46.800 --> 00:13:47.020
piece of content, which works well for some

00:13:49.600 --> 00:13:50.100
cases, but if you say you have a Zettelkasten

00:13:52.300 --> 00:13:52.500
or you have a set of org files that you want

00:13:56.120 --> 00:13:56.580
to share with people, you want to be able to

00:13:58.860 --> 00:13:59.160
update those files and have other people pull

00:13:59.960 --> 00:14:00.360
those updates from you.

00:14:02.300 --> 00:14:02.720
And so HyperDrive allows you to have these

00:14:05.340 --> 00:14:05.820
mutable sets of files that you can share and

00:14:08.440 --> 00:14:08.600
use the same link for other peers to pull the

00:14:09.440 --> 00:14:09.800
latest changes from you.

00:14:11.660 --> 00:14:11.960
Also, it's versioned, as we showed in the

00:14:15.200 --> 00:14:15.700
video, which is really helpful for having

00:14:17.500 --> 00:14:17.900
community deliberations and community

00:14:19.400 --> 00:14:19.600
discussions where you want to be able to

00:14:22.420 --> 00:14:22.700
reference some something that somebody said

00:14:26.120 --> 00:14:26.320
in the past and not have it get deleted or

00:14:26.860 --> 00:14:27.360
changed or something.

00:14:30.600 --> 00:14:31.100
[Speaker 0]: We are now switching to talk So just for

00:14:32.720 --> 00:14:33.200
letting you know if you want to say something

00:14:37.640 --> 00:14:37.840
now. Too late. The BB room is still open,

00:14:38.480 --> 00:14:38.860
so you can still discuss.

00:14:41.480 --> 00:14:41.980
There's also a lot going on on the pad.

00:14:47.980 --> 00:14:48.480
But you can also discuss here inside and

00:14:49.760 --> 00:14:50.260
answer the pet questions maybe later.

00:14:52.800 --> 00:14:53.300
[Speaker 1]: Yeah, there are good questions.

00:14:58.680 --> 00:14:59.180
I'll go ahead, please.

00:15:01.120 --> 00:15:01.620
[Speaker 3]: continuing here on the pad?

00:15:04.540 --> 00:15:05.040
[Speaker 1]: Are we I can hear you.

00:15:07.540 --> 00:15:08.040
[Speaker 5]: Yeah, so the question I had on the pad was,

00:15:10.760 --> 00:15:10.900
would it make sense in any sense to put a

00:15:13.820 --> 00:15:13.940
FUSE interface or put the POSIX semantics in

00:15:14.960 --> 00:15:15.460
front of this at some point?

00:15:17.800 --> 00:15:18.080
[Speaker 1]: Yeah, that would be cool.

00:15:20.680 --> 00:15:21.060
It's kind of a similar question to any plans

00:15:21.680 --> 00:15:22.180
for a Tramp interface.

00:15:25.440 --> 00:15:25.940
There was a project that the HyperCore

00:15:31.160 --> 00:15:31.500
HolePunch team was working on a year or more

00:15:34.320 --> 00:15:34.820
ago that provided a FUSE interface.

00:15:39.560 --> 00:15:40.060
And I think it didn't pan out.

00:15:43.580 --> 00:15:43.940
But it's a good idea. Same with the Tramp

00:15:46.560 --> 00:15:46.720
interface. It seems like a good idea that

00:15:51.900 --> 00:15:52.260
would make it possible to more easily hook

00:15:55.520 --> 00:15:56.020
into the built-in Emacs functionality for,

00:16:01.340 --> 00:16:01.840
for example, like incremental file name

00:16:03.680 --> 00:16:03.960
completion, which we don't currently support

00:16:09.800 --> 00:16:10.260
in Hyperdrive.el. So I'd love to have

00:16:12.720 --> 00:16:13.220
feedback and design ideas for those projects.

00:16:15.860 --> 00:16:16.020
[Speaker 5]: Yeah, there's just Everything in Emacs just

00:16:17.980 --> 00:16:18.280
sort of assumes the file system is there and

00:16:20.940 --> 00:16:21.440
usable in that way. That's all.

00:16:23.980 --> 00:16:24.480
[Speaker 1]: Yeah, it's a good idea.

00:16:28.180 --> 00:16:28.680
[Speaker 3]: An idea for the privacy type thing is

00:16:33.160 --> 00:16:33.380
Syncthing links. Because I think you can set

00:16:36.100 --> 00:16:36.480
up Syncthing in such a way that you have the

00:16:38.560 --> 00:16:38.900
private networks that other people can't

00:16:40.240 --> 00:16:40.740
actually get access to.

00:16:45.540 --> 00:16:45.700
[Speaker 1]: I did not know that that was possible with

00:16:47.120 --> 00:16:47.620
Syncthing. I'll have to look into that.

00:16:48.840 --> 00:16:49.200
[Speaker 3]: At least I think it is anyway,

00:16:53.000 --> 00:16:53.500
because yeah, there's ways you can explicitly

00:16:56.780 --> 00:16:57.280
authorize devices. Yeah,

00:17:00.240 --> 00:17:00.400
right. I think you could actually set it up

00:17:03.480 --> 00:17:03.960
in such a way that you can have private stuff

00:17:06.300 --> 00:17:06.480
and links, and then that might be a way that

00:17:10.119 --> 00:17:10.619
you can get a completely distributed

00:17:12.720 --> 00:17:13.220
Zettelcast and with private notes.

00:17:22.339 --> 00:17:22.599
[Speaker 1]: Yeah. Good idea. There's a question in the

00:17:26.280 --> 00:17:26.380
pad about DATRS, a Rust version of

00:17:28.660 --> 00:17:29.160
HyperDrive. I had not heard of that,

00:17:30.260 --> 00:17:30.760
so I'll have to look into that.

00:17:33.040 --> 00:17:33.460
If you had your druthers,

00:17:34.820 --> 00:17:35.320
what would make your work on hyperdrive.dl

00:17:40.240 --> 00:17:40.740
easier? It's been a lot of fun.

00:17:42.480 --> 00:17:42.980
I would love to have more user feedback.

00:17:45.660 --> 00:17:46.160
That would be my wish.

00:17:50.500 --> 00:17:51.000
I tried putting a git repo in HyperDrive.

00:17:53.320 --> 00:17:53.500
Does it work well? I don't think that would

00:17:56.880 --> 00:17:57.100
work well because, as I mentioned a moment a

00:18:00.060 --> 00:18:00.220
few moments ago, the data that you put into a

00:18:00.920 --> 00:18:01.420
hyperdrive is duplicated.

00:18:06.300 --> 00:18:06.800
So if you had the whole work tree in

00:18:08.800 --> 00:18:08.960
hyperdrive every time you made a change and

00:18:12.340 --> 00:18:12.840
saved it, it would be duplicated.

00:18:15.240 --> 00:18:15.740
If you had just a bare repository,

00:18:18.240 --> 00:18:18.740
I don't know, try it.

00:18:21.140 --> 00:18:21.540
[Speaker 3]: They're trying to solve the same problem,

00:18:23.560 --> 00:18:24.060
but 1 of the optimizations they have for

00:18:25.520 --> 00:18:25.900
being able to view a whole bunch of people's

00:18:28.780 --> 00:18:28.980
data is they made shallow clones a lot

00:18:34.640 --> 00:18:35.140
[Speaker 1]: Would you phrase that again,

00:18:35.140 --> 00:18:35.640
please?

00:18:39.780 --> 00:18:40.280
[Speaker 3]: easier. Right? So like Git and Hypercore,

00:18:42.720 --> 00:18:43.220
1 of the things they do is they allow you to

00:18:46.160 --> 00:18:46.660
have a whole history of every single change

00:18:51.880 --> 00:18:52.380
for a dataset Zettelkasten project.

00:18:56.400 --> 00:18:56.600
But 1 of the optimizations Hypercore did to

00:19:02.020 --> 00:19:02.220
make it more network web friendly is they

00:19:04.540 --> 00:19:04.700
made the shallow clones work a lot better and

00:19:07.040 --> 00:19:07.240
a lot... Yeah, they made that work a lot

00:19:08.760 --> 00:19:09.060
better so you don't have to download every

00:19:11.340 --> 00:19:11.840
single thing for every single project.

00:19:14.860 --> 00:19:15.100
And because they both are implementing the

00:19:17.800 --> 00:19:18.040
delta upgrades, I don't see how they could

00:19:19.000 --> 00:19:19.500
work really well together.

00:19:21.780 --> 00:19:22.280
At least from what it looked like to me.

00:19:25.640 --> 00:19:26.140
It can't hurt to experiment.

00:19:28.980 --> 00:19:29.480
[Speaker 1]: But yeah, I would agree with you.

00:19:35.020 --> 00:19:35.180
Is data transferred between nodes in the

00:19:38.800 --> 00:19:39.060
clear or encrypted? That's a good question.

00:19:41.640 --> 00:19:42.140
I don't know how it's encrypted.

00:19:47.440 --> 00:19:47.940
I don't, I wouldn't recommend sharing

00:19:53.400 --> 00:19:53.900
sensitive data with hyperdrive right now?

00:19:55.680 --> 00:19:55.800
I would recommend if you want to play with

00:19:57.240 --> 00:19:57.520
it, have it be something where you're

00:20:00.660 --> 00:20:01.160
expecting the data to be shared.

00:20:03.460 --> 00:20:03.960
Is there a searchable catalog?

00:20:06.700 --> 00:20:06.980
[Speaker 3]: It's also the data in transport versus data

00:20:08.480 --> 00:20:08.800
at rest. I'm pretty sure the data at rest

00:20:09.960 --> 00:20:10.460
would not be encrypted.

00:20:14.440 --> 00:20:14.640
Right. You can separate that into those 2

00:20:14.640 --> 00:20:15.140
questions.

00:20:19.920 --> 00:20:20.420
[Speaker 1]: Right. Right. Is there a searchable catalog

00:20:23.000 --> 00:20:23.320
of hyper drives? So that's a thing,

00:20:32.980 --> 00:20:33.480
an idea that we've been a distributed trust

00:20:38.200 --> 00:20:38.700
network for discovering peers that are

00:20:41.260 --> 00:20:41.760
trusted for a particular topic.

00:20:47.220 --> 00:20:47.440
And we actually made a demo video of a

00:20:51.760 --> 00:20:51.900
previous prototype that's available on the

00:20:54.580 --> 00:20:55.080
Ashen hyperdrive that you can watch that

00:20:58.980 --> 00:20:59.280
shows the basic idea. But the idea is just

00:21:02.980 --> 00:21:03.480
that you would have a list of peers that you

00:21:07.120 --> 00:21:07.620
think are worth listening to or worth reading

00:21:09.400 --> 00:21:09.880
for a particular topic.

00:21:11.980 --> 00:21:12.180
And those peers would have peers that they

00:21:14.640 --> 00:21:14.920
think are worth listening to for that same

00:21:16.600 --> 00:21:16.720
topic. And so you would say,

00:21:17.560 --> 00:21:17.900
if I'm interested in Emacs,

00:21:21.220 --> 00:21:21.660
I want to see all the peers that I trust for

00:21:23.700 --> 00:21:24.200
the topic Emacs. And if,

00:21:27.340 --> 00:21:27.640
say, Adam Porter shows up in my list and Adam

00:21:30.340 --> 00:21:30.840
Porter trusts Jonas and Jonas trusts Pratt,

00:21:33.420 --> 00:21:33.920
I would be able to read hyperdrive

00:21:36.760 --> 00:21:37.260
information from all of those people by

00:21:41.600 --> 00:21:41.800
looking at the indirect relationships that I

00:21:43.260 --> 00:21:43.760
have by following the chain of relationships,

00:21:44.760 --> 00:21:45.260
kind of like a web of trust.

00:21:49.640 --> 00:21:49.860
And so it would also allow you to have a

00:21:53.480 --> 00:21:53.980
network of peers that you trust to block

00:21:54.900 --> 00:21:55.400
other people on your behalf.

00:21:57.660 --> 00:21:58.160
So it would be useful for subjective

00:22:02.220 --> 00:22:02.520
moderation where you can remove spam and bad

00:22:04.920 --> 00:22:05.420
actors from the people that you follow

00:22:08.940 --> 00:22:09.440
without having to delegate that powerful

00:22:13.260 --> 00:22:13.380
responsibility to some third party in a

00:22:15.260 --> 00:22:15.720
permanent way where that third party might

00:22:23.040 --> 00:22:23.320
abuse that power. So it allows you to share

00:22:26.120 --> 00:22:26.260
your list of trusted peers and your list of

00:22:29.180 --> 00:22:29.280
blocked peers with other people in a

00:22:29.860 --> 00:22:30.360
peer-to-peer way.

00:22:38.080 --> 00:22:38.580
[Speaker 3]: Have you ever looked at GNUnet?

00:22:40.200 --> 00:22:40.700
It kind of does some...

00:22:45.660 --> 00:22:45.800
It's trying to do something weird with the

00:22:47.520 --> 00:22:47.600
internet where it redesigns it from the

00:22:51.040 --> 00:22:51.540
ground up to be peer-to-peer,

00:22:53.680 --> 00:22:54.180
local first, or something like that.

00:22:58.380 --> 00:22:58.880
[Speaker 1]: I would like to know more about GNUnet.

00:23:01.800 --> 00:23:01.960
Yes. I have heard of it,

00:23:03.620 --> 00:23:04.120
but I haven't really researched it.

00:23:09.060 --> 00:23:09.560
If you edit a file on the hyperdrive,

00:23:12.400 --> 00:23:12.900
then edit the same file on the local mirror,

00:23:15.480 --> 00:23:15.640
how is the conflict handled when you sync the

00:23:21.140 --> 00:23:21.280
mirror again? So I think if I understand the

00:23:29.160 --> 00:23:29.620
question, the answer is that you can't edit

00:23:32.280 --> 00:23:32.780
the file in 2 different places,

00:23:36.860 --> 00:23:37.360
I think is the answer to the question.

00:23:41.220 --> 00:23:41.720
If you were to manually copy the private key

00:23:44.040 --> 00:23:44.540
from 1 machine onto another machine,

00:23:51.820 --> 00:23:52.320
then you could cause a conflict,

00:23:54.400 --> 00:23:54.900
like a merge conflict,

00:23:58.100 --> 00:23:58.240
but you would have to go out of your way to

00:24:00.520 --> 00:24:00.900
do that. And It's not handled.

00:24:03.580 --> 00:24:03.820
I think the Hypercore Hole Punch team has

00:24:05.600 --> 00:24:05.860
another project that they're working on that

00:24:07.200 --> 00:24:07.700
would, it's called AutoBase,

00:24:09.560 --> 00:24:10.060
that would merge those conflicts.

00:24:13.200 --> 00:24:13.680
But we're not using that right now.

00:24:16.260 --> 00:24:16.760
And I think it's in early development still.

00:24:19.860 --> 00:24:20.360
So there might be a solution in the future.

00:24:32.240 --> 00:24:32.740
[Speaker 3]: What's a surprising change of thoughts or

00:24:36.900 --> 00:24:37.180
what's the most interesting thing you weren't

00:24:39.060 --> 00:24:39.560
expecting to discover while developing this?

00:24:44.640 --> 00:24:44.800
Like change of thoughts on how you write or I

00:24:45.020 --> 00:24:45.520
don't know.

00:24:59.060 --> 00:24:59.540
[Speaker 1]: Well, I'm relatively new to Emacs and to Lisp

00:25:01.200 --> 00:25:01.700
and really to programming in general.

00:25:04.160 --> 00:25:04.540
And so it's been a fantastic learning

00:25:08.480 --> 00:25:08.900
experience. Adam, Alpha Papa,

00:25:11.320 --> 00:25:11.520
Adam and I have been doing a lot of pair

00:25:12.960 --> 00:25:13.460
programming sessions where we work together

00:25:15.380 --> 00:25:15.880
and I get to learn from him.

00:25:19.540 --> 00:25:19.940
And we've had meetings with Jonas and Prat

00:25:23.560 --> 00:25:23.800
and meetings with Mauve where it's a

00:25:25.520 --> 00:25:26.020
fantastic learning experience for me to

00:25:30.660 --> 00:25:30.800
discover how to build software in an

00:25:32.820 --> 00:25:33.320
efficient and intelligent way.

00:25:40.580 --> 00:25:40.920
It's a huge pleasure. If there are no more

00:25:43.320 --> 00:25:43.820
questions, I just wanted to encourage

00:25:48.380 --> 00:25:48.620
everyone to try it out and to let us know

00:25:50.380 --> 00:25:50.560
what you think. It would be really helpful to

00:25:54.960 --> 00:25:55.320
have some feedback from people who are using

00:25:57.240 --> 00:25:57.600
it in new and creative ways that we haven't

00:25:57.600 --> 00:25:58.100
anticipated.

00:26:02.120 --> 00:26:02.300
[Speaker 6]: Hi, I'd just like to say that I tried this

00:26:02.980 --> 00:26:03.480
new thing called hyperdrive.el

00:26:05.880 --> 00:26:06.380
today, and I think it's pretty cool.

00:26:12.540 --> 00:26:12.800
[Speaker 2]: Sorry, that was somebody else.

00:26:13.440 --> 00:26:13.940
Hey Joseph, how's it going?

00:26:15.080 --> 00:26:15.580
Oh, talk today.

00:26:16.420 --> 00:26:16.580
[Speaker 3]: Oh, thanks. Wonderful.

00:26:19.200 --> 00:26:19.700
[Speaker 1]: Who's that? Oh, hey. Well,

00:26:34.060 --> 00:26:34.560
I'm going to say goodbye.

00:26:37.040 --> 00:26:37.540
Thank you. And thank you for your questions,

00:26:39.680 --> 00:26:39.840
[Speaker 3]: I know that

00:26:40.380 --> 00:26:40.880
[Speaker 1]: PlasmaStrike. I've met you before.

00:26:42.340 --> 00:26:42.720
Appreciate your questions,

00:26:42.880 --> 00:26:43.380
your thoughts.

00:26:50.380 --> 00:26:50.880
[Speaker 2]: Oh, by the way, Joseph,

00:26:53.000 --> 00:26:53.500
we have our, our first,

00:26:55.120 --> 00:26:55.480
I don't know if our first new user,

00:26:57.280 --> 00:26:57.780
but we have the first link being shared,

00:27:01.160 --> 00:27:01.480
to hyperdrive file in the chat and I loaded

00:27:03.080 --> 00:27:03.240
it and it works. And it's funny too.

00:27:03.880 --> 00:27:04.000
It's worth looking at.

00:27:09.140 --> 00:27:09.640
So. Oh, I think it's frozen.

00:27:11.580 --> 00:27:12.080
I don't know if anybody can hear me.

00:27:12.720 --> 00:27:13.220
[Speaker 3]: I can.

00:27:15.200 --> 00:27:15.620
[Speaker 2]: Okay, cool. The browser is frozen.

00:27:19.020 --> 00:27:19.520
It's it's not, okay. Just unfroze.

00:27:21.740 --> 00:27:22.100
Anyway. All right. Well,

00:27:24.000 --> 00:27:24.440
By the way, I enjoyed your talks about

00:27:26.260 --> 00:27:26.480
hyperbole. I'm going to rewatch those later

00:27:28.040 --> 00:27:28.260
when I get a chance. It was nice to meet you,

00:27:31.100 --> 00:27:31.240
too. Bob is a really great guy to work with.

00:27:38.800 --> 00:27:39.300
[Speaker 3]: Definitely a lot of interesting people.

00:27:40.200 --> 00:27:40.700
[Speaker 2]: I owe him 1. Yes, sir.

00:27:41.580 --> 00:27:41.760
All right, you have a good day,

00:27:45.140 --> 00:27:45.640
[Speaker 3]: Will do, I like the insistence on local

00:27:48.740 --> 00:27:48.940
first. Feels like it's a good dovetail with

00:27:49.540 --> 00:27:50.040
the hyper core

00:27:51.180 --> 00:27:51.680
[Speaker 2]: enjoy the conference. Yeah,

00:27:54.960 --> 00:27:55.120
yeah, I think there's a lot of a lot of

00:27:57.980 --> 00:27:58.180
interesting possibilities to build on this we

00:28:01.340 --> 00:28:01.600
have some plans that we Will get to you later

00:28:05.600 --> 00:28:05.820
this well in the coming year And we'll see

00:28:07.480 --> 00:28:07.900
where the hyperdrive people,

00:28:09.920 --> 00:28:10.040
you know, upstream how they develop it as

00:28:14.340 --> 00:28:14.840
well and yeah, so exciting times.