1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
|
[[!meta title="Emacs Lisp native compiler, current status and future developments"]]
[[!meta copyright="Copyright © 2021 Andrea Corallo"]]
[[!inline pages="internal(2021/info/native-nav)" raw="yes"]]
<!-- You can manually edit this file to update the abstract, add links, etc. --->
# Emacs Lisp native compiler, current status and future developments
Andrea Corallo
[[!inline pages="internal(2021/info/native-schedule)" raw="yes"]]
Emacs Lisp (Elisp) is the Lisp dialect used by the Emacs text editor
family. GNU Emacs is traditionally capable of executing Elisp code
either interpreted or byte-interpreted after it has been compiled to
byte-code.
In this talk I'll discuss the Emacs Lisp native compiler. This feature
recently merged into the main Emacs development line allow for
automatically compiling and executing Elisp as native code.
During the presentation I'll touch on:
- design goals
- compiler and runtime design and implementation
- performance implications
- upstream process
- area of improvements and future developments
Format: 40 minutes
# Discussion
BBB:
- Where did funding for your work came from? Will you be able to maintain this in the foreseeable future?
- akrk: What kinds of applications do you envision native-comp enabling to work well in Emacs in the next few years, that wouldn't otherwise be possible?
- Is this the first real-world practical use of libgccjit?
- Is there any easy tasks you need help with?
- yes, your updates and communication with the community have been great
- I believe, going by the aliases, there's at least a couple of GNU compiler hackers in this BBB room now :)
- you mentioned that these improvements are orthogonal to the garbage collector. Do you know of any work on that area?
- hmmm XEmacs got a new GC, much better -- and it turned out *slower* than the original. This stuff is hard...
- NullNix: Really? Yesterday Stefan mentioned XEmacs's GC and said that it could be used in GNU Emacs
- Alas, quite noticeably slower :( cache locality, probably. It may be possible to make it faster with more work, though, while the existing Emacs one is probably at its implementation limits.
- IIRC, the XEmacs one was a generational GC. It was a long time ago though, ICBW
- The JDK and Go both have interesting GC designs in this area...
- some level of "naive" optimism is necessary to start working on these big projects :)
- what kind of packages do you think could be now practical with native comp?
- ok, but what are the limits, in your opinion? How fast can elisp go?
- relevant link: <https://www.emacswiki.org/emacs/GuileEmacs> (with caveats. lots of caveats). note: guile has native support for elisp -- but the lack of buffers, the different rep with strings, etc, was *hard*. the guile compiler changed a *lot* in v3. v1.8 -> 2.0 -> 2.2 -> 3.0 were all big changes in the guile comp world
- indeed :)
- What are some other hobbies/interests of yours besides Emacs?
- Questioner: cool, reminds me of Thierry Volpiatto who's a professional climber, and there are several Emacsers who do DJing; that would be fun; "Emacs Plumbers Conf";
- will you be presenting there or anywhere else in the next year?
- Emacs keeps creeping toward being the Lisp Machine of the 21st century :)
- not only that, but with LSP and things like Doom, there is an increasing appeal for Emacs as an editor for the general public; native compilation will help with that
- (Probably a live question)
- yes, myths about emacs-devel are hard to dispel
- Eli is so patient with the people on Reddit :D
- agreed, we owe him a lot
- I've always wanted to do Emacs trading cards; like features, devs, etc :P
- that's a great idea :D
- I designed some for an old gaming clan years ago, it was a lot of fun
- Not American?~; in the US we have a tradition of baseball, and other sport playing cards, each with a picture and some stats on the back
- we have that with football (real football) in Europe :)
- (Probably live question
- there might be even more from RMS that weren't accounted for as separate commits when the repo was converted to git
- Where is the pre-git repository?
- I thought it was from bzr.
- I don't remember the details, but ESR's written about it on his blog IIRC
- do you have 'wish list' features, things you long for Emacs to be able to do?
- look for posts about reposurgeon
- dickmao has a patch that makes Gnus async.... 8k lines from what I've heard
- I recall that dickmao posted it to the Emacs tracker but it was somewhat monolithic and wasn't well accepted
- i think he was asked to break it down to more reviewable units
- One thing I wondered if you wanted to talk more about andrea was, to the prior point about "myths" about what emacs-devel is "like", there's also "make the culture your own". do you have advice on how to approach the community you haven't gotten to yet?
BBB feedback:
- Extremely impressive work, Andrea. Also, very needed for the long term sustainability of the platform. Thanks a lot for the hard work!
- Yes, if there were an Emacs Hall of Fame, Andrea would deserve a prominent place in it. :)
- we really do need an Emacs Hall of Fame so we can remember those who laid the foundations
- I think I can safely say that we are very grateful for your work, because there aren't many people in the world that could do it and who also have enough interest in Emacs to do so :)
- I have to go, thanks for replying to our questions, for the chat and for the incredible work, Andrea
- Thanks very much, and for your work on gccmacs :D
- thanks for the presentation and answering all of the questions.
thanks to you andrea for your awesome talk, and for the extended q&a!
IRC nick: akrl
- What's the risk of (setq native-comp-speed 3)? will it melt my cpu?
- The same as the risk of using -O3 with gcc. It gives itself the latitude to aggressively optimise away code elements which it believes are unnecessary, up to and including violating the language semantics of lisp (which gcc doesn't inherently care about). -O3 is something which is fine for specific cases where you test afterwards, but you would never, for example, set -O3 globally in Gentoo.
- so we can get type annotations in Elisp?!
- Is there a benefit in setting native-comp-compiler-options to "-mtune=native -march=<cpu>"?
- Would Eli agree on replacing the C parts of Emacs with Elisp? ;)
- Why not implement Emacs Lisp in Guile and use Guile's compiler?
- https://www.emacswiki.org/emacs/GuileEmacs
- guile elisp is a very-long-term project, but so far has never been good enough: the problem seems to be, alas, time overhead involved in bidirectional conversion of strings and things like that: and unfortunately Emacs is all about strings... guile can run elisp (or something very like it) but that's not anywhere near replacing the elisp interpreter...
Feedback:
- what a great talk. this will rise the hype for emacs 28
- This work is really amazing. Congratulations on the effort and the deep insights that made this possible.
- excellent presentation and work that will be greatly appreciate by all Emacs users.
- It is very humbling to see this depth of knowledge and how it positively impacts my day to day computing experience.
- this is a very interesting update on his talk at last year's GNU Tools Track at LPC :)
- The worse thing about native comp is that you get used to it after a couple of days and you don't appreciate it anymore! ;) which is not fair...
[[!inline pages="internal(2021/captions/native)" raw="yes"]]
[[!inline pages="internal(2021/info/native-nav)" raw="yes"]]
|
