Skip to content

Commit 438470e

Browse files
committed
rustc: document the jobserver
Explicitly document that the jobserver may be used by `rustc`, as well as recommend the `+` indicator for integration of `rustc` into GNU Make. In particular, show the warning to increase the chances that this document is found when searching for solutions online. In addition, add a note about the issue with GNU Make 4.3 since it is important that users realize they should do this even if they do not expect parallelism from `rustc`. Finally, show how to workaround the issue of `$(shell ...)` calls in recursive Make (which e.g. was needed for the Linux kernel). The GNU Make 4.4 case under `--jobserver-style=pipe` is not added since it got fixed after Rust 1.76.0 already (i.e. `rustc` will not warn if it finds the negative file descriptors). From: rust-lang#120515 Cc: @petrochenkov @belovdv @weihanglo @bjorn3 Signed-off-by: Miguel Ojeda <[email protected]>
1 parent 8f359be commit 438470e

File tree

2 files changed

+49
-0
lines changed

2 files changed

+49
-0
lines changed

src/doc/rustc/src/SUMMARY.md

+1
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,7 @@
33
- [What is rustc?](what-is-rustc.md)
44
- [Command-line Arguments](command-line-arguments.md)
55
- [Codegen Options](codegen-options/index.md)
6+
- [Jobserver](jobserver.md)
67
- [Lints](lints/index.md)
78
- [Lint Levels](lints/levels.md)
89
- [Lint Groups](lints/groups.md)

src/doc/rustc/src/jobserver.md

+48
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,48 @@
1+
# Jobserver
2+
3+
Internally, `rustc` may take advantage of parallelism. `rustc` will coordinate
4+
with the build system calling it if a [GNU Make jobserver] is passed in the
5+
`MAKEFLAGS` environment variable.
6+
7+
Starting with Rust 1.76.0, `rustc` will warn if a jobserver appears to be
8+
available but is not accessible, e.g.:
9+
10+
```console
11+
$ echo 'fn main() {}' | MAKEFLAGS=--jobserver-auth=3,4 rustc -
12+
warning: failed to connect to jobserver from environment variable `MAKEFLAGS="--jobserver-auth=3,4"`: cannot open file descriptor 3 from the jobserver environment variable value: Bad file descriptor (os error 9)
13+
|
14+
= note: the build environment is likely misconfigured
15+
```
16+
17+
## Calling `rustc` from GNU Make
18+
19+
When calling `rustc` from GNU Make, it is recommended that all `rustc`
20+
invocations are marked as recursive in the `Makefile` (by prefixing the command
21+
line with the `+` indicator), so that GNU Make enables the jobserver for them.
22+
For instance:
23+
24+
```make
25+
x:
26+
+@echo 'fn main() {}' | rustc -
27+
```
28+
29+
In particular, GNU Make 4.3 (a widely used version as of 2024) passes a simple
30+
pipe jobserver in `MAKEFLAGS` even when it was not made available for the child
31+
process, which in turn means `rustc` will warn about it. For instance, if the
32+
`+` indicator is removed from the example above and GNU Make is called with e.g.
33+
`make -j2`, then the warning will trigger.
34+
35+
For calls to `rustc` inside `$(shell ...)` inside a recursive Make, one can
36+
disable the jobserver manually, e.g.:
37+
38+
```make
39+
S := $(shell MAKEFLAGS= rustc --print sysroot)
40+
41+
x:
42+
@$(MAKE) y
43+
44+
y:
45+
@echo $(S)
46+
```
47+
48+
[GNU Make jobserver]: https://www.gnu.org/software/make/manual/html_node/POSIX-Jobserver.html

0 commit comments

Comments
 (0)