go/src
Michael Anthony Knyszek b25b5f3ff4 runtime: fix GODEBUG=gccheckmark=1 and add smoke test
This change fixes GODEBUG=gccheckmark=1 which seems to have bit-rotted.
Because the root jobs weren't being reset, it wasn't doing anything.
Then, it turned out that checkmark mode would queue up noscan objects in
workbufs, which caused it to fail. Then it turned out checkmark mode was
broken with user arenas, since their heap arenas are not registered
anywhere. Then, it turned out that checkmark mode could just not run
properly if the goroutine's preemption flag was set (since
sched.gcwaiting is true during the STW). And lastly, it turned out that
async preemption could cause erroneous checkmark failures.

This change fixes all these issues and adds a simple smoke test to dist
to run the runtime tests under gccheckmark, which exercises all of these
issues.

Fixes #69074.
Fixes #69377.
Fixes #69376.

Change-Id: Iaa0bb7b9e63ed4ba34d222b47510d6292ce168bc
Cq-Include-Trybots: luci.golang.try:gotip-linux-amd64-longtest
Reviewed-on: https://go-review.googlesource.com/c/go/+/608915
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Auto-Submit: Michael Knyszek <mknyszek@google.com>
Reviewed-by: Carlos Amedee <carlos@golang.org>
2025-02-03 08:21:09 -08:00
..
archive archive/zip, archive/tar: writer appends slash to directory names 2025-01-27 20:20:09 -08:00
arena
bufio bufio: make the description of Peek's behavior better 2024-12-09 16:30:42 +00:00
builtin builtin: use list instead of indentation for comments in cap, len, and make 2024-12-30 15:59:23 -08:00
bytes bytes, strings: add cross-references in docstrings 2024-12-17 11:08:32 -08:00
cmd runtime: fix GODEBUG=gccheckmark=1 and add smoke test 2025-02-03 08:21:09 -08:00
cmp
compress
container
context context: use "canceled" in docs to refer to timed-out contexts 2025-01-03 14:30:13 -08:00
crypto crypto/internal/cryptotest: print stderr if go tool fails 2025-02-03 08:20:05 -08:00
database/sql
debug debug/elf: adjust version API per issue discussion 2024-12-17 13:28:29 -08:00
embed embed: document exclusions more explicitly 2024-12-05 17:20:19 +00:00
encoding encoding/json: cleanup tests 2025-01-14 14:54:07 -08:00
errors
expvar
flag
fmt fmt, strconv: document that exponent is always two digits 2024-12-17 07:54:13 -08:00
go go/types: avoid importer.Default 2025-01-22 10:13:04 -08:00
hash hash/maphash, cmd/compile: make Comparable[string] not escape its argument 2024-12-02 21:27:06 +00:00
html html/template: escape script tags in JS errors case insensitively 2024-12-10 19:03:42 +00:00
image internal/byteorder: use canonical Go casing in names 2024-11-20 20:59:28 +00:00
index/suffixarray
internal internal/goversion: update Version to 1.25 2025-02-03 07:28:02 -08:00
io
iter iter: improve documentation with iterator example 2024-12-27 05:44:33 -08:00
log log/slog: make DiscardHandler example package-level 2024-12-11 13:06:33 -08:00
maps all: fix some function names and typos in comment 2024-11-21 22:16:20 +00:00
math math/bits: update reference to debruijn paper 2024-12-04 22:15:36 +00:00
mime mime: disable TestLookupMallocs with ASAN 2024-11-19 02:54:28 +00:00
net net/url: add panic to unhex for imposible error case 2025-02-03 08:19:56 -08:00
os Revert "os: employ sendfile(2) for file-to-file copying on Linux when needed" 2025-01-29 06:29:28 -08:00
path internal/copyright: add test that copyright notices exist 2024-11-21 16:12:09 +00:00
plugin
reflect runtime: rename mapiterinit and mapiternext 2025-01-28 10:54:43 -08:00
regexp
runtime runtime: fix GODEBUG=gccheckmark=1 and add smoke test 2025-02-03 08:21:09 -08:00
slices slices: document two oddities 2024-12-21 08:22:08 -08:00
sort sort: add examples for SearchStrings, SliceIsSorted 2024-12-03 17:07:42 +00:00
strconv strconv: adjust comment so that gofmt doesn't mung it 2025-01-27 13:16:45 -08:00
strings bytes, strings: add cross-references in docstrings 2024-12-17 11:08:32 -08:00
structs
sync sync: document RWMutex locks cannot be upgraded / downgraded 2024-12-04 02:44:30 +00:00
syscall syscall/js: adjust comments to that gofmt does not change them 2025-01-13 11:11:07 -08:00
testdata
testing testing: fix reference to B.N in docstring 2025-01-21 04:36:54 -08:00
text text/template: don't crash piping to call with no arguments 2024-11-18 16:24:22 +00:00
time internal/synctest: new package for testing concurrent code 2024-11-19 19:40:40 +00:00
unicode
unique unique: fix typo 2024-12-30 08:59:20 -08:00
unsafe
vendor net/http: update bundled golang.org/x/net/http2 [generated] 2025-01-21 13:03:18 -08:00
weak weak: don't panic when calling Value on a zero Pointer 2025-01-07 10:08:42 -08:00
Make.dist
README.vendor
all.bash
all.bat
all.rc
bootstrap.bash
buildall.bash
clean.bash
clean.bat
clean.rc
cmp.bash
go.mod net/http: update bundled golang.org/x/net/http2 [generated] 2025-01-21 13:03:18 -08:00
go.sum net/http: update bundled golang.org/x/net/http2 [generated] 2025-01-21 13:03:18 -08:00
make.bash
make.bat
make.rc make.rc: correct test for undefined GOROOT_BOOTSTRAP 2024-11-14 18:02:59 +00:00
race.bash
race.bat
run.bash
run.bat
run.rc

README.vendor

Vendoring in std and cmd
========================

The Go command maintains copies of external packages needed by the
standard library in the src/vendor and src/cmd/vendor directories.

There are two modules, std and cmd, defined in src/go.mod and
src/cmd/go.mod. When a package outside std or cmd is imported
by a package inside std or cmd, the import path is interpreted
as if it had a "vendor/" prefix. For example, within "crypto/tls",
an import of "golang.org/x/crypto/cryptobyte" resolves to
"vendor/golang.org/x/crypto/cryptobyte". When a package with the
same path is imported from a package outside std or cmd, it will
be resolved normally. Consequently, a binary may be built with two
copies of a package at different versions if the package is
imported normally and vendored by the standard library.

Vendored packages are internally renamed with a "vendor/" prefix
to preserve the invariant that all packages have distinct paths.
This is necessary to avoid compiler and linker conflicts. Adding
a "vendor/" prefix also maintains the invariant that standard
library packages begin with a dotless path element.

The module requirements of std and cmd do not influence version
selection in other modules. They are only considered when running
module commands like 'go get' and 'go mod vendor' from a directory
in GOROOT/src.

Maintaining vendor directories
==============================

Before updating vendor directories, ensure that module mode is enabled.
Make sure that GO111MODULE is not set in the environment, or that it is
set to 'on' or 'auto', and if you use a go.work file, set GOWORK=off.

Also, ensure that 'go env GOROOT' shows the root of this Go source
tree. Otherwise, the results are undefined. It's recommended to build
Go from source and use that 'go' binary to update its source tree.

Requirements may be added, updated, and removed with 'go get'.
The vendor directory may be updated with 'go mod vendor'.
A typical sequence might be:

    cd src  # or src/cmd
    go get golang.org/x/net@master
    go mod tidy
    go mod vendor

Use caution when passing '-u' to 'go get'. The '-u' flag updates
modules providing all transitively imported packages, not only
the module providing the target package.

Note that 'go mod vendor' only copies packages that are transitively
imported by packages in the current module. If a new package is needed,
it should be imported before running 'go mod vendor'.