go/src
Damien Neil fdc21f3eaf net/http: don't set length for non-range encoded content requests
Historically, serveContent has not set Content-Length
when the user provides Content-Encoding.

This causes broken responses when the user sets both Content-Length
and Content-Encoding, and the request is a range request,
because the returned data doesn't match the declared length.

CL 381956 fixed this case by changing serveContent to always set
a Content-Length header.

Unfortunately, I've discovered multiple cases in the wild of
users setting Content-Encoding: gzip and passing serveContent
a ResponseWriter wrapper that gzips the data written to it.

This breaks serveContent in a number of ways. In particular,
there's no way for it to respond to Range requests properly,
because it doesn't know the recipient's view of the content.

What the user should be doing in this case is just using
io.Copy to send the gzipped data to the response.
Or possibly setting Transfer-Encoding: gzip.
But whatever they should be doing, what they are doing has
mostly worked for non-Range requests, and setting
Content-Length makes it stop working because the length
of the file being served doesn't match the number of bytes
being sent.

So in the interests of not breaking users (even if they're
misusing serveContent in ways that are already broken),
partially revert CL 381956.

For non-Range requests, don't set Content-Length when
the user has set Content-Encoding. This matches our previous
behavior and causes minimal harm in cases where we could
have set Content-Length. (We will send using chunked
encoding rather than identity, but that's fine.)

For Range requests, set Content-Length unconditionally.
Either the user isn't mangling the data in the ResponseWriter,
in which case the length is correct, or they are, in which
case the response isn't going to contain the right bytes anyway.
(Note that a Range request for a Content-Length: gzip file
is requesting a range of *gzipped* bytes, not a range from
the uncompressed file.)

Change-Id: I5e788e6756f34cee520aa7c456826f462a59f7eb
Reviewed-on: https://go-review.googlesource.com/c/go/+/542595
Auto-Submit: Damien Neil <dneil@google.com>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Reviewed-by: Jonathan Amsterdam <jba@google.com>
2023-11-15 18:59:12 +00:00
..
archive archive: add available godoc link 2023-10-13 18:36:46 +00:00
arena
bufio bufio: allow terminating Scanner early cleanly without a final token or an error 2023-10-23 09:06:30 +00:00
builtin
bytes bytes,internal/bytealg: add func bytealg.LastIndexRabinKarp 2023-11-01 19:02:57 +00:00
cmd cmd/compile/internal/inline: score call sites exposed by inlines 2023-11-15 14:28:00 +00:00
cmp cmp: gofmt 2023-09-28 17:57:40 +00:00
compress compress: some minor corrections or adjustments for godoc link 2023-10-13 23:20:03 +00:00
container container/heap: add available godoc link 2023-10-12 14:39:10 +00:00
context all: stop using fmt.Sprintf in t.Error/t.Fatal 2023-09-20 18:57:24 +00:00
crypto crypto/tls: remove RSA KEX ciphers from the default list 2023-11-14 18:03:29 +00:00
database/sql database/sql: add godoc links 2023-10-23 09:04:12 +00:00
debug debug/elf,cmd/link: add additional relocations for loong64 2023-11-02 19:46:03 +00:00
embed embed: add available godoc link 2023-10-18 19:37:19 +00:00
encoding encoding/json: use reflect.Value.IsZero 2023-10-18 20:00:40 +00:00
errors errors: add available godoc link 2023-11-02 19:45:41 +00:00
expvar expvar: add available godoc link 2023-10-13 20:31:53 +00:00
flag flag: add available godoc link 2023-10-18 19:36:19 +00:00
fmt fmt: clarify that we don't call String for %#v 2023-09-25 14:28:27 +00:00
go go/types, types2: remove local version processing in favor of go/version 2023-11-15 00:07:05 +00:00
hash hash/maphash: weaken avalanche test a bit more 2023-10-31 17:00:31 +00:00
html html/template: track brace depth for each nested expression 2023-10-16 03:29:27 +00:00
image image: add available godoc link 2023-10-19 12:02:45 +00:00
index/suffixarray index/suffixarray: add available godoc link 2023-10-13 19:15:06 +00:00
internal internal/cpu: detect support of AVX512 2023-11-15 18:30:03 +00:00
io io: add available godoc link 2023-10-18 19:34:35 +00:00
log log/slog: add LogLoggerLevel to enable setting level on the default logger 2023-11-10 21:25:30 +00:00
maps maps: add examples for Clone,Copy and Equal 2023-10-11 20:21:56 +00:00
math math/big: update comment in the implementation of FloatPrec 2023-11-14 16:45:59 +00:00
mime
net net/http: don't set length for non-range encoded content requests 2023-11-15 18:59:12 +00:00
os os/signal: remove some arbitrary timeouts in tests 2023-11-09 15:34:56 +00:00
path path/filepath: consider \\?\c: as a volume on Windows 2023-11-09 22:45:11 +00:00
plugin plugin: add available godoc link 2023-11-06 19:46:10 +00:00
reflect reflect: optimize Value.IsZero for array types 2023-11-15 04:10:05 +00:00
regexp regexp: add godoc links 2023-10-11 20:23:37 +00:00
runtime internal/cpu: detect support of AVX512 2023-11-15 18:30:03 +00:00
slices slices: zero the slice elements discarded by Delete, DeleteFunc, Compact, CompactFunc, Replace. 2023-11-14 17:12:38 +00:00
sort all: drop old +build lines 2023-10-19 23:33:27 +00:00
strconv all: drop old +build lines 2023-10-19 23:33:27 +00:00
strings bytes,strings: add available godoc link 2023-10-13 17:10:31 +00:00
sync sync: use atomic.Uint32 in Once 2023-10-06 21:01:50 +00:00
syscall syscall: regen zsyscall_{aix_ppc64,solaris_amd64}.go 2023-11-10 21:09:10 +00:00
testdata
testing testing: add available godoc link 2023-11-08 17:55:47 +00:00
text
time all: fix function names 2023-10-14 22:30:23 +00:00
unicode unicode: add available godoc link 2023-11-06 20:02:46 +00:00
unsafe
vendor net/http: pull http2 underflow fix from x/net/http2 2023-10-26 15:35:15 +00:00
Make.dist
README.vendor
all.bash
all.bat
all.rc
bootstrap.bash
buildall.bash
clean.bash
clean.bat
clean.rc
cmp.bash
go.mod net/http: pull http2 underflow fix from x/net/http2 2023-10-26 15:35:15 +00:00
go.sum net/http: pull http2 underflow fix from x/net/http2 2023-10-26 15:35:15 +00:00
make.bash make.bash: use [[ rather than [ 2023-10-03 06:40:46 +00:00
make.bat
make.rc
race.bash
race.bat
run.bash
run.bat
run.rc

README.vendor

Vendoring in std and cmd
========================

The Go command maintains copies of external packages needed by the
standard library in the src/vendor and src/cmd/vendor directories.

There are two modules, std and cmd, defined in src/go.mod and
src/cmd/go.mod. When a package outside std or cmd is imported
by a package inside std or cmd, the import path is interpreted
as if it had a "vendor/" prefix. For example, within "crypto/tls",
an import of "golang.org/x/crypto/cryptobyte" resolves to
"vendor/golang.org/x/crypto/cryptobyte". When a package with the
same path is imported from a package outside std or cmd, it will
be resolved normally. Consequently, a binary may be built with two
copies of a package at different versions if the package is
imported normally and vendored by the standard library.

Vendored packages are internally renamed with a "vendor/" prefix
to preserve the invariant that all packages have distinct paths.
This is necessary to avoid compiler and linker conflicts. Adding
a "vendor/" prefix also maintains the invariant that standard
library packages begin with a dotless path element.

The module requirements of std and cmd do not influence version
selection in other modules. They are only considered when running
module commands like 'go get' and 'go mod vendor' from a directory
in GOROOT/src.

Maintaining vendor directories
==============================

Before updating vendor directories, ensure that module mode is enabled.
Make sure that GO111MODULE is not set in the environment, or that it is
set to 'on' or 'auto'.

Requirements may be added, updated, and removed with 'go get'.
The vendor directory may be updated with 'go mod vendor'.
A typical sequence might be:

    cd src
    go get golang.org/x/net@master
    go mod tidy
    go mod vendor

Use caution when passing '-u' to 'go get'. The '-u' flag updates
modules providing all transitively imported packages, not only
the module providing the target package.

Note that 'go mod vendor' only copies packages that are transitively
imported by packages in the current module. If a new package is needed,
it should be imported before running 'go mod vendor'.