1.21.0 (January 12, 2022)¶
Incompatible behavior changes¶
Changes that are expected to cause an incompatibility if applicable; deployment changes are likely required
auto_config: auto_config now verifies that any transport sockets configured via transport_socket_matches support ALPN. This behavioral change can be temporarily reverted by setting runtime guard
*became a reserved name for a wildcard resource that can be subscribed to and unsubscribed from at any time. This is a requirement for implementing the on-demand xDSes (like on-demand CDS) that can subscribe to specific resources next to their wildcard subscription. If such xDS is subscribed to both wildcard resource and to other specific resource, then in stream reconnection scenario, the xDS will not send an empty initial request, but a request containing
*for wildcard subscription and the rest of the resources the xDS is subscribed to. If the xDS is only subscribed to wildcard resource, it will try to send a legacy wildcard request. This behavior implements the recent changes in xDS protocol and can be temporarily reverted by setting the
envoy.restart_features.explicit_wildcard_resourceruntime guard to false.
Minor behavior changes¶
Changes that may cause incompatibilities for some users, but should not for most
bandwidth_limit: added bandwidth limit stats
bandwidth_limit: added response trailers when request or response delay are enforced.
dns: now respecting the returned DNS TTL for resolved hosts, rather than always relying on the hard-coded dns_refresh_rate.. This behavior can be temporarily reverted by setting the runtime guard
ext_authz: the ext_authz span was always getting sampled, even if the parent span was not; now the ext_authz span follows the parent’s sampling status.
http: directly responding with only a 1xx http status code isn’t valid, and is now refused as invalid direct_response config.
http: envoy will now proxy 102 and 103 headers from upstream, though as with 100s only the first 1xx response headers will be sent. This behavioral change by can temporarily reverted by setting runtime guard
http: usage of the experimental matching API is no longer guarded behind a feature flag, as the corresponding protobuf fields have been marked as WIP.
http: when a downstream connection hits a configured
max_requests_per_connection, it will send an HTTP/2 “shutdown notification” (GOAWAY frame with max stream ID) and go to a default grace period of 5000 milliseconds (5 seconds) if drain_timeout is not specified. During this grace period, envoy will continue to accept new streams. After the grace period, a final GOAWAY is sent and envoy will start refusing new streams. However before the bugfix, during the grace period, every time a new stream is received, envoy would restart the drain which caused the grace period to be extended and so making it longer than the configured drain timeout.
json: switching from rapidjson to nlohmann/json. This behavioral change can be temporarily reverted by setting runtime guard
listener: destroy per network filter chain stats when a network filter chain is removed during the listener in place update.
router: take elapsed time into account when setting the
x-envoy-expected-rq-timeout-ms headerfor retries, and never send a value that’s longer than the request timeout. This behavioral change can be temporarily reverted by setting runtime guard
stream_info: response code details with empty space characters (‘ ‘, ‘\t’, ‘\f’, ‘\v’, ‘\n’, ‘\r’) is not accepted by the
upstream: fixed a bug where auto_config didn’t work for wrapped TLS sockets (e.g. if proxy proto were configured for TLS).
Changes expected to improve the state of the world and are unlikely to have negative effects
ext_authz: fix the ext_authz http filter to correctly set response flags to
UAEXwhen a connection is denied.
ext_authz: fix the ext_authz network filter to correctly set response flag and code details to
UAEXwhen a connection is denied.
hcm: stop processing the response if encoding it has caused downstream reset. The fix is guarded by
listener: fixed issue where more than one listener could listen on the same port if using reuse port, thus randomly accepting connections on different listeners. This configuration is now rejected.
tcp: fixing a log error where errors both from the kernel and the transport were not handled gracefully.
thrift_proxy: do not close downstream connections when an upstream connection overflow happens.
thrift_proxy: fix the thrift_proxy connection manager to correctly report success/error response metrics when performing payload passthrough.
Removed config or runtime¶
Normally occurs at the end of the deprecation period
envoy.reloadable_features.enable_compression_without_content_length_headerruntime guard and legacy code paths.
envoy.reloadable_features.grpc_web_fix_non_proto_encoded_response_handlingand legacy code paths.
header map: removed
envoy.reloadable_features.header_map_correctly_coalesce_cookiesand legacy code paths.
health check: removed
envoy.reloadable_features.health_check.immediate_failure_exclude_from_clusterruntime guard and legacy code paths.
envoy.reloadable_features.add_and_validate_scheme_headerand legacy code paths.
envoy.reloadable_features.check_unsupported_typed_per_filter_config, Envoy will always check unsupported typed per filter config if the filter isn’t optional.
envoy.reloadable_features.dont_add_content_length_for_bodiless_requestsand legacy code paths.
envoy.reloadable_features.grpc_json_transcoder_adhere_to_buffer_limitsand legacy code paths.
envoy.reloadable_features.http2_skip_encoding_empty_trailersand legacy code paths. Envoy will always encode empty trailers by sending empty data with
end_streamtrue (instead of sending empty trailers) for HTTP/2.
envoy.reloadable_features.improved_stream_limit_handlingand legacy code paths.
envoy.reloadable_features.remove_forked_chromium_urland legacy code paths.
envoy.reloadable_features.return_502_for_upstream_protocol_errors. Envoy will always return 502 code upon encountering upstream protocol error.
envoy.reloadable_features.treat_host_like_authorityand legacy code paths.
envoy.reloadable_features.treat_upstream_connect_timeout_as_connect_failureand legacy code paths.
envoy.reloadable_features.upstream_http2_flood_checksand legacy code paths.
envoy.reloadable_features.upstream_host_weight_change_causes_rebuildand legacy code paths.
access log: added custom_tags to annotate log entries with custom tags.
access log: added grpc_stream_retry_policy to the gRPC logger to reconnect when a connection fails to be established.
access_log: added METADATA token to handle all types of metadata (DYNAMIC, CLUSTER, ROUTE).
access_log: added a CEL extension filter to enable filtering of access logs based on Envoy attribute expressions.
access_log: added new access_log command operator
%UPSTREAM_REQUEST_ATTEMPT_COUNT%to retrieve the number of times given request got attempted upstream.
access_log: added new access_log command operator
%VIRTUAL_CLUSTER_NAME%to retrieve the matched Virtual Cluster name.
api: added support for
xds.type.v3.TypedStructin addition to the now-deprecated
udpa.type.v1.TypedStructproto message, which is a wrapper proto used to encode typed JSON data in a
aws_request_signing_filter: added match_excluded_headers to the signing filter to optionally exclude request headers from signing.
bootstrap: added typed_dns_resolver_config in the bootstrap to support DNS resolver as an extension.
cluster: added typed_dns_resolver_config in the cluster to support DNS resolver as an extension.
decompressor: added ignore_no_transform_header to run decompression regardless of the value of the
no-transformcache control header.
dns: added ALL option to return both IPv4 and IPv6 addresses.
dns_cache: added typed_dns_resolver_config in the dns_cache to support DNS resolver as an extension.
dns_filter: added typed_dns_resolver_config in the dns_filter to support DNS resolver as an extension.
dns_resolver: added AppleDnsResolverConfig to support apple DNS resolver as an extension.
dns_resolver: added CaresDnsResolverConfig to support c-ares DNS resolver as an extension.
dns_resolver: added filter_unroutable_families to the c-ares DNS resolver.
dns_resolver: added use_resolvers_as_fallback to the c-ares DNS resolver.
grpc_http_bridge: added upgrade_protobuf_to_grpc option for automatically framing protobuf payloads as gRPC requests.
grpc_json_transcoder: added support for matching unregistered custom verb match_unregistered_custom_verb.
http: added support for forwarding HTTP1 reason phrase.
http: added support for retriable health check status codes.
http: added support for
%REQUESTED_SERVER_NAME%to extract SNI as a custom header.
http: added support for
%VIRTUAL_CLUSTER_NAME%to extract the matched Virtual Cluster name as a custom header.
http: added timing information about upstream connection and encryption establishment to stream info. These can currently be accessed via custom access loggers.
listener: added support for MPTCP (multipath TCP).
listener: added support for opting out listeners from the globally set downstream connection limit via ignore_global_conn_limit.
matcher: added support for
xds.type.matcher.v3.IPMatcherIP trie matching.
oauth filter: added cookie_names to allow overriding (default) cookie names (
OauthExpires) set by the filter.
oauth filter: setting
RefreshTokencookies if they are provided by Identity provider along with
perf: added support for Perfetto performance tracing.
router: added support for the x-forwarded-host header.
stateful session http filter: added stateful session http filter.
stats: added text_readouts query parameter to prometheus stats to return gauges made from text readouts.
tcp_proxy: added support to populate upstream http connect header values from stream info.
thrift_proxy: add header to metadata filter for turning headers into dynamic metadata.
thrift_proxy: add host level success/error metrics where success is a reply of type success and error is any other response to a call.
thrift_proxy: add upstream metrics to show decoding errors and whether exception is from local or remote, e.g.
thrift_proxy: add upstream response zone metrics in the form
thrift_proxy: support header flags.
thrift_proxy: support subset lb when using request or route metadata.
tls: added support for match_typed_subject_alt_names for subject alternative names to enforce specifying the subject alternative name type for the matcher to prevent matching against an unintended type in the certificate.
tls: added support for only verifying the leaf CRL in the certificate chain with only_verify_leaf_cert_crl.
tls: support loading certificate chain and private key via pkcs12.
tls_inspector filter: added enable_ja3_fingerprinting to create JA3 fingerprint hash from Client Hello message.
transport_socket: added envoy.transport_sockets.tcp_stats which generates additional statistics gathered from the OS TCP stack.
udp: add support for multiple listener filters.
udp_proxy: added use_per_packet_load_balancing option to enable per packet load balancing (selection of upstream host on each data chunk).
upstream: added the ability to configure max connection duration for upstream clusters.
xds: re-introduced unified delta and sotw xDS multiplexers that share most of the implementation. Added a new runtime config
envoy.reloadable_features.unified_mux(disabled by default) that when enabled, switches xDS to use unified multiplexers.