.. _arch_overview_http_routing: HTTP routing ============ Envoy includes an HTTP :ref:`router filter ` which can be installed to perform advanced routing tasks. This is useful both for handling edge traffic (traditional reverse proxy request handling) as well as for building a service to service Envoy mesh (typically via routing on the host/authority HTTP header to reach a particular upstream service cluster). Envoy also has the ability to be configured as forward proxy. In the forward proxy configuration, mesh clients can participate by appropriately configuring their http proxy to be an Envoy. At a high level the router takes an incoming HTTP request, matches it to an upstream cluster, acquires a :ref:`connection pool ` to a host in the upstream cluster, and forwards the request. The router filter supports the following features: * Virtual hosts that map domains/authorities to a set of routing rules. * Prefix and exact path matching rules (both :ref:`case sensitive ` and case insensitive). Regex/slug matching is not currently supported, mainly because it makes it difficult/impossible to programmatically determine whether routing rules conflict with each other. For this reason we don’t recommend regex/slug routing at the reverse proxy level, however we may add support in the future depending on demand. * :ref:`TLS redirection ` at the virtual host level. * :ref:`Path `/:ref:`host ` redirection at the route level. * :ref:`Direct (non-proxied) HTTP responses ` at the route level. * :ref:`Explicit host rewriting `. * :ref:`Automatic host rewriting ` based on the DNS name of the selected upstream host. * :ref:`Prefix rewriting `. * :ref:`Websocket upgrades ` at route level. * :ref:`Request retries ` specified either via HTTP header or via route configuration. * Request timeout specified either via :ref:`HTTP header ` or via :ref:`route configuration `. * Traffic shifting from one upstream cluster to another via :ref:`runtime values ` (see :ref:`traffic shifting/splitting `). * Traffic splitting across multiple upstream clusters using :ref:`weight/percentage-based routing ` (see :ref:`traffic shifting/splitting `). * Arbitrary header matching :ref:`routing rules `. * Virtual cluster specifications. A virtual cluster is specified at the virtual host level and is used by Envoy to generate additional statistics on top of the standard cluster level ones. Virtual clusters can use regex matching. * :ref:`Priority ` based routing. * :ref:`Hash policy ` based routing. * :ref:`Absolute urls ` are supported for non-tls forward proxies. Route table ----------- The :ref:`configuration ` for the HTTP connection manager owns the :ref:`route table ` that is used by all configured HTTP filters. Although the router filter is the primary consumer of the route table, other filters also have access in case they want to make decisions based on the ultimate destination of the request. For example, the built in rate limit filter consults the route table to determine whether the global rate limit service should be called based on the route. The connection manager makes sure that all calls to acquire a route are stable for a particular request, even if the decision involves randomness (e.g. in the case of a runtime configuration route rule). .. _arch_overview_http_routing_retry: Retry semantics --------------- Envoy allows retries to be configured both in the :ref:`route configuration ` as well as for specific requests via :ref:`request headers `. The following configurations are possible: * **Maximum number of retries**: Envoy will continue to retry any number of times. An exponential backoff algorithm is used between each retry. Additionally, *all retries are contained within the overall request timeout*. This avoids long request times due to a large number of retries. * **Retry conditions**: Envoy can retry on different types of conditions depending on application requirements. For example, network failure, all 5xx response codes, idempotent 4xx response codes, etc. Note that retries may be disabled depending on the contents of the :ref:`x-envoy-overloaded `. .. _arch_overview_http_routing_priority: Priority routing ---------------- Envoy supports priority routing at the :ref:`route ` level. The current priority implementation uses different :ref:`connection pool ` and :ref:`circuit breaking ` settings for each priority level. This means that even for HTTP/2 requests, two physical connections will be used to an upstream host. In the future Envoy will likely support true HTTP/2 priority over a single connection. The currently supported priorities are *default* and *high*. .. _arch_overview_http_routing_direct_response: Direct responses ---------------- Envoy supports the sending of "direct" responses. These are preconfigured HTTP responses that do not require proxying to an upstream server. There are two ways to specify a direct response in a Route: * Set the :ref:`direct_response ` field. This works for all HTTP response statuses. * Set the :ref:`redirect ` field. This works for redirect response statuses only, but it simplifies the setting of the *Location* header. A direct response has an HTTP status code and an optional body. The Route configuration can specify the response body inline or specify the pathname of a file containing the body. If the Route configuration specifies a file pathname, Envoy will read the file upon configuration load and cache the contents. .. attention:: If a response body is specified, it must be no more than 4KB in size, regardless of whether it is provided inline or in a file. Envoy currently holds the entirety of the body in memory, so the 4KB limit is intended to keep the proxy's memory footprint from growing too large. If **response_headers_to_add** has been set for the Route or the enclosing Virtual Host, Envoy will include the specified headers in the direct HTTP response.