Networking Runbooks

DNS resolution, TCP connections, TLS handshakes, and packet loss.

25 scenarios ยท search and filter below, or jump via the quick nav.

Intermediate11 runbooks
DNS returns NXDOMAIN for a record that exists -- stale resolver or propagation delayhigh

dig/nslookup returns NXDOMAIN for a domain that was recently updated

NetworkingIntermediate3 causes
1Open runbook
DNS SERVFAIL -- resolver cannot answer, misconfigured zone or broken DNSSECcritical

dig returns status: SERVFAIL for one or more domains

NetworkingIntermediate3 causes
2Open runbook
TCP connect timeout -- firewall silently dropping SYN packetscritical

curl: Connection timed out after 30-120s instead of refused

NetworkingIntermediate3 causes
3Open runbook
Connection reset by peer -- RST received from server, backend overload or bughigh

curl: (56) Connection reset by peer

NetworkingIntermediateRED4 causes
4Open runbook
TLS handshake fails -- unsupported protocol version (SSLv3, TLS 1.0/1.1 disabled)high

curl: (35) error:14094410:ssl routines:ssl3_read_bytes:sslv3 alert handshake failure

NetworkingIntermediate3 causes
5Open runbook
TLS incomplete certificate chain -- missing intermediate CA certificatehigh

curl: (60) SSL certificate problem: unable to get local issuer certificate

NetworkingIntermediate2 causes
6Open runbook
TLS cipher/version mismatch -- legacy client cannot negotiate with modern servermedium

Old Java/Python client gets 'no cipher suites in common' error

NetworkingIntermediate2 causes
7Open runbook
HTTP 502 Bad Gateway -- proxy cannot reach or connect to the upstream servicecritical

curl returns HTTP 502 Bad Gateway

NetworkingIntermediateRED3 causes
8Open runbook
HTTP 504 Gateway Timeout -- upstream service too slow, proxy timeout exceededhigh

curl returns HTTP 504 Gateway Timeout after exactly 60s (default nginx proxy timeout)

NetworkingIntermediateRED3 causes
9Open runbook
Firewall rule order -- REJECT/DROP rule before ACCEPT causes unexpected blockscritical

Connections to a specific port fail despite an ACCEPT rule existing for the source

NetworkingIntermediate3 causes
10Open runbook
IPv6 network unreachable -- IPv6 disabled or broken, app binds IPv6 onlyhigh

'connect: Network is unreachable' when the app tries to connect via IPv6

NetworkingIntermediate4 causes
11Open runbook
Advanced9 runbooks
dig resolves but browser/app cannot reach the host -- proxy or DNS interceptionhigh

dig and nslookup resolve the hostname correctly but curl/browser gets ERR_NAME_NOT_RESOLVED

NetworkingAdvanced3 causes
1Open runbook
Idle connections silently dropped -- NAT/firewall timeout killing long-lived connectionshigh

WebSocket or long-poll connection drops after ~300s or ~3600s of inactivity

NetworkingAdvanced3 causes
2Open runbook
High SYN retransmissions -- packet loss on the network pathhigh

netstat shows high RetransSegs counter increasing rapidly

NetworkingAdvancedUSE3 causes
3Open runbook
TLS client certificate required -- mTLS handshake failurehigh

curl: (35) error:14094410:ssl routines:ssl3_read_bytes:sslv3 alert handshake failure when connecting to mTLS endpoint

NetworkingAdvanced3 causes
4Open runbook
Proxy SNI mismatch -- TLS SNI not forwarded, every vhost gets the default certificatehigh

Browser shows certificate warning for a vhost -- certificate CN doesn't match the hostname

NetworkingAdvanced2 causes
5Open runbook
Keepalive close storm -- server sends Connection: close, causing connection churnmedium

High rate of TCP TIME_WAIT connections on the server

NetworkingAdvancedRED3 causes
6Open runbook
conntrack table full -- nf_conntrack: table full, dropping packetcritical

dmesg shows 'nf_conntrack: table full, dropping packet'

NetworkingAdvancedUSE3 causes
7Open runbook
PMTU blackhole -- large packets silently dropped due to Path MTU Discovery failurehigh

Small HTTP requests succeed but large responses or file transfers hang or fail

NetworkingAdvanced3 causes
8Open runbook
ARP cache incomplete or full -- neighbor table overflow, 'no route to host' locallyhigh

'No route to host' errors between hosts on the same subnet

NetworkingAdvancedUSE3 causes
9Open runbook