testing - What kinds of out-of-band failures am I forgetting to test? -


i came across amazing presentation years ago (which of course can't find) listed bunch of kinds of failures remote services people don't test for.

in addition timeout, 4xx, 5xx, etc, listed things like:

  • connection closes after 10 bytes of data
  • returns contents of www.google.com
  • returns contents of /dev/random
  • returns contents of /etc/passwd
  • returns correctly-formatted unicode chinese text
  • returns ansi color control characters
  • returns incorrect content-type, labeled correctly (you requested content-type: application/json, send content-type: application/jpeg)
  • returns 1 byte of data every 29 seconds

what types of "out-of-band failures" you've encountered developers don't (but should) test for?

(extra bonus points if can find original presentation)

the ones listed great; i'd love see original presentation if dig up! couple other favorites:

  • a "valid" response couple bits flipped
  • a "valid" response data weren't expecting ({"result": 123, "extrastuff": {...}}) simulate upgrades remote side
  • a syntactically-valid response never ends ({"results":["lol", "lol", "lol", ..., or bunch of whitespace)

Comments

Popular posts from this blog

javascript - Using jquery append to add option values into a select element not working -

Android soft keyboard reverts to default keyboard on orientation change -

jquery - javascript onscroll fade same class but with different div -