I don't know of a word more specific than courtesy and similar, such as civility and politesse, or politeness or perhaps good manners.
On the host's part, hospitality usually is expected. Also see Wikipedia's article re Greek term xenia, which starts with X.
Edit 1: Regarding committee, suggested in another answer, wiktionary shows (besides the usual "group of persons convened for the accomplishment of some specific purpose" meaning) a second meaning: "(archaic) a guardian; someone in charge of another person deemed to be unable to look after himself or herself". This meaning vaguely applies in the case of the quoted instance, "You are guests in my home. As such I require you to respect rules of committee, as I do the rules of hospitality."
However, there's a good possibility the episode-writer used or meant to use the well-known Latin word comitas ("politeness, courtesy; kindness, generosity") but got stuck with committee by an editing mistake. Hospitality also being of Latin origin, the sentence "I require you to respect rules of comitas, as I do the rules of hospitality" reads reasonably well because of the two parallel words. Alternately, comity, "courtesy", might be used. Per etymonline:
early 15c., "association," from Fr. comité, from L. comitas "courtesy, kindness, affability," from comis "courteous, friendly, kind," of uncertain origin. Meaning "courtesy" in English is from 1540s. Phrase comity of nations attested from 1862: "The obligation recognized by civilized nations to respect each other's laws and usages as far as their separate interests allow."
The sense of "obligation ... to respect each other's laws and usages" fits well into the context of the episode quote, and its still more likely with comity than with comitas that a spell-checker or an editor could have substituted committee.