A "case in point" is something like a relevant example. How does the phrase break down literally, though? For example, "with bated breath" makes sense because "to bate" means to hold, so "with bated breath" means with breath held in anticipation. What about "case in point"?
In point comes from French. World Wide Words explains it as follows: