Is there a word for "the sunlight that streams into a room through the window, or a crack in the curtain or through a skylight"
These are also called shafts of light
Shaft: 5. Something suggestive of a spear or arrow in appearance or configuration, as: a. A ray or beam of light.1
A shaft of light falls on the scene as the young-looking Fortinbras enters...
1 American Heritage® Dictionary of the English Language, Fifth Edition. Copyright © 2011 by Houghton Mifflin Harcourt Publishing Company. Published by Houghton Mifflin Harcourt Publishing Company. All rights reserved.
How about sunbeams or rays of sunlight? The meaning of these terms is a little broader than the specific context you're talking about, but I can't think of a better word.
Sunbeam here is defined as:
a beam, ray, or stream of sunlight.
An additional term is god rays, often used as a synonym of crepuscular rays in particular.
It is regularly used in the gaming industry to refer to the capability of a graphical engine to render volumetric lighting, by means of which light is seemingly scattered when travelling through non-solid objects (like air).
Although I believe it is commonly known in the CGI world, neither Merriam-Webster, Collins nor Dictionary.com have an entry for this term. Wikipedia's Sunbeams page seems to be the most prominent semi-authoritative website mentioning the phrase.