So I have some text that I want to analyze as part of a statistical analysis. I'm specifically interested in the relationships of words. I'm looking for:
- The most frequently used 'word pairs' eg. the words which based on their average frequency in the text are most regularly adjacent to each other.
- The most distant words eg. frequently used words tend to have the most words between them on average.
While I relate to the first example as 'frequent word pairs' I'm trying to find out what to call those word combinations with the largest distance between them.
To clarify as there have been a fair few comments: I'm not looking at the distance of any word pairs but those words where the usage is most frequently increased in a subset of text compared to the average corpus of words.
An example will be words with an increased word frequency in a specific subreddit on reddit.