- an opinion formed beforehand without adequate evidence
- a partiality that prevents objective consideration of an issue or situation (Vocabulary.com)
IMO, a preconception can imply 'both positive and negative emotional associations', as per your requirement.