When the word abandon has the word with with in front of it it means without concerns or perhaps consequences or care what others think. she danced with abandon or she danced freely. He spent money with abandon or he spent money without thinking of the consequences. they drank with abandon and did not get up for work or they drank without caring about getting up for work.
You could drive with abandon, swear with abandon, steal or lie with abandon, or even eat, drink or smoke with abandon. These may all have negative consequences but you are abandoning responsibility for a time. You can dance with abandon, sing with abandon, laugh with abandon or love with abandon. These things might make on feel uncomfortable but you are abandoning your inhibitions for a time.
I am not an English major but it is my native language and this is a funny word that is not really clearly explained in the dictionary.