As far as English is concerned, most punctuation should not be used at the start of a line.
If we must be pedantic, we can say that you could write the first word of a sentence with quotation marks. In that case you'd have punctuation at the beginning.
But commas can stay at the start of a sentence when they divide two clause, introducing a relative one, for example; but in that case it will be in the middle, not at the real start. There is no case where the comma would be at the beginning.
Other examples of punctuation that can start a sentence are dotted lists, for example, still belonging to "punctuation".
About the line break, the comma should stay at the end of the previous line,