LLMs and Emojis [D]

LLMs are trained on human data, so where does the tendency to add emojis come from?

For example, when some models generate code explanations or even normal responses, they often add lots of emojis that people don’t really use that way in real life.

My current guess (without having researched this yet) is that emojis might sometimes be added after the initial generation process, maybe during post-processing, alignment, or some “reasoning/thinking” stage, rather than being part of the raw generated response itself.

Because intuitively, an emoji doesn’t really behave like a normal word/token inside a sentence or code block.