Exploring the use of Machine Learning and the generation of music lyrics. In this paper you will find many materials covered from the data processing required when human language is involved to Machine Learning techniques that are able to learn from text data. Discussing the strengths and weaknesses of different approaches as well how to combat them with a mix of techniques. Overall this paper is meant as an exploration and deep dive into machine learning and it many branches, touching on stochastic learning to path-finding and much more.