This one sounds silly, but I am curious about how the question mark came into existence, in all languages. For instance, in Japanese, we use the character か at the end to designate a sentence as a question (as an example, look it up for usage! 
), so the history of the question mark sounds fascinating.
A good place to start is probably Question mark - Wikipedia.