His office is . . . . . . . . the second floor to the building.

A preposition is a word which comes before a noun or a pronoun and establishes a relationship between the elements of a clause or words. 'On' is correct as it indicates a surface. The other options are wrong as 'at', 'in', and 'of' indicate a specific location, inside something, and possession respectively.