We propose an approach how to develop and integrate usability metrics in (multimodal) dialog systems and user interfaces with
Model Driven Software Development (MDSD). It enables the developer to start early with simple metrics and allows him to refine
them during the ongoing work. Additionally, we show how the resulting metrics can be used to estimate the usability in advance,
so that the developer may care about critical parts of the application before testing it.