This monograph is a collection of the author's recently published scientific papers about computer arithmetic in residue number system and scalable architectures. It can be used as a tutorial for graduate students in the field of VLSI architectures for cryptographic hardware. Both residue number system arithmetic and scalable architectures provide high parallelisms to improve system performance. The main topic is on modular multiplication and Montgomery algorithm.