This verse is recited by the shaliach tzibbur when he receives the Torah to return it to the ark. The Sforno explains that G-d is unique because He alone has no end. He is exalted because He remembers all of His creations.