The official title is Board of Regents of the University System of Georgia. Capitalize in formal use. The office, in Atlanta, is the University System office.

On Second Reference

“board of regents” or simply “regents.”

Capitalization
Organizations
People
Titles and Names