Charles Grant attended Churchland High School in Portsmouth, VA, where he was a first team 4A All-Eastern Region selection in 2019. Grant was also All-Region and All-District as a junior for Churchland. He also showed off his athleticism by becoming an All-State wrestler during his time in high school. Although Grant was not a rated prospect by 247Sports, he got offered and accepted a scholarship to William & Mary.
In his true freshman season in the spring of 2021 (because of Covid-19) he saw action in all three games and took a redshirt. In his redshirt freshman season, he was a reserve offensive lineman who saw action in all 11 games and earned five starts at left tackle. In 2022, he was named All-CAA first team after starting all 13 games at left tackle and not allowing any sacks. Grant was dominant in 2023, starting all 11 games at left tackle and allowing just one sack in 334 pass blocking snaps. He was named First Team All-America honors by the AFCA and Second Team All-America selection by the Associated Press.