That's perfectly fine, as we're leaving it up to players whether the character retains their memories as a child, or whether they don't remember things they hadn't learned as an adult yet.

Short answer: yes, though physically (and possibly maturity-wise as well, though, again, up to you) he'll be aged down.