Yes, you are right about the theory part.

In the interview, I explained both the theory and formulas in a shared whiteboard. Also, I wasn't asked to derive anything other than back propagation of linear regression.