The Database Mail Profile that is used for the SQL server agent need to be a member of DatabaseMailUserRole in the msdb database.

https://msdn.microsoft.com/en-us/library/ms186358.aspx#Security