Per the documentation, it appears i can make use of the $User variable for the currently authenticated user while using AzureAD.
The authentication works perfectly fine, but $User is null in all endpoints. I am not supplying any claims information, I just want to be able to use $user.