And if we enable Web Server Logging:
We can access the IIS logs via FTP:
We can also access a Kudu page on the Git repository location (I found this by accident, since I don't think the link is on the Azure UI)
Which allows us to download all the logs (via the Dump link)
And get a live stream of the lastest logs (which looks pretty powerful and should allow for realtime application monitoring)