For Android phone, use BubbleUPnP ( https://play.google.com/store/apps/details?id=com.bubblesoft.android.bubbleupnp&hl=en_US ) to turn your phone into DLNA server. Make sure to configure media allowed for remote browsing in its settings first. Then enable Kodi's DLNA client function on Android TV by turning on "Allow control of Kodi via UPnP" ( https://kodi.wiki/view/Settings/Services/UPnP_DLNA ). You can also use other DLNA clients ( http://homemediaportal.com/best-android-dlna-player-client-apps/ ).

You can also use X-plore's "WiFi file sharing" function to share files on your phone with Android TV. Basically install X-plore on both your phone and Android TV, activate "WiFi server" on your phone, and then connect to your phone with "Add device" on Android TV. But this function is only available in paid version of X-plore. It's also possible to create this setup with the free MiXplorer, albeit with slighly different steps.

Local cast is great for casting media files to android TV

https://play.google.com/store/apps/details?id=de.stefanpledl.localcast

Edit: Just noticed you asked for non casting, using an ftp server is how I would usually do this, below is the one I use

https://play.google.com/store/apps/details?id=com.medhaapps.wififtpserver