Did a few more tests using different SD Cards and USB Drives (both flash and external hdd) as well as different Wii http server homebrew
Outlook is looking grim. In all instances, either timeouts in browser or core dump on Wii before it's even done serving index.html, the site's icon and a small js file, let alone hitting the actual big files to serve