You are correct that there is not a huge amount of battery (...

You are correct that there is not a huge amount of battery ( lithium ) recycling going on today. But, just like any other emerging industry, these solutions take time.

I think you would agree that widespread ev use is only at the tip of the iceberg of what it will be in 20-50 years. So, it's great that science and engineering is working on the problem today.
In the scheme of things the batteries that are chucked away today are small beer compared to the future. While not ideal, I don't expect this to be an issue in 5 years.

https://www.sustainability.vic.gov.au/About-Us/Latest-News/2018/04/26/04/57/Australias-first-lithium-battery-recycling-plant-opens

https://www.power-technology.com/features/lithium-battery-recycling-in-australia/

https://www.csiro.au/en/News/News-releases/2018/Australia-to-lead-lithium-ion-battery-recycling-charge

https://eit.europa.eu/news-events/news/recycling-lithium-ion-batteries-relieve-eit-rawmaterials

https://lithionrecycling.com/lithium-ion-battery-recycling-plant/

https://www.pv-magazine.com/2019/03/25/innovation-boosts-lithium-ion-battery-recycling-rate-to-over-80/

https://resource.co/article/ion-prize-how-recycle-lithium-batteries-12630