I'm sorry, but you must be doing something wrong. Docker Desktop on Mac M1 is not slow at all and I'm working on large projects with many changing files. Maybe check your settings.