Do these stacks have a lot of resources? We've seen some performance issues related to total resource count per stack, and while both backends have this issue it does vary on latency/bandwidth to the backend so might be you had a better connection to the SASS then you do your S3 bucket.