04/05/2021, 8:54 PM
So I've been exploring using the automation API with some automated integration tests with dynamodb-local (localstack in future). - For isolation reasons each test uses it's own stack and thus infra resources. This facilitates running tests in parallel. - Using a single shared LocalWorkspace across tests. - Using local backend (setting backend url to
) - A stack with a single resource, a simple dynamodb table. - So everything is local and should not be making any external network calls. Non-scientific performance numbers: -
~ 1.4s -
~ 0.7s -
~ 6.5s Overall each test has ~9s overhead. Not bad to be honest but it'll add up as the test count increases. If I use the AWSSDK directly to deploy a table it is significantly faster (<1s). However with this approach I'd have to maintain some sort of table definition abstraction that would be used both in the test fixtures and pulumi component to achieve alignment / re-use. This would add a complexity cost. Thought I'd mention the above in the hope that there could be some performance improvements made to the Automation API. In any case, it's really nice stuff :)
๐Ÿบ 1
๐Ÿ™Œ๐Ÿฝ 1
๐Ÿ™Œ 4
โ˜๏ธ 1


04/05/2021, 8:56 PM
That's awesome. I've never used any of the local fakes for testing, it's on my backlog. Do you have anything sharable yet? The localstack implementation in particular is very interesting.


04/05/2021, 9:06 PM
Hope to have something sharable in the coming week. Component I'm working on is dynamodb only so just using dynamodb-local at the moment. Will be getting to localstack shortly after.
๐Ÿ‘ 2


04/05/2021, 9:23 PM
This is awesome, thanks for the feedback. Just confirming, youโ€™re using the dotnet SDK here? EDIT: Yes you are! Youโ€™re the one whose questions I answered in the issue yesterday ๐Ÿ™‚
๐Ÿ˜‰ 1


04/05/2021, 9:25 PM
nice one @fresh-summer-65887! I hope there's a blog post coming here? ๐Ÿ™‚
๐Ÿ‘ 1


04/05/2021, 9:53 PM
I'm also very curious about integration testing targetting localstack, as that was something we were going to explore before long