mysterious-oyster-86659
04/09/2021, 6:39 PMaws.glue.crawler
docs. How do I configure and provision a TS Glue Crawler resource with recrawlPolicy
property set to CRAWL_NEW_FOLDERS_ONLY
?
Here's what I have so far:
export const fooGlueCrawlerJsonRaw = new aws.glue.Crawler(
"fooGlueCrawlerJsonRaw",
{
name: "fooGlueCrawlerJsonRaw",
role: glue.glueJobRole.arn,
databaseName: fooGlueDatabaseRaw.name,
classifiers: [housingRawGlueClassifier.name],
recrawlPolicy: "CRAWL_NEW_FOLDERS_ONLY",
s3Targets: [{path: `${path1}foo1.json`,},
{path: `${path2}foo2.json`},
{path: `${path3}foo3.json`},
{path: `${path4}foo4.json`},],
tags: tags(),
},
{deleteBeforeReplace: true},
);