Code

feat(glue): Job construct#12506

Code

Merged

mergify[bot] merged 67 commits intoaws:masteraws/aws-cdk:masterfrom humanzz:glue-jobCopy head branch name to clipboardSep 8, 2021

+3,309-11

Commits

Commits on Jul 11, 2021

• feat(aws-glue): add Job construct (#12443)

  Show description for c158a05
  humanzz

  committed
  c158a05

  Copy full SHA for c158a05

• support job's event rules and rule-based metrics

  Show description for 9ea48b6
  humanzz

  committed
  9ea48b6

  Copy full SHA for 9ea48b6

• add metric helper method

  Show description for 638129c
  humanzz

  committed
  638129c

  Copy full SHA for 638129c

• add JobSpecialArgumentNames for glue special parameters

  Show description for b99dbce
  humanzz

  committed
  b99dbce

  Copy full SHA for b99dbce

• rebase to use Connection and SecurityConfiguration

  humanzz

  committed
  06b4d55

  Copy full SHA for 06b4d55

Commits on Jul 27, 2021

• address some comments

  Show description for 6bcdad8
  humanzz

  committed
  6bcdad8

  Copy full SHA for 6bcdad8

• Merge branch 'master' into glue-job

  humanzz

  committed
  e0eb941

  Copy full SHA for e0eb941

• improve docs

  humanzz

  committed
  b2d866f

  Copy full SHA for b2d866f

Commits on Jul 28, 2021

• rename JobCommandName constants and JobCommand methods

  humanzz

  committed
  29ff157

  Copy full SHA for 29ff157

Commits on Jul 29, 2021

• Merge branch 'master' into glue-job

  humanzz

  authored
  c615c8e

  Copy full SHA for c615c8e

Commits on Jul 30, 2021

• drop unnecessry toString() methods

  humanzz

  committed
  c31d7e4

  Copy full SHA for c31d7e4

• indicate PythonVersion.TWO is the default for JobCommand

  humanzz

  committed
  f05afa7

  Copy full SHA for f05afa7

• make metricRule and buildJobArn protected

  humanzz

  committed
  5a46dc5

  Copy full SHA for 5a46dc5

• address more comments

  humanzz

  committed
  f59d688

  Copy full SHA for f59d688

Commits on Aug 2, 2021

• drop jobRunId from metric()'s arguments

  humanzz

  committed
  fba208d

  Copy full SHA for fba208d

• change how event.Rules caching is done

  humanzz

  committed
  6032807

  Copy full SHA for 6032807

• Merge branch 'master' into glue-job

  humanzz

  committed
  8b74200

  Copy full SHA for 8b74200

• drop JobSpecialArgumentNames

  humanzz

  committed
  98c19df

  Copy full SHA for 98c19df

Commits on Aug 11, 2021

• introduce JobExecutable and refactor accordingly

  Show description for 933ebcd
  humanzz

  committed
  933ebcd

  Copy full SHA for 933ebcd

Commits on Aug 12, 2021

• refactor JobExecutable and add more tests

  humanzz

  committed
  6b3d31e

  Copy full SHA for 6b3d31e

• add enableProfilingMetrics to JobProps

  humanzz

  committed
  2f02798

  Copy full SHA for 2f02798

• Merge branch 'master' into glue-job

  humanzz

  committed
  52ae192

  Copy full SHA for 52ae192

• add @aws-cdk/assert-internal to package.json after merge

  humanzz

  committed
  fe08089

  Copy full SHA for fe08089

• add sparkUI optional prop to JobProps

  humanzz

  committed
  55b5ee4

  Copy full SHA for 55b5ee4

Commits on Aug 13, 2021

• add continuousLogging optional prop to JobProps

  humanzz

  committed
  3235ae7

  Copy full SHA for 3235ae7

• Merge branch 'master' into glue-job

  humanzz

  authored
  ee74a8a

  Copy full SHA for ee74a8a

Commits on Aug 20, 2021

• Merge branch 'master' into glue-job

  humanzz

  authored
  1367813

  Copy full SHA for 1367813

Commits on Aug 24, 2021

• Merge branch 'master' into glue-job

  humanzz

  authored
  c3c9e80

  Copy full SHA for c3c9e80

• add GlueVersion.V3_0

  Show description for 0ff9d01
  humanzz

  committed
  0ff9d01

  Copy full SHA for 0ff9d01

• Merge branch 'master' into glue-job

  humanzz

  authored
  cd27ef7

  Copy full SHA for cd27ef7

Commits on Aug 30, 2021

• Merge branch 'master' into glue-job

  humanzz

  authored
  4353f22

  Copy full SHA for 4353f22

• address smaller comments

  humanzz

  committed
  fb7e376

  Copy full SHA for fb7e376

• Merge branch 'master' into glue-job

  humanzz

  authored
  818be70

  Copy full SHA for 818be70

Commits on Aug 31, 2021

• address metric comments

  humanzz

  committed
  7072a6f

  Copy full SHA for 7072a6f

• take 1 at glue.Code (not fulyl tested)

  humanzz

  committed
  e860f4d

  Copy full SHA for e860f4d

• test glue.Code

  humanzz

  committed
  1068229

  Copy full SHA for 1068229

• Merge branch 'master' into glue-job

  humanzz

  authored
  bf896fa

  Copy full SHA for bf896fa

• address some comments

  Show description for 9f5f85a
  

  humanzz

  and

  BenChaimberg

  authored
  9f5f85a

  Copy full SHA for 9f5f85a

• fix build issues from previous round of comments

  humanzz

  committed
  0f587c9

  Copy full SHA for 0f587c9

• address comments

  Show description for 87dee59
  humanzz

  committed
  87dee59

  Copy full SHA for 87dee59

• refactor JobExecutableProps

  humanzz

  committed
  0ded0f2

  Copy full SHA for 0ded0f2

• drop @aws-cdk/aws-s3-assets from devDependencies

  humanzz

  committed
  82c1d98

  Copy full SHA for 82c1d98

• restore docs about individual files support

  humanzz

  committed
  c81e736

  Copy full SHA for c81e736

Commits on Sep 1, 2021

• apply suggestions from comments

  Show description for 8ce0fe8
  

  humanzz

  and

  BenChaimberg

  authored
  8ce0fe8

  Copy full SHA for 8ce0fe8

• add optional role to JobAttributes

  humanzz

  committed
  2ed79e1

  Copy full SHA for 2ed79e1

• drop @aws-cdk/assert-internal in favour of @aws-cdk/assertions

  humanzz

  committed
  1eb9c20

  Copy full SHA for 1eb9c20

• Merge branch 'master' into glue-job

  humanzz

  authored
  16e3265

  Copy full SHA for 16e3265

• update README

  humanzz

  committed
  7df0c1f

  Copy full SHA for 7df0c1f

• increase test coverage to 100% for the new files

  humanzz

  committed
  8884ad7

  Copy full SHA for 8884ad7

• increase test coverage to 100%

  humanzz

  committed
  13b03e8

  Copy full SHA for 13b03e8

• Merge branch 'master' into glue-job

  humanzz

  authored
  2b5f47e

  Copy full SHA for 2b5f47e

Commits on Sep 3, 2021

• tweak tests

  humanzz

  committed
  bc82d60

  Copy full SHA for bc82d60

• Merge branch 'master' into glue-job

  humanzz

  authored
  550b919

  Copy full SHA for 550b919

• tweak tests #2

  humanzz

  committed
  70b3e24

  Copy full SHA for 70b3e24

• Merge branch 'master' into glue-job

  humanzz

  authored
  a500cf2

  Copy full SHA for a500cf2

Commits on Sep 8, 2021

• remove role from IJob

  BenChaimberg

  committed
  32ba2ae

  Copy full SHA for 32ba2ae

• address some comments

  Show description for babd3ec
  humanzz

  committed
  babd3ec

  Copy full SHA for babd3ec

• Merge branch 'master' into glue-job

  humanzz

  authored
  7379066

  Copy full SHA for 7379066

• simplify job.test.ts

  humanzz

  committed
  b62a868

  Copy full SHA for b62a868

• simplify testing success/failure/timeout rules and metrics

  humanzz

  committed
  80c3f15

  Copy full SHA for 80c3f15

• better handling for extraPythonFiles with non-Python jobs

  humanzz

  committed
  094929c

  Copy full SHA for 094929c

• update integ.job.ts

  humanzz

  committed
  f01c0be

  Copy full SHA for f01c0be

• fix issues identified trying to run jobs from integ tests

  Show description for cd2d2ee
  humanzz

  committed
  cd2d2ee

  Copy full SHA for cd2d2ee

• update integ test verification documentation

  humanzz

  committed
  ea32eab

  Copy full SHA for ea32eab

• update Code.bind signature and PythonShell supported glue versions

  humanzz

  committed
  98cc575

  Copy full SHA for 98cc575

• narrow the permissions granted by S3Code

  humanzz

  committed
  0328615

  Copy full SHA for 0328615

• Merge branch 'master' into glue-job

  humanzz

  authored
  6bb18eb

  Copy full SHA for 6bb18eb