Oliver Nocon
cead027bfb
Support yml and yaml extension of config files ( #1153 )
...
* Support yml and yaml extension of config files
* Update cmd/piper.go
Co-Authored-By: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
2020-02-06 09:08:15 +01:00
Daniel Mieg
2e742c7ed3
Fix formatting of documentation ( #1151 )
...
* Fix formatting of documentation
* Regenerate go files
2020-02-05 15:46:14 +01:00
Christopher Fenner
ee1eed4f5f
chore(pipeline): streamline travis job ( #1150 )
...
* chore(pipeline): streamline travis job
* fix stages
2020-02-05 13:23:27 +01:00
Sven Merk
59e9d897bf
feat(hadolint): enable correct handling of multiple scan results ( #1145 )
...
* Add missing parameter
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* fix code climate issues
* Update default_pipeline_environment.yml
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
* Update hadolintExecute.groovy
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
2020-02-04 16:36:09 +01:00
Stephan Aßmus
ad7256a56e
Merge pull request #1146 from SAP/extension-error-handling
...
Executing extensions in handlePipelineStepErrors
2020-02-04 14:28:09 +01:00
Stephan Aßmus
164c12b9f0
Executing extensions in handlePipelineStepErrors
...
The code of extensions was not executed within the try-catch-block of
handlePipelineStepErrors. The main benefit of this change is better
logging and re-using the 'unstable' feature also for
extended/overwritten steps.
2020-02-04 12:33:13 +01:00
Daniel Mieg
6f0bde154b
Go implementation for abapEnvironmentPullGitRepo() ( #1107 )
2020-02-04 11:43:27 +01:00
Oliver Nocon
9c1bd04752
Streamline step generation ( #1142 )
...
* Streamline step generation
* Include PR feedback, update DEVELOPMENT.md
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
Co-authored-by: Sven Merk <33895725+nevskrem@users.noreply.github.com>
2020-02-04 10:46:43 +01:00
Christopher Fenner
5e06cc4ff5
chore(pipeline): enable GH actions for PRs from forks ( #1144 )
...
* Update verify-go.yml
* Update verify-go.yml
* revert dummy change
* Update verify-go.yml
* fix code climate
* Update verify-groovy.yml
2020-02-04 10:00:02 +01:00
Christopher Fenner
a79fd95fd8
fix: correct jenkinsKubernetes parameter exposure & docs ( #721 )
...
* remove jenkinsKubernetes parameter
2020-02-04 08:02:38 +01:00
Stephan Aßmus
d1b94a8f29
Merge pull request #1143 from SAP/env-utils
...
Added EnvironmentUtils needed by DebugReport (#1126 )
2020-02-04 06:35:43 +01:00
Stephan Aßmus
1d9ecdb999
Added EnvironmentUtils needed by DebugReport
...
This should have been added along with DebugReport. For context:
EnvironmentUtils used to be a class alongside DebugReport and thus
there was no 'import' directive. Working with Jenkins DSL stuff
has numbed my ability to pay attention to the IDE indicating errors.
2020-02-03 17:07:56 +01:00
Christopher Fenner
6494638106
chore(pipeline): add Groovy unit test as GH action ( #1140 )
...
* Create verify-groovy.yml
* correct indent
* correct indent
2020-02-03 15:59:56 +01:00
Sven Merk
36423eb78d
Avoid potential collisions among steps ( #1141 )
...
* Avoid potential collisions amongst steps
* Improve code, move to JenkinsUtils
* Improve code
* Improve tests
* Fix test
* Add scope on golang side
2020-02-03 15:25:49 +01:00
Stephan Aßmus
f6da8c6f3c
Merge pull request #1126 from SAP/debug-report
...
Add DebugReport facility
2020-02-03 14:05:53 +01:00
Stephan Aßmus
c06d4c95d6
Add pipelineStageWrapper test for global extension
2020-02-03 12:37:20 +01:00
Stephan Aßmus
0c2fb3181a
Test DebugReport usage in piperStageWrapper
2020-02-03 12:37:20 +01:00
Stephan Aßmus
3010cb0c10
Test DebugReport usage in handlePipelineStepErrors
2020-02-03 12:37:20 +01:00
Stephan Aßmus
fbcae5be53
Exchange wrong TODO with NOTE about what actually happens
2020-02-03 12:37:20 +01:00
Stephan Aßmus
942e6dd18a
Don't check for isResilient, use failOnError
2020-02-03 12:37:20 +01:00
Stephan Aßmus
4420c34e4f
Integrate DebugReport with handlePipelineStepErrors
2020-02-03 12:37:20 +01:00
Stephan Aßmus
8e953715a0
DebugReport: Log failure to retrieve Jenkins plugins
2020-02-03 12:37:20 +01:00
Stephan Aßmus
6c9e23db40
Feed DebugReport from piperStageWrapper
...
Information about overwritten/extended stages is stored in DebugReport (as done before in SDK Pipeline's runAsStage).
2020-02-03 12:37:20 +01:00
Stephan Aßmus
6e551dfc79
Add DebugReport facility
...
The DebugReport is a global instance where steps can store information relevant for diagnosing failed pipelines. In the SDK Pipeline, this is used to generate a debug report within the postActionArchiveDebugLog step. The reason for adding this to Piper is to feed information about extended or overwritten stages in piperStageWrapper into the DebugReport, as was done before in the SDK Pipeline's equivalent runAsStage step.
2020-02-03 12:37:20 +01:00
Florian Wilhelm
941eba0472
Fix Could not find matching constructor for: hudson.FilePath ( #1134 )
...
The constructor for hudson.FilePath does not take a file, but rather a
string containing the path to the file.
2020-02-03 12:28:16 +01:00
Christopher Fenner
768c6aa399
fix: generator for custom steps ( #1139 )
2020-01-31 15:39:45 +01:00
Christopher Fenner
d2b8b373b9
chore(pipeline): add GO unit test as GH action ( #1138 )
...
* add GO unit test job
* Update .github/workflows/verify-go.yml
2020-01-31 15:18:34 +01:00
Oliver Nocon
b542d15998
Enhance telemetry reporting ( #1133 )
...
* Enhance telemetry reporting
* Use central telemetry data object
* Add duration
Co-Authored-By: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
2020-01-31 14:06:08 +01:00
Stephan Aßmus
1f2ae0fcef
Merge pull request #1122 from SAP/stashing-steps
...
Move stage stashing functionality into Utils
2020-01-29 21:57:09 +01:00
Stephan Aßmus
c20dba2744
Merge branch 'master' into stashing-steps
2020-01-29 20:57:28 +01:00
Christopher Fenner
2da06bfa91
chore(build): use GH actions to verify if go codebase is up to date ( #1125 )
...
* add action to keep codebase up to date
* add go mod tidy command
* use official go action
* correct go fmt command
* fix code climate findings
* remove dummy changes
* separate checks
2020-01-29 18:09:51 +01:00
Stephan Aßmus
a7543fd19b
Merge branch 'master' into stashing-steps
2020-01-29 16:19:17 +01:00
Oliver Nocon
152c4dc9d2
Pass container image via CPE ( #1113 )
...
* Pass container image via CPE
* Update generated step
* update map name to better represent content
2020-01-29 16:03:18 +01:00
Stephan Aßmus
479123a800
Remove try-blocks in new stashing methods
2020-01-29 15:13:21 +01:00
Stephan Aßmus
948d07ce7d
Merge branch 'master' into stashing-steps
2020-01-29 14:38:53 +01:00
Marcus Holl
40f0a17b45
re-use execRunner for envExecRunner ( #1117 )
...
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2020-01-29 14:22:43 +01:00
Marcus Holl
cea3d0b4e3
Add test handling exception in dockerExecuteOnK8S in case exception is raised. ( #1081 )
...
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2020-01-29 14:15:12 +01:00
Stephan Aßmus
282934d70a
Merge branch 'master' into stashing-steps
2020-01-29 13:51:48 +01:00
Sven Merk
4b1ca5697d
Add missing test ( #1116 )
...
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2020-01-29 13:46:28 +01:00
Stephan Aßmus
40121f3fa0
Merge branch 'master' into stashing-steps
2020-01-29 13:36:29 +01:00
Christopher Fenner
aa3fb8adb4
feat(go): add telemetry reporting ( #1100 )
...
* Add telemetry support
* First round telemetry
* Add telemetry flag
* fix: move files to avoid import cycles
* add noTelemetry as global config option
* Respect telemetry configuration for reporting
* add site id, swa endpoint
* correct logger initialization
* add http logic
* rename init method
* rename consts & types
* convert struct to payload
* convert data to payload string
* move activation flag out of data structure
* extract types to own file
* build query using net/url
* correct field mapping
* extract notify coding to own file
* cleanup parameter mapping
* preare base data
* fix codeclimate issue
* correct test case
* fill values from env
* test all fields
* untrack notify.go
* ignore empty custom values
* cleanup data.go
* add test cases
* cleanup
* add usage reporting to karma step
* add usage reporting to step generator
* externalise siteID
* correct custom field names
* test env handling
* simplify method signature
* revert parameter negation
* correct import
* adjust golden file
* inclease log level
* ignore test case
* Revert "inclease log level"
This reverts commit 70cae0e029
2020-01-29 13:17:54 +01:00
Stephan Aßmus
53833eaae9
Move stage stashing functionality into Utils
...
* No functional change intended
* Steps in the SDK pipeline may use Utils for stashing,
as separate stashFiles and unstashFiles steps are eliminated.
2020-01-29 12:30:07 +01:00
Christopher Fenner
92441577d8
fix(NPM): change NodeJS image to LTS ( #1069 )
...
* change NodeJS image to current LTS
* Update default_pipeline_environment.yml
* Update SonarExecuteScanTest.groovy
* use node:lts-stretch image
2020-01-29 11:17:56 +01:00
Marcus Holl
7b95c04752
[refactor] CPE read/write from/to disk: remote repetitive coding ( #1110 )
...
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2020-01-28 13:22:37 +01:00
Sven Merk
cbe368fe36
Checkmarx as golang ( #1075 )
...
* Added base functionality for checkmarx interaction
* Extend http client with file upload capabilities
* Latest changes
* Add debug logging
* Introduce Uploader interface
* Add tests for checkmarx client
* Hook new checkmarx command
* Improve coverage
* Add tests
* Improved test coverage and fixed code
* Add influx reporting
* Add alternation capabilities
* Add groovy step
* Try fix cmd
* Enhancements
* Fix report generation
* Final performance improvements
* Fix code
* Structure code, cleanup
* Improvements
* Fix codeclimate issue
* Update groovy
* Adapt latest changes to http
* Fix test
* Fix http tests
* Fix test
* Fix test
* Fix test 2
* Fix code
* Fix code 2
* Fix code
* Code
* Fix
* Fix
* Add report and link handling
* Fix returns, add groovy test
* Review comments
* Added doc template
* Docs update
* Remove SAP internals
* Better status display
* Add name to link
* Fix test
* Fix
* Fix verbose handling
* Fix verbose handling 2
* Fix verbose handling 3
* Fix
* Tiny improvements
* Regenerate
* Fix test
* Fix test code
* Fix verbosity issue
* Fix test
* Fix test
* Fix test
2020-01-27 23:40:53 +01:00
Oliver Nocon
73ab887f25
Add kubernetesDeploy step ( #1073 )
...
* Add kubernetesDeploy step
Co-authored-by: Sven Merk <33895725+nevskrem@users.noreply.github.com>
2020-01-24 14:30:27 +01:00
Stephan Aßmus
7ead134d68
Introduce support for different"interceptor APIs" in extensions
2020-01-24 14:06:09 +01:00
Stephan Aßmus
878e09abbb
Adopt work-around for Jenkins on Kubernetes regarding deleteDir()...
...
... from SDK pipeline.
2020-01-24 11:29:35 +01:00
Stephan Aßmus
ddd10683c4
Added support for old "interceptor API" for extensions
...
This is part of the effort to get rid of the "runAsStage" step in the SDK pipeline, and use piperStageWrapper directly. The SDK pipeline currently needs to support for loading "old" extensions where the call() method had different parameters. The support for the exact API can and should be removed, however, having a mechanism for supporting old extension APIs seems beneficial in general.
Another crucial change is the deleteDir() call before unstashing at the beginning of the stage. Without this, the SDK pipeline fails to unstash, since apparently the workspace may not always be clean at that point.
2020-01-24 11:29:35 +01:00
Stephan Aßmus
f59d9f9d49
Added Unit-Test for extensions using an older API
2020-01-24 11:29:35 +01:00
