Sven Merk
dfe9cb6149
Add capability for yarn scanning ( #2716 )
...
* Add capability for yarn scanning
* Update whitesource.yaml
* Update configHelper.go
* Add newly generated impl
2021-03-24 16:33:32 +01:00
Roland Stengel
101e8ec784
TransportRequest: add UploadSOLMAN groovy step ( #2688 )
...
* TransportRequest: add UploadSOLMAN groovy step
- groovy to go
- use docker image in go
- map credentials in go
- generated yaml
2021-03-22 11:53:37 +01:00
Oliver Nocon
2b11c09a8c
feat(githubCreateIssue): allow content via file ( #2557 )
2021-03-19 13:04:30 +01:00
Oliver Nocon
9b6a8cb3b6
feat(whitesource): create json report ( #2699 )
...
* feat(withesource): create json report
* proper constant value
* update generation
2021-03-19 11:10:08 +01:00
Oliver Nocon
2048c00d2c
whitesource: use only Unified Agent for scanning ( #2707 )
...
don't use native build-tool specific plugins any longer.
They have been deprecated by WhiteSource mid 2019 already.
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
2021-03-19 09:58:24 +01:00
Roland Stengel
d79295a30f
add common pipeline environment persistency to solman upload ( #2659 )
...
* add common pipeline environment
- cpe/custom/ChangeDocumentId
- cpe/custom/TransportRequestId
- rename tests: prefix TestTrSolman allows to easily process
subset.
2021-03-19 08:58:20 +01:00
Sven Merk
d52a1a3619
Influx step execution reporting ( #2700 )
...
* Influx step execution reporting
* influx for newmanExecute added
Co-authored-by: lndrschlz <leander.schulz01@sap.com>
2021-03-18 10:32:03 +01:00
lndrschlz
dea96a3ba0
feat(newmanExecute): golang implmementation for newmanExecute ( #2513 )
...
* Automates first parts of newmanExecute.groovy
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Adds newman installation
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Removes warning
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* makes tests robust for later shell calls
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Adds version logging
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Adds tests for version logging
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Adds newman shell execution
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Prepare cloud foundry apps with secrets handling
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Adds further process to CF Utils
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Fixes unit test
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Adds error category
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Add fix to execute step locally
Currently only tested on windows machine locally in powershell.
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* Adapt unit test to fix of runCommand
Signed-off-by: Fabian Reh <fabian.reh@sap.com>
* refactored golang step to newmanExecute
* wip
* added test config
* refactored newmanExecute groovy wrapper step
* exclude newmanExecute from common step test
* cleaups
* add credential support
* fix groovy credential providing
* add import
* add stageName
* define script
* remove unused vars
* add import
* fix iterator ref
* golang secret handling and cleanups
* wip
* wip
* wip
* update go step
* implement cf credential proposal
* testRepository functionality implemented
* register secrets to logger
* add missing dependecies
* test xsuaa credential handling
* wip
* wip
* cleanups
* add import
* remove mandatory params
* add container definition
* test runCommand
* test runCommand
* fix npm path
* fix npm path
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* added newmanEnvironment to templating
* wip
* use env and globals params in runCommand when no templating
* fix condition
* wip
* reverted config edit
* updated documentation
* install with shell
* wip
* wip
* fix tests
* refactor tests
* wip
* remove old test
* wip
* escape go tmpl
* escape go tmpl
* fix defaults
* add doc comment
* remove test case
* refactored newman commands
* add cli reporter
* refactor options
* mock os getenv and fix all tests
* refactoring and doc update
* go generate
* small refactor
* spelling
* fix newman doc
* remove MaskPasswords wrapper; fix stash bug;
* docu fix
Co-authored-by: Fabian Reh <fabian.reh@sap.com>
2021-03-17 08:08:33 +01:00
Christopher Fenner
4cabbca26e
docs(protecode): add description how to use fetch url for docker image ( #2665 )
...
* Update protecode.yaml
* update generated files
* update files
* fix typo
2021-03-12 09:58:21 +01:00
Christopher Fenner
f999925788
fix(influx): correct data type of influx measurements ( #2171 )
...
* update data type of influx measurements
* Update checkmarx.yaml
* pick changes from #1885 for testing
* update generated code
* update to new datatype
* adjust to type changes
* change back to string type
* Update fortifyExecuteScan.go
* add typo to be backward compatible
* change type to int for files_scanned and lines_of_code_scanned
* add typo
* add measurements to whitesource
* update generated sources
* adjust test cases
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2021-03-10 16:00:53 +01:00
Louis Lecaroz
67ef1f21c7
nexusUpload parameters reading from commonPipelineEnvironment ( #2658 )
...
* nexusUpload parameters reading from commonPipelineEnvironment
* Cleaning code formatting
* Fixing go fmt issues
* Fixing go generate files
* Fixing codeclimate issue
* Fixing with PR feedback
* Fixing unit test failure due to changed error message
* Fixing codeclimate on punctuatin in error message
* Fixing typo error in error message
Co-authored-by: LECAROZ <louis.lecaroz@sap.com>
2021-03-10 15:06:42 +01:00
Sven Merk
afdc726a01
Fortify cmd parameters for scan ( #2680 )
...
* Add sca cmd extensibility
* Fix formatting
2021-03-09 13:16:21 +01:00
Oliver Nocon
c077cdd733
fix(whitesourceExecuteScan) get full list of projects ( #2672 )
...
* fix(whitesourceExecuteScan) get full list of projects
* update doc
2021-03-08 17:01:18 +01:00
Siarhei Pazdniakou
cc66b7cabd
Added createBOM parameter to the npmExecuteScripts step ( #2642 )
...
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2021-03-04 10:16:59 +01:00
tiloKo
218a743fb1
abapEnvironmentAssemblePackages Unit Tests & Error Handling ( #2654 )
...
* Unit Test Assemble Package
* Remove obsolete lines
dust wiping
* climate change
* climate change #2
* climate change #3
* climate change #4
* climate change #5
Co-authored-by: Daniel Mieg <56156797+DanielMieg@users.noreply.github.com>
2021-03-01 13:51:44 +01:00
lndrschlz
4ca9186f39
fix(uiveri5ExecuteTests): add 'tests' stash to step yaml ( #2641 )
...
* add tests stash to uiveri5 step
* add stash to uiveri5
* extend step generator with input resources
* add step generator test
2021-03-01 13:03:42 +01:00
Sven Merk
d2eb2877e0
fortifyExecuteScan: Functional enhancements ( #2647 )
...
* Improvements
* Formatting
* Fix test
* Update resources/metadata/fortify.yaml
Enhance description
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
* Unify version handling with ws step
* Part 2
* go fmt
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2021-02-26 13:43:03 +01:00
Nikolai Demidenko
eb87a2c976
Add createBOM parameter to the mavenBuild step ( #2639 )
...
* Add createBOM parameter to the mavenBuild step
* update generated files
* Update resources/metadata/mavenBuild.yaml
* Update resources/metadata/mavenBuild.yaml
* update generated mavenBuild
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2021-02-25 15:01:19 +01:00
Christopher Fenner
cb3fa7c293
feat(sonar): add output of measurements ( #2218 )
...
* add sonarqube measurements
* fetch measurements from API
* add api for fetching issue counts
* add debug outputs
* add further severities
* log number of issues
* report failure
* expose method to send request
* Fixed what was broken.
* add debug output
* wip
* correct opaque property
* push client handling to apiClient.go
* use correct API URL
* correct log outputs
* remove logging
* remove option validation
* extend search options
* restructure
* rename api client file
* simplify client usage
* simplify issue client
* write sonar values to influx
* extract issue service
* reorder imports
* add sonar integration test
* allow unknown fields
* add test case
* add test case
* remove
* fix
* Update http.go
* Apply suggestions from code review
* Update cmd/sonarExecuteScan.go
* rework test cases
* use explicit returns
* add task service
* add waitfortask
* fix typo
* remove fixme
* expose poll interval
* rename test cases
* add test cases
* use newAPIClient method
* use waitForTask
* rename services
* finalize code
* handle error
* move defer
* move types
* add test case
* use http.status...
* add test case
* expose api endpoint names
* extract api client
* adjust test cases
* Update integration-tests-pr.yaml
* Update integration-tests.yaml
* improve require message
* Update integration-tests-pr.yaml
* Update integration-tests-pr.yaml
2021-02-24 15:44:23 +01:00
Marcus Holl
60feb3409f
solman upload go the step ( #2522 )
...
Upload content into a transport request via SOLMAN
Co-authored-by: Oliver Feldmann <oliver.feldmann@sap.com>
2021-02-19 13:07:18 +01:00
Mayur Belur Mohan
06afce3005
IntegrationArtifactUpload Command ( #2610 )
...
* IntegrationArtifactUpload Command
2021-02-17 09:59:56 +01:00
Daniel Mieg
484d9c2ec1
Increase cf-cli version for abap steps ( #2613 )
2021-02-16 18:03:29 +01:00
Marcus Holl
f74ebe0aa8
Fix alias for transport request upload cts ( #2614 )
...
* no duplicate alias key
* regenerate after metadata update
2021-02-16 15:31:15 +01:00
Daniel Mieg
cb3ad328f5
test ( #2611 )
2021-02-15 11:06:07 +01:00
Marcus Holl
e90548d41d
Introduce checkChangeInDevelopment ( #2504 )
...
* Introduce checkChangeInDevelopment
2021-02-12 08:50:38 +01:00
Daniel Mieg
d610c96b63
Increase ppiper cf-cli version to v7 ( #2590 )
...
* Increase ppiper cf-cli version to v7
* Change v7 to 7
2021-02-11 12:54:11 +01:00
Marcus Holl
c53d5241cb
use v6 version of ppiper/cf-cli consistently for all go steps ( #2569 )
2021-02-11 09:31:25 +01:00
Mayur Belur Mohan
f030bc9861
IntegrationArtifactDownload Command ( #2587 )
...
* IntegrationArtifactDownload Command
Co-authored-by: Marcus Holl <marcus.holl@sap.com>
2021-02-10 17:08:23 +01:00
Oliver Nocon
d47a17c8fc
feat(whitesource): consolidated reporting and versioning alignment ( #2571 )
...
* update reporting and add todo comments
* enhance reporting, allow directory creation for reports
* properly pass reports
* update templating and increase verbosity of errors
* add todo
* add detail table
* update sorting
* add test and improve error message
* fix error message in test
* extend tests
* enhance tests
* enhance versioning behavior accoring to #1846
* create markdown overview report
* small fix
* fix small issue
* make sure that report directory exists
* align reporting directory with default directory from UA
* add missing comments
* add policy check incl. tests
* enhance logging and tests
* update versioning to allow custom version usage properly
* fix report paths and golang image
* update styling of md
* update test
2021-02-10 16:18:00 +01:00
Christian Luttenberger
e9a93ed384
Adding new step for abap Enviroment Assembly Confirm ( #2586 )
...
* Adding new abap Assembly Confirm
* Update abapEnvironmentAssembleConfirm.go
* Add generated objects
Co-authored-by: tiloKo <70266685+tiloKo@users.noreply.github.com>
2021-02-10 11:33:10 +01:00
lndrschlz
5f053d1c32
fix(uiVeri5): update documentation for more explicit deprecation notes ( #2568 )
...
* use strings.Join() for string slice
* add explanaiton to script passing in extensions
* add note about groovy templating
* remove single quotes from seleniumAddress default
* updated documentation
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2021-02-05 16:04:52 +01:00
Mayur Belur Mohan
538256774a
IntegrationArtifactGetServiceEndpoint Command ( #2582 )
...
* GetIntegrationArtifactServiceEndpoint Command
Co-authored-by: Marcus Holl <marcus.holl@sap.com>
2021-02-05 10:35:55 +01:00
Mayur Belur Mohan
426c106765
IntegrationArtifactGetMplStatus Command ( #2558 )
...
* IntegrationArtifactGetMplStatus Command
Co-authored-by: Marcus Holl <marcus.holl@sap.com>
2021-02-04 10:50:15 +01:00
Marcus Holl
3ebc21b5cb
provide alias for transport request upload cts ( #2551 )
...
* provide alias for transportRequestUploadCTS
* re-generate after metadata update
2021-02-04 10:09:20 +01:00
Oliver Nocon
a104b2a06d
feat(whitesourceExecuteScan): UA for all build tools, e.g. maven & npm ( #2501 )
...
* feat(whitesource): add config helper
this helps to ease & enforce config settings
* fix accidential change of class
* add todos wrt java download
* use existing scanOptions, add option to download jre
* update generation
* fix generation
* allow running UA via go library
* correct image, improve logging
* add removal of downloaded JVM
* update java creation and deletion
* refactor and add log output
* remove obsolete ToDo
* increase test coverage
* increase test coverage
* adding aliases and tests
* make go modules as default
* maven: update behavior of projectNaming
* add Docker capabilities
* correct parameter name
* retrieve Docker coordinates
* docker coordinates only to provide artifact
* add ToDos
* add mta capability
* add aliases, mvn arguments for settings
* clean up groovy part
* update defaults
* add container for pip
* add defaults, add maven specifics, ...
* properly download settings
* maven: check existence of excluded files
* fix reporting
* Update CommonStepsTest.groovy
* update comment
* fix CodeClimate finding
* add tests for pip & fix minor issues
* fix order of pip build descriptors
* update pip container options
* fix pip virtualEnv parameter
* update report permissions
* fix test
* update container options
* add use fileUtils to load properties file
* update parameter description
* adding Docker scanning defaults
* clean up configHelper
* consider also npm tool cache
* add todos
2021-02-03 14:52:48 +01:00
Oliver Nocon
b7754437b3
new step to create a scan summary report ( #2559 )
...
* new step to create a scan summary report
* add flag to collect only failed reports
* add stepName to report
2021-02-02 14:36:40 +01:00
Daniel Mieg
05b51d3e82
use compatible cf-cli ( #2556 )
2021-01-29 12:11:25 +01:00
Giridhar Shenoy
d3f31acc9f
feat(detect): Scanonchanges : Parameter to reduce scan running time and load on BlackDuck server ( #2538 )
...
* changes to detectExec before master merge
* changes for detectExecuteScan
* self generated code added
* fix syntax errors and update docu
* added unit tests for fail and Group
* fix failOn bug
* add Groups as string array
* add Groups as string array
* tests and validation for groups, failOn
* Updated docs and added more tests
* documentation md files should not be changed
* Handle merge conflicts from PR 1845
* fix merge errors
* remove duplicate groups, merge error
* adding buildCode and buildTool as params
* switching build options
* building maven modules
* parameter correction
* parameter correction
* gnerate with new build parameter
* adding comments
* removing piper lib master and modifying goUtils to download 1.5.7 release
* first cleaning then installing
* multi module maven built
* multi module maven built removing unwanted code
* multi module maven built moving inside switch
* testing
* modifying the default use case to also call maven build
* modifying the default use case to also call maven build wih --
* corrected maven build command
* corrected maven build command with %v
* skipping test runs
* testing for MTA project with single pom
* adding absolute path to m2 path
* clean up
* adding switch for mta and maven and removing env from containers
* commiting changes for new detect step
* correting log message
* code clean up
* unit tests changes to detectExecute
* basic tests for new change
* restoring piperGoUtils to download correct piper binary
* code clean up
* code clean up
* clean detect code
* add the the scanOnChanges parameter to detect
* fix codeclimate issue
* updated detect.yaml
Co-authored-by: Keshav <anil.keshav@sap.com>
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
2021-01-29 10:17:02 +01:00
Mayur Belur Mohan
0ed5cce53a
IntegrationArtifactUpdateConfiguration Command ( #2542 )
...
* IntegrationArtifactUpdateConfiguration Command
Co-authored-by: Marcus Holl <marcus.holl@sap.com>
2021-01-29 09:46:47 +01:00
lndrschlz
e60bdb94a6
feat(uiVeri5): golang implmementation for uiVeri5ExecuteTests ( #2394 )
...
* added uiVeri5ExecuteTests step files
* added confPath an regenerated step
* added test for uiVeri5ExecuteTests
* config modified
* added groovy wrapper
* ambiguous method fixed
* uiveri5 wrapper
* removed install command
* fixed defaults
* added testOptions as confPath arg
* test set env
* test npm install local
* changed env settings
* tests regenerated
* go generate
* fix code climate
* overwrite groovy step
* remove groovy wrapper go
* unstash piper bin
* test older node version
* test piperExecuteBin
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* refactored params
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* wip
* set testServerUrl as os env for uiveri5
* Update config.yml
* fix naming of testServerUrl param
* wip
* refactored setEnv and fixed tests
* wip
* step param for NPM_CONFIG_PREFIX
* fix runCommand
* refactored step param, regenerate, docu, fix tests
* fix groovy wrapper test
* cleanup
* add to CommonStepsTest field whitelist
* fixed default pipeline environment vars
* fix []string default
* fix metadata.go bug
* added test for docu metadata gen
* fix metadata_test.go in doc gen
* Update metadata_generated.go
* Update metadata_generated.go
* remove npm config prefix param; doc fix
* remove tab
* changed npm config prefix
* removed groovy wrapper test
* removed groovy step defaults
* modify path variable
* modified npm config prefix
* fix error wrapper and tests
* doc update
* add testRepository support
* wip
* fix testRepository param
* wip
* add utils
* init stash content
* wip
* wip
* wip
* add comment for deprecated parameters
* fixed commonStepTest
* fixed commonStepTest
* added error category for testOptions failure
* Update vars/uiVeri5ExecuteTests.groovy
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
* Update vars/uiVeri5ExecuteTests.groovy
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
* fix condition
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
2021-01-28 11:31:24 +01:00
Kevin Stiehl
9ad0dec224
add access_token alias to all gh secrets ( #2543 )
2021-01-27 12:58:47 +01:00
Mayur Belur Mohan
fe72b295d6
IntegrationArtifactDeploy Command ( #2526 )
...
* UpdateIntegrationArtifactConfiguration Command
* Fixes for codeclimate Check
* CommonStepsTest changes
* CodeReview Changes
* Git Patch
* Git Patch undo
* Code Review Comments
* code review fixes
* improve the error handling
* codeclimate fixes
* remove json parsing
* Error handling changes
* TestCase coverage fixes
* Refactoring Commands
* IntegrationArtifactDeploy Command
* Regenerate metadata_generated
* codereview fixes
* Code Review Fixes
* Code Review Fixes
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
Co-authored-by: Oliver Feldmann <oliver.feldmann@sap.com>
2021-01-22 15:55:50 +01:00
Giridhar Shenoy
205bbc1bed
fix(detect): scan paths to better handle signature scan and dependency scan paths ( #2508 )
...
* changes to detectExec before master merge
* changes for detectExecuteScan
* self generated code added
* fix syntax errors and update docu
* added unit tests for fail and Group
* fix failOn bug
* add Groups as string array
* add Groups as string array
* tests and validation for groups, failOn
* Updated docs and added more tests
* documentation md files should not be changed
* Handle merge conflicts from PR 1845
* fix merge errors
* remove duplicate groups, merge error
* adding buildCode and buildTool as params
* switching build options
* building maven modules
* parameter correction
* parameter correction
* gnerate with new build parameter
* adding comments
* removing piper lib master and modifying goUtils to download 1.5.7 release
* first cleaning then installing
* multi module maven built
* multi module maven built removing unwanted code
* multi module maven built moving inside switch
* testing
* modifying the default use case to also call maven build
* modifying the default use case to also call maven build wih --
* corrected maven build command
* corrected maven build command with %v
* skipping test runs
* testing for MTA project with single pom
* adding absolute path to m2 path
* clean up
* adding switch for mta and maven and removing env from containers
* commiting changes for new detect step
* correting log message
* code clean up
* unit tests changes to detectExecute
* basic tests for new change
* restoring piperGoUtils to download correct piper binary
* code clean up
* code clean up
* revert to clean version
* add unmap parameter to detect
* Added Additional parameters for BlackDuck scan
* Added detect tools paramater
* fix detect.yaml to accept correct data type
* fix codeclimate issue in detect.yaml
Co-authored-by: Keshav <anil.keshav@sap.com>
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
2021-01-21 14:57:00 +01:00
Marcus Holl
c8c1315d0c
transport request upload cts / the step ( #2416 )
...
fiori cts upload piper-go step
2021-01-13 16:14:56 +01:00
mayurmohan
f4469c3427
DeployIntegrationArtifact Command ( #2474 )
...
DeployIntegrationArtifact Command
Co-authored-by: Oliver Feldmann <oliver.feldmann@sap.com>
Co-authored-by: Marcus Holl <marcus.holl@sap.com>
2021-01-12 12:17:42 +01:00
Marcus Holl
65d22eb42a
Mta extension credentials handling ( #2430 )
...
Mta extension credentials handling
Co-authored-by: Stephan Aßmus <stephan.assmus@sap.com>
2021-01-12 09:39:04 +01:00
Oliver Nocon
ab3362849a
feat(kubernetesDeploy): allow disabling --force
( #2495 )
...
fixes #1731
2021-01-07 16:52:16 +01:00
Oliver Nocon
59f32cf042
feature(vault) retrieve github token from Vault ( #2484 )
2020-12-22 17:57:11 +01:00
Oliver Nocon
4bd155d1ed
feature(protecodeExecuteScan) proper Vault support ( #2483 )
2020-12-22 17:43:57 +01:00
Oliver Nocon
7de42230e0
add step to create a GitHub issue ( #2481 )
...
* add step to create a GirHub issue
* add groovy library step
* Update githubcreateissue.yaml
Co-authored-by: Sven Merk <33895725+nevskrem@users.noreply.github.com>
2020-12-21 17:13:16 +01:00