Oliver Nocon
91b6b0900f
Config and Defaults via http(s) ( #1302 )
...
* Config and Defaults via http(s)
Add the possibility to use http(s) urls as path to
* config.yml
* defaults
* Remove comment
* Addressing PR feedback
* Fix error handling
2020-03-31 08:47:09 +02:00
Daniel Kurzynski
a40ac015a8
Add tests for maven build ( #1276 )
2020-03-26 08:23:21 +01:00
Stephan Aßmus
804bd8e3e0
http.go: Set fine-grained timeouts ( #1257 )
...
* Replace the default maximum request deadline with a default timeout on the transport level.
* Keep the possibility to set a maximum request deadline.
2020-03-23 15:02:22 +01:00
Christopher Fenner
60b7d3a8df
refactor(sonar): implement Sonar step in GO ( #1042 )
...
* refactor(sonar): add initial metadata file for GO-based sonar step
* refactor(sonar): add initial generated files for GO-based sonar step
* refactor(sonar): add initial step file for GO-based sonar step
* refactor(sonar): add sonar cmd to executable
* refactor(sonar): cleanup metadata file
* fix(go): use capital TLS in golang names
* add download of Sonar scanner cli
* move download & unzip methods to FileUtils
* download certificate files
* use http.Downloader
* update generated code
* add slice prefix function
* update sonar step
* add test cases
* update docs
* use node:lts image
* use latest sonar-scanner
* add test cases
* use latest sonar-scanner
* fix test case
* change things
* return errors on functions
* limit changeID visibility
* use lowercase scm provider
* add test case for legacy PRs
* add test case
* update docs
* use local temp dir
* extend parameter visibility to GENERAL
* use SONAR_AUTH_TOKEN
* remove comments
* update generated code
* Apply suggestions from code review
* change to private fields
* use setter for sonar options & environment
* remove obsolete return statement
* add comment about Downloader mock
* add test case for custom options
* handle custom options
* refactor slice functions
* fix go fmt
* fix generated step code
* update docs
2020-03-23 10:38:31 +01:00
Stephan Aßmus
20b65d5a2e
Implement nexusUpload command and tests ( #1255 )
...
Artifacts to upload are assembled for MTA projects and Maven projects with optional application sub-module. Then maven deploy:deploy-file is used as backend to upload bundles of artifacts plus sub-artifacts.
Co-authored-by: Florian Wilhelm <florian.wilhelm02@sap.com>
2020-03-20 18:20:52 +01:00
Oliver Nocon
8fbeddb26c
Golang step metadata: Config aliases for steps ( #1293 )
...
* Golang step metadata: Config aliases for steps
This will ease following scenarios:
* config migration due to step name changes
* re-use of more general config, e.g. `mavenExecute` in `mavenBuild`
* fix CodeClimate finding
* Fix panic if original stage config does not exist yet
2020-03-19 17:24:35 +01:00
Stephan Aßmus
e51cfe276c
Fix copy-paste-bug for downloading settings ( #1284 )
...
* Fix copy-paste-bug for downloading settings
* Extend unit tests accordingly.
* Fix some expected versus actual mixup
2020-03-17 08:33:35 +01:00
Stephan Aßmus
e0c789a791
Add Evaluate() method to maven package ( #1268 )
...
Useful for evaluating properties from pom files using the Maven evaluate plugin.
2020-03-13 14:54:49 +01:00
Christopher Fenner
dd67be3d21
docs(command): Clarify runExecutable Env usage ( #1264 )
...
* Clarify runExecutable Env usage
* remove trailing spaces
2020-03-12 09:00:51 +01:00
Florian Wilhelm
fdb9fd3c6e
Print "Status" in error case in http client ( #1256 )
...
This might provide useful context to the user.
For example when you try to upload a SNAPSHOT jar to a maven-release
repo in nexus, this will print an error like
returned with response 400 Repository version policy: RELEASE does
not allow version: 1.0-SNAPSHOT
instead of
returned with HTTP Code 400
2020-03-09 19:25:40 +01:00
Stephan Aßmus
84f3e10e3b
Implementation of Nexus upload as Go package ( #1250 )
...
The nexus package implements uploading artifacts to a Nexus repository manager version 2 or 3 via HTTP. It also generates the MD5 and SHA1 hash files for the uploaded artifacts in the Nexus repository.
2020-03-06 23:10:10 +01:00
Marcus Holl
d3820cb1f7
Have strategy for environment variable handling only once ( #1234 )
...
Have strategy for environment variable handling only once
And provide also a test checking if the environment variables
are present in the forked process.
The strategy applied for setting the environment variables is now
different from what it was before. Before the environment was
fully replaced by the new environment variables. Now we append
our environment variables to the list of environment variables available
by default for the forked process.
Co-authored-by: Florian Geckeler <43751896+fgeckeler@users.noreply.github.com>
2020-03-03 11:15:24 +01:00
Marcus Holl
2918ee52cc
Eliminte envMockRunner ( #1233 )
...
ExecMockRunner and ShellMockRunner both needs an environment. "Extending"
here leads to "subclasses" for both cases. That is more long-winded since
it could be.
2020-03-03 10:26:34 +01:00
Marcus Holl
52b0991a36
Get rid of two dimensional env array ( #1235 )
...
I don't understand why there should be a two dimensional array.
When dealing with envs we have normally a list containing entries like
[]string{"DEBUG=true", "HOME=/home/me"}
Having two dimensional env arrays would mean to have several alternate
environment in the tests at the same time. Don't think there is a need
for that.
2020-03-03 09:26:32 +01:00
Florian Geckeler
d32e6402b0
Add GetTestModulesExcludes to pkg/maven ( #1237 )
2020-03-02 17:04:49 +01:00
Florian Geckeler
783d955654
Add mavenExecute to go lib
2020-02-28 13:09:46 +01:00
Florian Geckeler
9dc352029a
Add tag release when building go binary
2020-02-27 15:01:37 +01:00
Florian Geckeler
ef330e1eee
Move mock capabilities to pkg/mock/runner and adapt all tests
2020-02-27 12:11:22 +01:00
Marcus Holl
4835fbffab
Support nested folders when performing a http download into a file ( #1206 )
2020-02-25 16:52:12 +01:00
Marcus Holl
d1e5d9c2e7
Settings file handling (prepares mtaBuild step) ( #1176 )
...
download settings file via http or copy from the local file system into either $M2_HOME/conf/settings.xml or into ~/.m2/settings.xml
Co-authored-by: Stephan Aßmus <stephan.assmus@sap.com>
2020-02-25 14:17:00 +01:00
Florian Wilhelm
c15f6a03d2
Add functions to infer build tool ( #1210 )
2020-02-23 16:54:50 +01:00
Florian Geckeler
48fa0a7521
Add 'Code generated by' header to stepGoTemplate
2020-02-21 12:56:09 +01:00
Marcus Holl
317716cf64
switch downloader from POST to GET ( #1203 )
2020-02-20 12:46:32 +01:00
Christopher Fenner
ea45136c3d
feat(go): add download file function ( #1200 )
...
* add download file function
* add test case
* Update pkg/piperutils/FileUtils.go
* correct test case
* remove FileUtils.Download
* add Downloader
* add Downloader
* fix error
* respect header and cookies
* add test case
* rename files
* correct test case
* remove SendRequest
* correct test case
2020-02-19 19:26:47 +01:00
Oliver Nocon
a5d4c64bf4
Correct step generator ( #1190 )
2020-02-18 08:31:54 +01:00
Oliver Nocon
ec4fb1b186
Update generator ( #1188 )
...
Provide better starting point for new steps
2020-02-17 13:30:30 +01:00
redehnroV
2ebf2010b7
Protecode as GoLang ( #1119 )
...
* Protecode as go implementation
Co-authored-by: Sven Merk <33895725+nevskrem@users.noreply.github.com>
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2020-02-06 16:16:34 +01:00
Sven Merk
1417f4650a
Small cleanup ( #1159 )
2020-02-06 14:22:58 +01:00
redehnroV
a1232799e2
Docker functionality fix interface ( #1156 )
...
* Docker functionality fix interface
2020-02-06 11:14:11 +01:00
redehnroV
bb068ed76b
Provide docker functionality ( #1155 )
...
* Provide docker functionality to retrieve images
Co-authored-by: Sven Merk <33895725+nevskrem@users.noreply.github.com>
2020-02-06 10:47:45 +01:00
Daniel Mieg
6f0bde154b
Go implementation for abapEnvironmentPullGitRepo() ( #1107 )
2020-02-04 11:43:27 +01:00
Oliver Nocon
9c1bd04752
Streamline step generation ( #1142 )
...
* Streamline step generation
* Include PR feedback, update DEVELOPMENT.md
Co-authored-by: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
Co-authored-by: Sven Merk <33895725+nevskrem@users.noreply.github.com>
2020-02-04 10:46:43 +01:00
Sven Merk
36423eb78d
Avoid potential collisions among steps ( #1141 )
...
* Avoid potential collisions amongst steps
* Improve code, move to JenkinsUtils
* Improve code
* Improve tests
* Fix test
* Add scope on golang side
2020-02-03 15:25:49 +01:00
Christopher Fenner
768c6aa399
fix: generator for custom steps ( #1139 )
2020-01-31 15:39:45 +01:00
Oliver Nocon
b542d15998
Enhance telemetry reporting ( #1133 )
...
* Enhance telemetry reporting
* Use central telemetry data object
* Add duration
Co-Authored-By: Christopher Fenner <26137398+CCFenner@users.noreply.github.com>
2020-01-31 14:06:08 +01:00
Sven Merk
4b1ca5697d
Add missing test ( #1116 )
...
Co-authored-by: Oliver Nocon <33484802+OliverNocon@users.noreply.github.com>
2020-01-29 13:46:28 +01:00
Christopher Fenner
aa3fb8adb4
feat(go): add telemetry reporting ( #1100 )
...
* Add telemetry support
* First round telemetry
* Add telemetry flag
* fix: move files to avoid import cycles
* add noTelemetry as global config option
* Respect telemetry configuration for reporting
* add site id, swa endpoint
* correct logger initialization
* add http logic
* rename init method
* rename consts & types
* convert struct to payload
* convert data to payload string
* move activation flag out of data structure
* extract types to own file
* build query using net/url
* correct field mapping
* extract notify coding to own file
* cleanup parameter mapping
* preare base data
* fix codeclimate issue
* correct test case
* fill values from env
* test all fields
* untrack notify.go
* ignore empty custom values
* cleanup data.go
* add test cases
* cleanup
* add usage reporting to karma step
* add usage reporting to step generator
* externalise siteID
* correct custom field names
* test env handling
* simplify method signature
* revert parameter negation
* correct import
* adjust golden file
* inclease log level
* ignore test case
* Revert "inclease log level"
This reverts commit 70cae0e029
2020-01-29 13:17:54 +01:00
Sven Merk
cbe368fe36
Checkmarx as golang ( #1075 )
...
* Added base functionality for checkmarx interaction
* Extend http client with file upload capabilities
* Latest changes
* Add debug logging
* Introduce Uploader interface
* Add tests for checkmarx client
* Hook new checkmarx command
* Improve coverage
* Add tests
* Improved test coverage and fixed code
* Add influx reporting
* Add alternation capabilities
* Add groovy step
* Try fix cmd
* Enhancements
* Fix report generation
* Final performance improvements
* Fix code
* Structure code, cleanup
* Improvements
* Fix codeclimate issue
* Update groovy
* Adapt latest changes to http
* Fix test
* Fix http tests
* Fix test
* Fix test
* Fix test 2
* Fix code
* Fix code 2
* Fix code
* Code
* Fix
* Fix
* Add report and link handling
* Fix returns, add groovy test
* Review comments
* Added doc template
* Docs update
* Remove SAP internals
* Better status display
* Add name to link
* Fix test
* Fix
* Fix verbose handling
* Fix verbose handling 2
* Fix verbose handling 3
* Fix
* Tiny improvements
* Regenerate
* Fix test
* Fix test code
* Fix verbosity issue
* Fix test
* Fix test
* Fix test
2020-01-27 23:40:53 +01:00
Oliver Nocon
73ab887f25
Add kubernetesDeploy step ( #1073 )
...
* Add kubernetesDeploy step
Co-authored-by: Sven Merk <33895725+nevskrem@users.noreply.github.com>
2020-01-24 14:30:27 +01:00
Marcus Holl
c448a72930
Trim spaces from config value while reading CPE ( #1103 )
2020-01-23 12:02:34 +01:00
Sven Merk
71d0842c07
Update http_test.go
2020-01-22 15:26:35 +01:00
Sascha Vornheder
979ed1fabd
added check that only POST and PUT is allowed for upload
2020-01-22 15:10:40 +01:00
Sascha Vornheder
1ae1be9cb9
improved Upload to handle http.Method
2020-01-22 14:22:04 +01:00
Oliver Nocon
a46b57e6b4
Persisted pipeline environment for golang library ( #1091 )
...
* Use commonPipelineEnvironment in go binary
* Update groovy part incl. tests
* Rework structure and naming
* Support influx resources in steps
* Update tests and some cleanups
* Add correct defer handling
* Address PR feedback
* Fix test
* Update resources.go
Co-authored-by: Sven Merk <33895725+nevskrem@users.noreply.github.com>
2020-01-15 12:16:25 +01:00
Sven Merk
acadf24d27
Add upload of files
2020-01-14 10:29:50 +01:00
Oliver Nocon
4f57738888
Detect: Add golang implementation ( #1049 )
...
Add detect golang implementation
2019-12-13 09:55:45 +00:00
Marcus Holl
9cd4950437
Don't swallow error raised from file exists helper method ( #1019 )
...
* Don't swallow error raised from file exists helper method
* streamline
2019-12-11 10:13:23 +01:00
Marcus Holl
3f3db13a8a
[fix] Don't forget to return the error instead of only creating an error ( #1054 )
2019-12-11 08:17:16 +01:00
Oliver Nocon
df1c61dcd7
Add http package ( #1033 )
...
* Add http package
This serves for http calls in future piper steps implemented ingolang
2019-12-09 17:35:31 +01:00
Marcus Holl
9ee2926018
xs deploy go ( #931 )
...
introduce xs deploy
2019-12-05 14:22:38 +01:00
redehnroV
0b3bfcbcd5
fixed docu generation layout ( #1014 )
2019-11-26 15:26:37 +01:00
Oliver Nocon
69bb2c9e60
Fix issues in config resolution ( #1000 )
...
* Respect defaults from step definition everywhere
* prevent empty config to overwrite default in aliasing
Address PR feedback
2019-11-22 10:30:44 +01:00
redehnroV
9559832a19
Merge branch 'master' into sv-docuGen
2019-11-22 07:49:40 +01:00
Oliver Nocon
e671094308
Use piper binary for githubPublishRelease ( #990 )
...
* Use piper binary for githubPublishRelease
2019-11-21 16:34:22 +01:00
Sven Merk
79e002cc5e
Merge branch 'master' into sv-docuGen
2019-11-21 16:13:50 +01:00
Oliver Nocon
0f33f7a2ef
Consider custom defaults in config.yml ( #995 )
...
* Consider custom defaults in config.yml
2019-11-21 16:09:57 +01:00
Sascha Vornheder
7558884f0b
fixed wrong format
2019-11-21 11:18:56 +01:00
Sascha Vornheder
f79f5e64ad
fixed codeclimate
2019-11-21 11:15:08 +01:00
Sascha Vornheder
957bd6ad4b
fixed codeclimate
2019-11-21 11:12:30 +01:00
Sascha Vornheder
c61b3a6e6c
removed unused code
2019-11-20 15:08:03 +01:00
Sascha Vornheder
39f6fd57c6
fixed issue with context defaults during docu generation
2019-11-20 14:36:07 +01:00
Sascha Vornheder
75b62547e3
fixed test
2019-11-20 11:29:13 +01:00
Sascha Vornheder
cdaa7dfd52
added dockerOptions to the docu generation
2019-11-20 10:50:23 +01:00
Sascha Vornheder
049dc95b1d
Merge remote-tracking branch 'origin/master' into docuGen
2019-11-20 09:05:22 +01:00
Sascha Vornheder
001895a228
added dockerOptions to the docu generator
2019-11-20 09:05:10 +01:00
Sven Merk
ceac2b2b73
Merge branch 'master' into sv-VolumeBind
2019-11-19 15:20:28 +01:00
Marcus Holl
e6f9d541ca
Add stdout/stderr to the interfaces (shellRunner, execRunner) ( #948 )
...
Otherwise we cannot set the streams on the level of the interfaces.
2019-11-19 14:29:53 +01:00
Sascha Vornheder
81b949685f
added docker options to the step meta data
2019-11-19 11:52:34 +01:00
Sascha Vornheder
5ba375250d
removed complexity added volumeMount
2019-11-18 11:14:45 +01:00
Sascha Vornheder
1da0f8d064
fixed order of mount path and name
2019-11-18 09:16:12 +01:00
Sascha Vornheder
4c747c05ca
fixed findings
2019-11-18 08:15:08 +01:00
Sascha Vornheder
90449d6226
added volume bindings to the step meta data
2019-11-15 10:34:38 +01:00
Sascha Vornheder
737e0e9c5b
added more tests
2019-11-14 15:09:12 +01:00
Sascha Vornheder
e763194779
added some tests, fixed CodeClimat findings
2019-11-14 13:59:31 +01:00
Sascha Vornheder
1a609e5418
fixed some codeclimate issues
2019-11-13 14:43:53 +01:00
Sascha Vornheder
c6f5dbf5ee
refactored docuHelper and added general test
2019-11-13 14:34:04 +01:00
Sascha Vornheder
b5b4f60bc4
fixed helper test
2019-11-12 14:21:23 +01:00
Sascha Vornheder
85570095c5
Fix CodeClimate finding
2019-11-12 13:55:32 +01:00
Sascha Vornheder
d87d27325c
Added docu generation to step generator
2019-11-12 13:19:49 +01:00
Christopher Fenner
2bb400910a
assign library field in logger with respect of containing repository ( #968 )
...
* set loggers library entry to repository url
* remove comment
2019-11-11 15:31:02 +01:00
Oliver Nocon
d7efd33a5b
Fix bug in step generator ( #964 )
...
When using step generator outside of the current package the `PrepareConfig` call was not done using the prefix.
2019-11-11 09:42:47 +01:00
Oliver Nocon
dca4a079b7
Refactor structure of generator ( #960 )
2019-11-08 15:35:11 +01:00
Oliver Nocon
fedfb74910
Export step generator ( #958 )
...
* Export step generator
* Fix CodeClimate finding
2019-11-07 15:42:22 +01:00
Marcus Holl
7c5a8a73bc
Helper for fileExists ( #954 )
...
Since we need it at several places (next use case will be step xsDeploy) we should
have a helper for that.
2019-11-07 08:17:42 +01:00
Oliver Nocon
ede322c8bb
Export general configuration - part 2 ( #957 )
...
* Export general configuration - part 2
First part in #956 missed to export the elements of the struct ...
* Add comment for exported struct
* Add function for opening config files
2019-11-06 16:22:50 +01:00
Oliver Nocon
bb230d3b9b
Export general configuration ( #956 )
...
Allow for package external access to general configuration.
Use-case: re-use individual steps
2019-11-06 14:07:41 +01:00
Christopher Fenner
ae221a8ea7
Merge branch 'master' into goGithub
2019-11-06 12:28:48 +01:00
Sven Merk
6721c59a30
Merge branch 'master' into cfg-hierarchical-defaults
2019-11-06 12:13:15 +01:00
Oliver Nocon
d9a7faed0f
Merge branch 'master' into goGithub
2019-11-06 10:32:22 +01:00
OliverNocon
57540d3127
Fix bug in replacement function
2019-11-06 10:32:02 +01:00
Marcus Holl
a456282d6a
fix: getting config should also work in case there is no project config ( #951 )
2019-11-06 10:28:15 +01:00
OliverNocon
deb965e2b4
Fix CodeClimate finding with generator update
2019-11-06 09:12:50 +01:00
Sven Merk
04d288a13f
Merge branch 'cfg-hierarchical-defaults' of https://github.com/SAP/jenkins-library into cfg-hierarchical-defaults
2019-11-05 16:31:50 +01:00
Sven Merk
376419e0db
Add mixin of dependent defaults
2019-11-05 16:30:41 +01:00
Sven Merk
0ba9baab6a
Merge branch 'master' into cfg-hierarchical-defaults
2019-11-04 16:31:02 +01:00
Sven Merk
c241066e21
Add capability for hierarchical defaults in golang
2019-11-04 16:29:39 +01:00
OliverNocon
4302066327
Merge master
2019-11-04 16:11:13 +01:00
OliverNocon
6256a0b9aa
Update githubPublishRelease
2019-11-04 16:07:30 +01:00
Christopher Fenner
742a67fc60
Add GO logging with logrus ( #938 )
...
* add log package
* add logrus dependency
* add logging to karma step
* add log stepName to generator, respect verbose flag
2019-11-04 14:43:33 +01:00
Marcus Holl
3a128001f2
Cleanup: remove commented line (leftover ?) ( #939 )
2019-10-30 21:47:48 +01:00
Oliver Nocon
e01b3327fd
Go configuration - add aliasing functionality ( #925 )
...
* Go configuration - add aliasing functionality
This assists in backward compatibility cases.
It is now possible to define per parameter aliases.
2019-10-29 10:58:24 +01:00
Oliver Nocon
d053653a93
Add golang implementation for karma tests ( #919 )
...
* Provide golang based karma step
2019-10-25 14:58:59 +02:00
Oliver Nocon
1f34511407
Provide golang based Piper library ( #915 )
...
* Provide golang based Piper library
This includes the main command
and a sub command for config resolution
2019-10-24 10:59:58 +02:00
Oliver Nocon
c1eb9f5c70
Provide first parts for golang implementation ( #905 )
...
* Provide first parts for golang implementation
2019-10-22 15:41:27 +02:00
