go/golang-saas-starter-kit
1
0
Fork 0
mirror of https://github.com/raseels-repos/golang-saas-starter-kit.git synced 2025-08-08 22:36:41 +02:00
Code Issues Releases Activity

updated readme

Browse Source
This commit is contained in:
Lee Brown
2019-07-14 17:59:06 -08:00
parent 8ae8c97af9
commit 2cd374a130
6 changed files with 80 additions and 73 deletions
Download Patch File Download Diff File Expand all files Collapse all files

124
README.md
View File

@@ -435,76 +435,46 @@ shared=# \dt
``` ```
## Development Notes ## Deployment
This project includes a complete build pipeline that relies on AWS and GitLab. `.gitlab-ci.yaml` the following build
### AWS Permissions stages:
```yaml
Base required permissions. stages:
``` - build:dev # Build containers with configs targeting dev env.
secretsmanager:CreateSecret - migrate:dev # Run database migration against the dev database.
secretsmanager:GetSecretValue - deploy:dev # Deploy the containers built for dev env to AWS ECS.
secretsmanager:ListSecretVersionIds - build:stage # Build containers with configs targeting stage env.
secretsmanager:PutSecretValue - migrate:stage # Run database migration against the stage database.
secretsmanager:UpdateSecret - deploy:stage # Deploy the containers built for stage env to AWS ECS.
- build:prod # Build containers with configs targeting prod env.
- migrate:prod # Run database migration against the prod database.
- deploy:prod # Deploy the containers built for prod env to AWS ECS.
``` ```
Additional permissions required for unit tests. Currently `.gitlab-ci.yaml` only defines jobs for the first three stages. The remaining stages can be chained together
``` so each job is dependant on the previous or run jobs for each target env independently.
secretsmanager:DeleteSecret
```
The example web app service allows static files to be served from AWS CloudFront for increased performance. Enable for A build tool called [devops](https://gitlab.com/geeks-accelerator/oss/saas-starter-kit/tree/master/tools/devops) has
static files to be served from CloudFront instead of from service directly. been included apart of this project to handle creating AWS resources and deploying your services with minimal additional
``` configuration. You can customizing any of the configuration in the code. When AWS already a core part of the
cloudFront:ListDistributions saas-starter-kit, keeping the deployment in GoLang limits the scope of additional technologies required to get your
``` project successfully up and running. If you understand GoLang, then you will be a master at devops with this tool.
The project by default includes a postgres database which adds an additional resource dependency when deploying the
project. The tasks running schema migration can not run as shared GitLab Runners since they will be outside the
deployment AWS VPC. There are two options here:
1. Enable the AWS RDS database to be publicly available.
2. Run our own GitLab runners inside the same AWS VPC and grant access for them to communicate with the database.
### Datadog This project has opted for option 2 and thus setting up the deployment pipeline requires a few more additional steps.
Using shared runners hosted by GitLab also requires AWS credentials to be input into GitLab for configuration.
Hosted our own GitLab runners uses AWS Roles instead of hardcoding the access key ID and secret access key in GitLab and
in other configuration files. And since this project is open source, we wanted to avoid sharing our AWS credentials.
Datadog has a custom init script to support setting multiple expvar urls for monitoring. The docker-compose file then If you don't have an AWS account, signup for one now and then proceed with the deployment setup.
can set a single env variable.
```bash
DD_EXPVAR=service_name=web-app env=dev url=http://web-app:4000/debug/vars|service_name=web-api env=dev url=http://web-api:4001/debug/vars
```
### Setup GitLab CI / CD
### Gitlab
[GitLab CI/CD Pipeline Configuration Reference](https://docs.gitlab.com/ee/ci/yaml/)
### Postgres and future MySQL support
Postgres is only supported based on its dependency of sqlxmigrate. MySQL should be easy to add to sqlxmigrate after
determining a better method for abstracting the create table and other SQL statements from the main testing logic.
### SQLx bindvars
When making new packages that use sqlx, bind vars for mysql are `?` where as postgres is `$1`.
To database agnostic, sqlx supports using `?` for all queries and exposes the method `Rebind` to
remap the placeholders to the correct database.
```go
sqlQueryStr = db.Rebind(sqlQueryStr)
```
For additional details refer to https://jmoiron.github.io/sqlx/#bindvars
## Contribute
### Development Notes regarding this copy of the project.
#### GitLab CI / CD
_Shared Runners_ have been disabled for this project. Since the project is open source and we wanted to avoid putting
our AWS credentials as pipeline variables. Instead we have deployed our own set of autoscaling runnings on AWS EC2 that
utilize AWS IAM Roles. All other configure is defined for CI/CD is defined in `.gitlab-ci.yaml`.
Below outlines the basic steps to setup [Autoscaling GitLab Runner on AWS](https://docs.gitlab.com/runner/configuration/runner_autoscale_aws/). Below outlines the basic steps to setup [Autoscaling GitLab Runner on AWS](https://docs.gitlab.com/runner/configuration/runner_autoscale_aws/).
@@ -680,6 +650,36 @@ instance will be a dedicated host since we need it always up and running, thus i
sudo gitlab-runner restart sudo gitlab-runner restart
``` ```
## Development Notes
### Datadog
Datadog has a custom init script to support setting multiple expvar urls for monitoring. The docker-compose file then
can set a single env variable.
```bash
DD_EXPVAR=service_name=web-app env=dev url=http://web-app:4000/debug/vars|service_name=web-api env=dev url=http://web-api:4001/debug/vars
```
### Postgres and future MySQL support
Postgres is only supported based on its dependency of sqlxmigrate. MySQL should be easy to add to sqlxmigrate after
determining a better method for abstracting the create table and other SQL statements from the main testing logic.
### SQLx bindvars
When making new packages that use sqlx, bind vars for mysql are `?` where as postgres is `$1`.
To database agnostic, sqlx supports using `?` for all queries and exposes the method `Rebind` to
remap the placeholders to the correct database.
```go
sqlQueryStr = db.Rebind(sqlQueryStr)
```
For additional details refer to https://jmoiron.github.io/sqlx/#bindvars
## What's Next ## What's Next
We are in the process of writing more documentation about this code. We welcome you to make enhancements to this We are in the process of writing more documentation about this code. We welcome you to make enhancements to this

2
cmd/web-api/Dockerfile
View File

@@ -40,7 +40,7 @@ COPY cmd/web-api/templates /templates
WORKDIR ./cmd/web-api WORKDIR ./cmd/web-api
# Update the API documentation. # Update the API documentation.
#RUN swag init RUN swag init
RUN CGO_ENABLED=0 GOOS=linux go build -a -installsuffix nocgo -o /gosrv . RUN CGO_ENABLED=0 GOOS=linux go build -a -installsuffix nocgo -o /gosrv .

15
cmd/web-api/README.md
View File

@@ -61,7 +61,7 @@ one `docker-compose.yaml` file that is shared between all services.
4. Open the Swagger UI. 4. Open the Swagger UI.
Navigate your browser to [http://localhost:3000/swagger](http://localhost:3000/swagger). Navigate your browser to [http://localhost:3001/swagger](http://localhost:3001/docs).
5. Signup a new account. 5. Signup a new account.
@@ -167,6 +167,19 @@ Run `swag init` in the service's root folder which contains the main.go file. Th
swag init swag init
``` ```
### Additional Annotations
Below are some additional example annotions that can be added to `main.go`
```go
// @title SaaS Example API
// @description This provides a public API...
// @termsOfService http://example.com/terms
// @contact.name API Support
// @contact.email support@geeksinthewoods.com
// @contact.url http://example.com/support
```
### Trouble shooting ### Trouble shooting

4
cmd/web-api/handlers/routes.go
View File

@@ -93,8 +93,8 @@ func API(shutdown chan os.Signal, log *log.Logger, masterDB *sqlx.DB, redis *red
// Register swagger documentation. // Register swagger documentation.
// TODO: Add authentication. Current authenticator requires an Authorization header // TODO: Add authentication. Current authenticator requires an Authorization header
// which breaks the browser experience. // which breaks the browser experience.
app.Handle("GET", "/swagger/", saasSwagger.WrapHandler) app.Handle("GET", "/docs/", saasSwagger.WrapHandler)
app.Handle("GET", "/swagger/*", saasSwagger.WrapHandler) app.Handle("GET", "/docs/*", saasSwagger.WrapHandler)
return app return app
} }

6
cmd/web-api/main.go
View File

@@ -50,12 +50,6 @@ var build = "develop"
var service = "WEB_API" var service = "WEB_API"
// @title SaaS Example API // @title SaaS Example API
// @description This is a sample server celler server.
// @termsOfService http://example.com/terms
// @contact.name API Support
// @contact.email support@geeksinthewoods.com
// @contact.url http://example.com/support
// @license.name Apache 2.0 // @license.name Apache 2.0
// @license.url http://www.apache.org/licenses/LICENSE-2.0.html // @license.url http://www.apache.org/licenses/LICENSE-2.0.html

2
cmd/web-app/main.go
View File

@@ -6,7 +6,6 @@ import (
"encoding/json" "encoding/json"
"expvar" "expvar"
"fmt" "fmt"
"geeks-accelerator/oss/saas-starter-kit/internal/mid"
"html/template" "html/template"
"log" "log"
"net" "net"
@@ -21,6 +20,7 @@ import (
"syscall" "syscall"
"time" "time"
"geeks-accelerator/oss/saas-starter-kit/internal/mid"
"geeks-accelerator/oss/saas-starter-kit/cmd/web-app/handlers" "geeks-accelerator/oss/saas-starter-kit/cmd/web-app/handlers"
"geeks-accelerator/oss/saas-starter-kit/internal/platform/devops" "geeks-accelerator/oss/saas-starter-kit/internal/platform/devops"
"geeks-accelerator/oss/saas-starter-kit/internal/platform/flag" "geeks-accelerator/oss/saas-starter-kit/internal/platform/flag"