You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
go-grpc_basic/README.md

253 lines
9.6 KiB
Markdown

# GO GRPC BASIC
2 years ago
## Requirements
2 years ago
check other branch to step by step create project
2 years ago
### Validate Go Installation
```bash
2 years ago
$ go version
go version go1.18.3 linux/amd64
2 years ago
```
### Validate GOPATH
```bash
echo $GOPATH
```
### Start Project in Go
```bash
cd $GOPATH/src
mkdir -p github.com/ajikamaludin/go-grpc_basic
cd github.com/ajikamaludin/go-grpc_basic
go mod init github.com/ajikamaludin/go-grpc_basic
go mod tidy
```
### Install Protoc
2 years ago
Linux : Download zip file, extract zip file to ~/.local/, add PATH ~/.local/bin
please read documentation from this link for more detail information
2 years ago
```
https://grpc.io/docs/protoc-installation/
```
### Validate Protoc Installation
```bash
2 years ago
$ protoc --version
libprotoc 3.21.2
2 years ago
```
2 years ago
### Install Protoc Dependecy for Golang
```bash
# protoc-gen-go
go install github.com/golang/protobuf/protoc-gen-go@latest
# proto (optional, execute in project dir)
go get google.golang.org/protobuf/proto@latest
# protoc-gen-grpc-gateway
go install github.com/grpc-ecosystem/grpc-gateway/protoc-gen-grpc-gateway@latest
# protoc-gen-swagger
go install github.com/grpc-ecosystem/grpc-gateway/protoc-gen-swagger@latest
```
2 years ago
### Add PATH
add to your ~/.bashrc or ~/.zshrc file
```bash
export PATH="$PATH:$GOPATH/bin"
```
2 years ago
### Validate Protoc Dependency Golang Installation
```bash
~ ls $GOPATH/bin
dlv gopls protoc-gen-go protoc-gen-grpc-gateway revel
go-outline grpcurl protoc-gen-go-grpc protoc-gen-swagger
```
## Start Project
### Setup Project
- create `proto` dir
- create versioning dir and service dir `health`
- create proto file `health.proto`
- compile / generate proto with `compile-proto.sh` in proto dir
2 years ago
### Setup config file
- create `config.yaml`
- create `pkg` dir , create versioning dir and create `configs` dir
- `go get gopkg.in/yaml.v2` , is a lib for parsing yaml config file to struct
- create `config.go` file, implement New and other func
- create `configs` dir on root project , create `configs.go`, this is file that bundle or wrap any services or packages
- `go get github.com/sirupsen/logrus`, is a lib to show log on run
- implement New to `configs.go` file
2 years ago
- create `main.go`, implement to call config and log environtment read is ready
- test `go run .`
### Implement Server GRPC
- create `utils/constants` dir in `pkg/v1`, to create global constants, implement EnvProduction, Successcode, SuccessDesc
- implement grpc service create `api/v1/health` service, create `health.go` as server service
- create `api/v1/health/status.go` as method implment from protobuf / pb file
- create `router` dir in root project
- create `grpc.go` in router dir and implement NewGRPCServer and register health api service
2 years ago
- `go get github.com/soheilhy/cmux`, TODO: what is for ?
2 years ago
- create `router.go` in router dir and implement IgnoreErr, this is for ignore error so can be safely ignore
2 years ago
- `go get golang.org/x/sync/errgroup`, TODO: what is for ?
2 years ago
- implement `main.go` to create grpc server from grpc.go with errgroup handler
- `go run .`, run server grpc
2 years ago
- `go install github.com/fullstorydev/grpcurl/cmd/grpcurl@latest`, this tool is
2 years ago
- test `grpcurl -plaintext localhost:5566 list`, to show list name of services
- test `grpcurl -plaintext localhost:5566 list api.gogrpc.v1.health.HealthService`, to show list name of service methods
- test `grpcurl -plaintext localhost:5566 api.gogrpc.v1.health.HealthService.Status`, to test method call in grpc
- result
2 years ago
```json
2 years ago
{
"success": true,
"code": "0000",
"desc": "SUCCESS"
}
```
- or test via postman , new -> grpc request -> Enter Server Url : localhost:5566 -> Import proto file / Select Method : Status -> Click Invoke
2 years ago
### Implement gRPC-Gateway
ref https://github.com/grpc-ecosystem/grpc-gateway
- implement `import "google/api/annotations.proto";` in proto file
- changes line below in all service methods for rest compile to rest
2 years ago
```proto
service HealthService {
rpc Status(google.protobuf.Empty) returns (Response) {
2 years ago
option (google.api.http) = {
get: "/api/gogrpc/v1/health/status"
};
}
}
```
- re - compile / re - generate proto with `compile-proto.sh` in proto dir
- `go mod tidy`
2 years ago
- `go get "github.com/gorilla/handlers"` TODO: what is for ?
- create `http.go` in router dir and implement NewHTTPServer and register health api service
- register httpserver to `main.go`
2 years ago
```go
g.Go(func() error { return router.NewHTTPServer(configs, logger) })
```
- `go run .` run grpc and http server
- test `curl localhost:8080/api/v1/health/status`, reponse
2 years ago
```json
{
"success":true,
"code":"0000",
"desc":"SUCCESS"
}
2 years ago
```
- GENERATE API DOCS:
- `mkdir swagger`
- `cd proto`
2 years ago
- `./gen-apidoc.sh`, will be generated in `swagger/docs.json`
2 years ago
- register apidoc to http server in `http.go` implement
2 years ago
```go
/////////
2 years ago
if configs.Config.Env != constants.EnvProduction {
CreateSwagger(mux)
}
2 years ago
/////////
2 years ago
func CreateSwagger(gwmux *http.ServeMux) {
gwmux.HandleFunc("/api/health/docs.json", func(w http.ResponseWriter, r *http.Request) {
http.ServeFile(w, r, "swagger/docs.json")
})
}
```
### Implement DB_Connection (With PostgreSQL)
- Execute `example.sql` in db, you know how to do it
- add `config.yaml` with line below
2 years ago
```yaml
postgres:
host: 127.0.0.1
port: 5432
dbname: test
username: postgres
password: mysecretpassword
```
- changes `pkg/v1/config/config.go` to add new config line in config struct and and validateConfigData rule
2 years ago
- `go get github.com/lib/pq`, this is a lib for standart go lib `database/sql` to connect postgresql, usage in call
```go
import (
_ "github.com/lib/pq"
)
// ref : https://github.com/lib/pq
```
- create `pkg/v1/postgres` dir, create `postgres.go` file in there implement string conn and test connection
- create `pkg/v1/utils/converter` dir, create `converter.go` file in there, to convert camelcase to snake_case
- create `pkg/v1/postgres/custom.main.go` to implement all query to database table custom
- changes `configs/configs.go` to bundle pg connection
2 years ago
- how to use custom.main.go call function from api calldb, check `api/v1/health/calldb.go`
2 years ago
### Example of call Other Rest API
- add new environtment to `config.yaml` add cert path
- changes `pkg/v1/config/config.go` to validate and add new environtment
- changes `pkg/v1/utils/constants` append method POST/GET/PUT/DELETE constant, JsonType Header, Hostname endpoint
- create `pkg/v1/cert` dir, create `cert.go`, this file is for handle Insecure ssl connection (self gen cert)
- create `pkg/v1/requestapi` dir, create `requestapi.go`, implement http call
- create `services/v1/jsonplaceholder` dir, create service name `jsonplaceholder.go`, implement any of endpoint http call from requestapi.go
2 years ago
- create new method from service health and implement call jsonplaceholder service from there, check `api/v1/health/callapi.go`
2 years ago
### HTTP Custom Error Reponse
- create `pgk/v1/utils/errors/errors.go`, implement error handler for custom http
- register runtime Http error in `http.go`
```go
runtime.HTTPError = errors.CustomHTTPError
2 years ago
```
2 years ago
### File Logger
2 years ago
- goal : create log file for every action like , request / response from / to client, request / response from / to other api,
2 years ago
- `go get github.com/lestrrat/go-file-rotatelogs`, this lib for create rotate log file automated
2 years ago
- create `pkg/v1/utils/logger/logger.go`, implement logger function to write log to file
- implement logger for `pkg/v1/requestapi/requestapi.go` to log request and response api from other service
- implement logger for `pkg/v1/utils/errors/errors.go` to log any of error from our service
- implement logger for `router/http.go` to log response grpc rest api service
- `go run .`
2 years ago
- test call method callapi will generate hif log, custom-error generate error log, call rest will generate rest log
### Jwt ( Json Web Tokens ) Auth
- add jwt configs to `config.yaml`, jwt: issuer: ajikamaludin, key: P@ssw0rd, type: Bearer
2 years ago
- changes `pkg/v1/config/config.go` add new config struct and validate config, <span style="color: black;background-color: #FFFF00">[UPDATE]</span> change New to GetInstance for singleton config
2 years ago
- changes `pkg/v1/utils/constants/constants.go` to add new const for jwt token expired and refresh token expired
- `go get github.com/dgrijalva/jwt-go`, lib to handle jwt token in go
- create new pkg `pkg/v1/jwt/jwt.go`, implement Generate token and Claim token
2 years ago
- create new proto `proto/v1/auth/auth.proto` auth for login and register service, recompile `sh compile-proto.sh` <span style="color: black;background-color: #FFFF00">[UPDATE]</span>
2 years ago
- implement `api/v1/auth/auth.go`, `api/v1/auth/login.go` and `api/v1/auth/register.go`
- register new grpc service to grpc server
```go
authpb.RegisterAuthServiceServer(grpcServer, auth.New(configs, logger))
```
- register new grp service to grpc gateay (http.go)
```go
authpb.RegisterAuthServiceHandler,
```
- implement middleware in grpc server, for check jwtoken in every request , and add
```go
grpcServer := grpc.NewServer(
grpc.UnaryInterceptor(
grpc_middleware.ChainUnaryServer(
authInterceptor,
),
),
)
```
- test call login with any userid and password
```bash
curl -X POST -d '{"userId":"aji","password":"pass"}' http://localhost:8080/api/v1/auth/login
```
- result
```json
{
"success":true,
"code":"0000",
"desc":"SUCCESS",
"auth":
{
"type":"Bearer",
"access":"eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ1c2VyIjoiYWppIiwiZXhwIjoxNjU4MTU2Njk5LCJpc3MiOiJiYW5rcmF5YSJ9.5o3b0twKzuqVzPtS68GMD6pw91m4JbCaJrg57iQw06A",
"expiredPeriode":3600,
"refresh":"eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ1c2VyIjoiYWppIiwiaXNSZWZyZXNoIjp0cnVlLCJleHAiOjE2NTgxNTY2OTksImlzcyI6ImJhbmtyYXlhIn0.C8ZF9JFYWJIg3A0f9Ax2kWlPd1LJPeKZtDOSjX_KW6E"
}
}
```
- use access token to access other resource / service - method