I’m still fairly new at working with Go. I have the goal of working with, and perhaps even on, several open source projects that use Go as their implementation language. It seems like the number of open source projects using Go is increasing rapidly. It also seems like I need to get acquainted more with Go, and find out how to interact from Go with Oracle Cloud Infrastructure (OCI), as I intend to add features to open source products that leverage OCI services.
In this article we’ll get a quick introduction to interactions with the OCI Object Storage Service for the purpose of creating and removing a bucket, and an object from a simple Go program that uses the OCI Go SDK. My environment is Ubuntu 20.4 on WSL2 on Windows 10, although that shouldn’t matter much.
The steps in this article:
- Install a Go environment.
- Create a Go application to connect to OCI using the OCI SDK.
- Interact with OCI Object Storage.
Install Go
Using this article: Install Go on Ubuntu — https://buildvirtual.net/how-to-upgrade-go-on-ubuntu/ — I quickly got the current version of Go removed and the latest version of Go installed.
Go get the URL for the latest release: https://go.dev/dl/
Download using wget and untar
Then move the extracted directory go to the /usr/local directory:
I tried to run go at this point, but I was too early. First, a small edit of .profile is in order: add the definition of environment variable GOPATH and add $GOPATH to the PATH environment variable.
Once the change is made to .profile and the change has been applied with source ~/, the profile environment is once again ready to run Go with the latest version.
Create a Go application to connect to OCI using the OCI SDK
On the Linux command line, I created a new directory — oci-client — and with “code .” I launched VS Code on this directory.
I can edit code in VS Code and run the code in the context of the Ubuntu environment with the Go runtime set up. Let’s create the simplest of Go applications.
And run it!
No interaction with OCI yet, but a running Go application is a nice start.
Now create file go.mod and add this contents:
<span class="et ua ta hj ub b ch uc ud l ue" data-selectable-paragraph="" id="9e98">module oci-client
go 1.16
require github.com/oracle/oci-go-sdk/v54 v54.0.0</span>
Then run: “go mod tidy” (see docs for help): go mod tidy ensures that the go.mod
file matches the source code in the module. It adds any missing module requirements necessary to build the current module's packages and dependencies, and it removes requirements on modules that don't provide any relevant packages. It also adds any missing entries to go.sum
and removes unnecessary entries. "
Define constants in the application for the tenancy OCID, the user OCID, the region and the fingerprint (the usual entries in the oci config file):
Import these packages:
Extend the application to the following listing — with functions initializeConfigurationProvider (to contact OCI) and listDomains (to interact with the identity service APIs
Finally create a file — for example called ppk (putty private key) — that contains the private key for an OCI account in PEM format.
With this in place, I can run the application.
The first action is to export an environment variable with the contents of the file ppk as its value:
<span class="et ua ta hj ub b ch uc ud l ue" data-selectable-paragraph="" id="c919">export pem=$(cat ./ppk)</span>
This makes the private key accessible to the Go application as environment variable, using os.Getenv(“pem”).
And there is contact between my locally running Go application and the OCI — as the output shows.
Interact from Go Application with OCI Object Storage
Time now to introduce the Object Storage APIs in the SDK (see docs here). These will allow us to create buckets and objects in those buckets from the Go application. This is a capability I’ll need when I implement a custom Dapr state component leveraging OCI Object Storage — as is my goal.
Let’s run the Go application I have crafted:
The result of running this code is the creation of a Bucket:
and a new file with the specified contents in this bucket:
Inspect the contents by downloading and view the object to my local file system:
So my Go application works with OCI Object Storage.
The main function in the application orchestrates the moves:
The configurationProvider contains the OCI connection details (such as OCIDs for tenancy and user, the fingerprint and private key). This provider is used to create the objectStorageClient — which is used for all subsequent interactions with the OCI ObjectStorage service.
The steps subsequently taken:
- Determine the namespace for the tenancy.
- Ensure that a bucket with the specified name exists — check if it exists already and if it does not, then create it.
- Put an object with the specified name and contents in the bucket (overwrite the object that may already be there under that name).
- Defer the statement that will remove the object again.
- Retrieve the object that was just created and write its contents to the output.
- Sleep for one minute and afterwards execute all deferred statements (which means that the object is removed).
This code is not robust, it does hardly any error checking and handling. It most certainly cannot be used in anything like a production environment. However, it does illustrate how we interact with the ObjectStorage service through the Go SDK, and under the right circumstances it certainly does the job of creating the bucket and the object plus reading the object and removing it.
Let’s look at the code in a little more detail. This code for initializing the OCI Configuration Provider is generic across all Go applications that interact with whatever OCI services. It uses common OCI configuration details — commonly found in the config file in directory .oci when using the OCI CLI — to create signed HTTP requests to the OCI REST APIs
The code that checks if a bucket already exists — by getting it and checking on status code 404 (not found) and creating the bucket if it was not found — is shown below. Note that the getBucketRequest struct expects pointers to strings for namespacename and bucketname (see docs), hence the &namespace and &name to produces the addresses for these string values (one of the intricacies of Go I am still getting used to)
With the Bucket established, creating the object is done as follows:
This is quite straightforward code — except for the way in which the string that contains the object’s content is turned into a reader object (at least to me that looks a bit special).
To retrieve an object from the OCI Object Storage service is basically the reverse operation from putObject:
This function returns the contents of the object as a string — assuming that it is at all meaningful to turn this object into a string. Note that the response object returns pointers to ContentLength, ContentType and Content. The asterisk (*response.Content:Length) is used to retrieve the actual value (at the pointer’s location).
Finally to delete the object — the simplest of the operations:
The full code for my OCI ObjectStorage sample client is shown below
Resources
Package Index: https://docs.oracle.com/en-us/iaas/tools/go/54.0.0/index.html#pkg-index
Configuring Go SDK: https://github.com/oracle/oci-go-sdk/blob/master/README.md#configuring
Article DEVELOPING MICROSERVICES WITH OCI SDKS AVOIDING TO INCLUDE THE PRIVATE KEY FILE IN THE CONTAINER IMAGE | EXAMPLE IN GO by Javier Mugueta — https://javiermugueta.blog/2021/04/26/developing-microservices-with-oci-sdks-avoiding-to-include-the-private-key-file-in-the-container-image-example-in-go/
OCI Object Storage REST API — https://docs.oracle.com/en-us/iaas/api/#/en/objectstorage/20160918/Bucket/CreateBucket
OCI Go SDK — generated client for GetObject — https://docs.oracle.com/en-us/iaas/tools/go-sdk-examples/54.0.0/objectstorage/GetObject.go.html
OCI Go SDK — ObjectStorage Package Index — https://docs.oracle.com/en-us/iaas/tools/go/54.0.0/objectstorage/index.htm
If you’re curious about the goings-on of Oracle Developers in their natural habitat, join us on our public Slack channel!
Originally published at https://technology.amis.nl on December 28, 2021.