Here is a direct comparisons between the services provided by Microsoft Azure and Amazon Web Services. The list contains all the services that could be mapped as similar in actions and usage.

Microsoft Azure Amazon Web Services (AWS)
Available Regions Azure Regions AWS Global Infrastructure
Compute Services Virtual Machines (VMs) Elastic Compute Cloud (EC2)
Cloud Services
Azure Websites and Apps
Amazon Elastic Beanstalk
Azure Visual Studio Online None
Container Support Docker Virtual Machine Extension (how to) EC2 Container Service (Preview)
Scaling Options Azure Autoscale (how to) Auto Scaling
Analytics/Hadoop Options HDInsight (Hadoop) Elastic MapReduce (EMR)
Government Services Azure Government AWS GovCloud
App/Desktop Services Azure RemoteApp Amazon WorkSpaces
Amazon AppStream
Storage Options Azure Storage (Blobs, Tables, Queues, Files) Amazon Simplge Storage (S3)
Block Storage Azure Blob Storage (how to) Amazon Elastic Block Storage (EBS)
Hybrid Cloud Storage StorSimple AWS Storage Gateway
Backup Options Azure Backup Amazon Glacier
Storage Services Azure Import Export (how to) Amazon Import / Export
Azure File Storage (how to) AWS Storage Gateway
Azure Site Recovery None
Content Delivery Network (CDN ) Azure CDN Amazon CloudFront
Database Options Azure SQL Database Amazon Relational Database Service (RDS)
Amazon Redshift
NoSQL Database Options Azure DocumentDB Amazon Dynamo DB
  Azure Managed Cache (Redis Cache) Amazon Elastic Cache
Data Orchestration Azure Data Factory AWS Data Pipeline
Networking Options Azure Virtual Network Amazon VPC
Azure ExpressRoute AWS Direct Connect
Azure Traffic Manager Amazon Route 53
Load Balancing Load Balancing for Azure (how to) Elastic  Load Balancing
Administration & Security Azure Active Directory AWS Directory Service
AWS Identity and Access Management (IAM)
Multi-Factor Authentication Azure Multi-Factor Authentication AWS Multi-Factor Authentication
Monitoring Azure Operational Insights Amazon CloudTrail
Azure Application Insights Amazon CloudWatch
Azure Event Hubs None
Azure Notification Hubs Amazon Simple Notification Service (SNS)
Azure Key Vault (Preview) AWS Key Management Service
Compliance Azure Trust Center AWS CLoudHSM
Management Services & Options Azure Resource Manager Amazon CloudFormation
API Management Azure API Management Amazon API Gateway
Automation Azure Automation AWS OpsWorks
Azure Batch
Azure Service Bus
Amazon Simple Queue Service (SQS)
Amazon Simple Workflow (SWF)
Visual Studio AWS CodeDeploy
Azure Scheduler None
Azure Search Amazon CloudSearch
Analytics Azure Stream Analytics Amazon Kinesis
Email Services Azure BizTalk Services Amazon Simple Email Services (SES)
Media Services Azure Media Services Amazon Elastic Transcoder
Amazon Mobile Analytics
Amazon Cognitor
Other Services & Integrations Azure Machine Learning (Preview) Amazon Machine Learning
Logic Apps AWS Lambda (Preview)
Service Bus AWS Config (Preview)

It is tough to make a significant decision like picking a cloud infrastructure vendor without actually trying them out. Both Amazon and Azure  offer a free tier of service, so you do just that.

In this short article we will see how we can do a Streaming Transfers of data from a HP Vertica SQL(any database may apply) straight into Google Cloud Storage Bucket using gsutil tool.
The secret of this task is to use ‘-‘ in place of src_url(source) or dst_url(destination) to perform a streaming transfer.

Example:

  •  this will create comma separated file that will be stored into the Google Storage bucket called gs://bktv in the file called schema.table.csv.

There some cons on using this type of data transfer such as :

  • they cannot be resumed, which means that is the upload get stuck in the middle you will have to restart the upload.(so use uploading from local files when dealing with large amounts of data)
  • no check sum is done on the streamed data so Google won`t do any validation on the data.

 

Google Cloud SDK (gcloud)contains tools and libraries that enable you to easily create and manage resources on Google Cloud Platform.

Installing Google Cloud SDK(gcloud) is quite simple and Google does all the work for you.

  • you will need to run the following command logged as root user.

Restart your Shell:

Set up a your gcloud tool default configuration:

  • to be able to manage your Google Cloud Account you need to create the configuration file.
  • you need to follow the instructions given by the installer.
  • you can choose the default options or use customized as well.

List installed version of gcloud utility.

  • after configuration is complete you can list the available tools using the command bellow:

So we finished installing Google Cloud SDK command-line interface. In the next articles we will go over the utilities that come with the gcloud tool.

 

Creating and removing Google Storage Buckets.

The gsutil tool can create Google Storage Buckets with ease after you have configured the Google gsutil client.

Examples of using the gsutil to create and remove Google Storage Buckets. 

Base Syntax:

Example:

  • we will create a bucket using the default options.

List the created bucket:

Create multiple buckets with the same gsutil comand:

Note:

  • buckets name must be unique at a global level and not only to your bucket naming list

 

Remove a Google Storage Bucket:

Base Syntax:

Example: 

  • we will remove the bucket we created in the previous step.

Remove multiple buckets:

Note:

  • the bucket needs to be empty before running the rb command, so remove or move any contents of the bucket before dropping the bucket.

I find gsutil quite easy to use and very similar to Linux  own commands.

In future articles we will see more advanced topics on how we can use gsutil tool.

   gsutil is a Python application that lets you access Google Cloud Storage from the command line.

You can use gsutil to do a wide range of bucket and object management tasks, including:

  • Creating and deleting buckets.
  • Uploading, downloading, and deleting objects.
  • Listing buckets and objects.
  • Moving, copying, and renaming objects.
  • Editing object and bucket ACLs.

gc

Let`s go ahead and see how we can install gsutil on a CentOS Linux Machine.

Download and unzip the gsutil tool using the wget linux utility from https://storage.googleapis.com/pub/gsutil.tar.gz

  • see example:

Once unzipped go ahead and ad the PATH environment variable to your .bashrc file.

  • run the following command.

 

Test that the gsutil was installed:

Set Up Credentials to Access Protected Data

  Installing gsutil allows you to download and access publicly-accessible objects, but in order to access protected data or write to a protected bucket, you need to set up credentials to access the Google Cloud Storage service.

The first time you run this command, gsutil prints a URL to the authorization page where you can authorize gsutil to access Google Cloud Storage.

 See steps to follow: 

  1. Run the gsutil config command
  2. Copy and paste the URL into a browser window.
  3. Click the Allow Access button.
  4. Copy the authorization code that appears on the next page into the gsutil prompt and press Enter.
  5. Log in to the Google Cloud Platform Console to find a project ID you can specify as the default project.
  6. Copy and paste the project ID into gsutil.

See example:

Test that the gsutil installation:

  • run the unit test(is faster).

Your gsutil tool should be ready to use, in the next article we will see how we can use the gsutil tool to manage our Google Storage buckets.