[AWS] [GCP] I tried to make cloud services easy to use with Python

At first

--I checked the operation with Python2 system, but I think it will work with 3, maybe. Dunno. ――Please use at your own risk. --If you have any problems, please pull request.

Why i made it

――I liked boto3, so I wanted to make something and publish it. ――Since googleapiclient has to do a lot of mess, I thought that creating a wrapper class would make everyone happy.

How to use

It is also written on github page, but also here

  1. Create a suitable virtualenv environment
  2. pip install cloud_lib
  3. The rest is like this
#EC2 instance launch
from cloud_lib.amazon_services import Ec2
ec2_service = Ec2(aws_access_key_id, aws_secret_access_key, region_name)
ec2_service.start_instance('instance_id')

#BigQuery table delete
from cloud_lib.google_services import BigQuery
bq_service = BigQuery(project_id, client_id, client_secret, refresh_token)
bq_service.delete_table(data_set_id, table_id)

Other --You can put a message in SQS and put it out in reverse. --Stop EC2 --Upload files to S3 or Google Storage, or download them in reverse --Table copy, import from storage, data acquisition for DynamoDB and BigQuery And so on. Please check the readme for details.

Impressions I made

--I was surprised that the mundane name cloud_lib was still open. ――There are still some features that are missing, but we plan to add them in the future. And the schedule is undecided. --The source of google_services.py tends to be long because there is no boto3

Supplement

I don't think it's a problem to make this kind of thing without permission, but if it doesn't work, I'll erase it, so please contact me. I'm sorry.

Recommended Posts

[AWS] [GCP] I tried to make cloud services easy to use with Python
[Zaif] I tried to make it easy to trade virtual currencies with Python
I tried to make various "dummy data" with Python faker
I tried to make GUI tic-tac-toe with Python and Tkinter
I want to play with aws with python
[5th] I tried to make a certain authenticator-like tool with python
[2nd] I tried to make a certain authenticator-like tool with python
I tried to make a periodical process with Selenium and Python
I tried to make a 2channel post notification application with Python
I tried to make a todo application using bottle with python
[4th] I tried to make a certain authenticator-like tool with python
[1st] I tried to make a certain authenticator-like tool with python
I tried to make an image similarity function with Python + OpenCV
I tried uploading / downloading a file to AWS S3 / Azure BlobStorage / GCP CloudStorage with Python
Python: I tried to make a flat / flat_map just right with a generator
I tried to use lightGBM, xgboost with Boruta
I want to make a game with Python
I tried to get CloudWatch data with Python
I tried to output LLVM IR with Python
I tried to make a traffic light-like with Raspberry Pi 4 (Python edition)
I want to use Temporary Directory with Python2
I tried to automate sushi making with python
I tried connecting AWS Lambda with other services
I tried to make a url shortening service serverless with AWS CDK
I tried to make a periodical process with CentOS7, Selenium, Python and Chrome
When I tried to make a VPC with AWS CDK but couldn't make it
I tried to summarize how to use matplotlib of python
I tried to implement Minesweeper on terminal with python
I tried to get started with blender python script_Part 01
I tried to touch the CSV file with Python
I tried to draw a route map with Python
I tried to solve the soma cube with python
Continuation ・ I tried to make Slackbot after studying Python3
I tried to get started with blender python script_Part 02
I tried to implement an artificial perceptron with python
I tried to build ML Pipeline with Cloud Composer
I tried to automatically generate a password with Python3
I want to AWS Lambda with Python on Mac!
I tried to summarize how to use pandas in python
I tried to solve the problem with Python Vol.1
I tried to analyze J League data with Python
I tried to make an OCR application with PySimpleGUI
[Introduction to AWS] I tried playing with voice-text conversion ♪
I tried to solve AOJ's number theory with Python
I tried fp-growth with python
I tried scraping with Python
Easy to make with syntax
I tried gRPC with Python
I tried scraping with python
I tried to make a real-time sound source separation mock with Python machine learning
I tried to find the entropy of the image with python
I tried to simulate how the infection spreads with Python
I tried various methods to send Japanese mail with Python
I tried follow management with Twitter API and Python (easy)
[Python] I want to use the -h option with argparse
[Python] I tried to visualize tweets about Corona with WordCloud
Mayungo's Python Learning Episode 3: I tried to print numbers with print
I tried to make a stopwatch using tkinter in python
I tried to divide the file into folders with Python
Python: How to use async with
[Python] I tried to make an application that calculates salary according to working hours with tkinter