-
GCP – DataFlow Pipeline Using Flex Template.
GCP – DataFlow Pipeline Using Flex Template. Steps For Creating DataFlow Pipeline: Install Prerequisites: 1 – Python Setup: https://www.python.org/downloads/ 2 – VsCode Setup: 3 – Docker Desktop Setup: https://www.docker.com/products/docker-desktop/ 4 – Google Cloud SDK Setup https://dl.google.com/dl/cloudsdk/channels/rapid/GoogleCloudSDKInstaller.exe 5 – VS Code Project Structure 6 – VS Code Extensions 7 – Authenticate With GCP #1 Login To Your GCP Account gcloud auth login #2 Set application default credentials (important for local development) gcloud auth application-default login #3 Set your project gcloud config set project ccoe-poc-admin #4 Verify Authentication gcloud auth list 8 – Set Up Python Virtual Environment python -m venv log_monitoring_venv
-
GCP – IAM Service Account Creation
GCP – IAM Service Account Creation Steps For Creating IAM Service Account:
-
GCP – Google Cloud Storage
GCP – Google Cloud Storage Steps For Creating Google Cloud Storage:
-
GCP – DataFlow Pipeline Creation!
GCP – DataFlow Pipeline Creation Installation Steps:
-
GCP – BigQuery Table Creation
GCP – BigQuery Table Creation Steps For Creating BigQuery Table Creation!
-
GCP – DataFlow Integration
GCP – Data Flow Integration Steps For Integrating Pub/Sub With DataFlow
-
GCP – Log Routing From One Project To Another.
GCP – Log Routing Steps For Routing The Logs: Step-1: Create A Pub/Sub Topic In The Destination Project Give A Topic Name: Select Add A Default Subscription: Add a default subscription a subscriber should be a different person then why we are making pub/sub as subscriber: what happen if i uncheck this option ? Create A Transform : Can I Add Transform Later Stage: Check Google Managed Encryption Key : Step-2: Create Log Sink In The Source Project Step-3: Give Permission to Source Project For Publisher Step-4: How To Check If The Logs Are Coming To Pub/Sub Or Not ?
-
GCP – Creating A New Project
GCP – Creating A New Project Table Of Content: What Is A Project In GCP. What Happen When You Create A New GCP Project ? Why To Use A Project ? Example Of Creating A Projects. How To Create A GCP Project ? (1) What Is A Project In GCP ? A project is like a folder you create to put everything required for working of the project. You generally create a folder and give it a name and start adding different files for your project in VS Code. So when you want to create a new application you generally
-
GCP – All Products Of GCP
GCP – List Of All Products Table Of Content: Management Compute Storage Analytics Networking Distributed Cloud Serverless Database Observability Operations Security App Development CI/CD Artificial Intelligence Integration Services Tools Web3 Other Google Products Support (1) Management: (2) Compute: (3) Storage: (4) Analytics: (5) Networking: (6) Distributed Cloud: (7) Serverless: (8) Databases (9) Observability (10) Operations (11) Security (12) App Development (13) CI/CD (14) Artificial Intelligence (15) Integration Services (16) Tools (17) Web3 (18) Other Google products (19) Support (20) Use Case
-
GCP – Log Detective Automation
GCP – Log Detective Automation Table Of Content: What Is Big Query ? Key Features Of Big Query. Common Use Cases. Example Of Big Query. Big Query Integration. Summary.
