How to Build Your Own Google Cloud Workflows
Replace Google Cloud Workflows with a custom build. Combine Google Cloud services and APIs to build reliable applications, process automation, and data and machine learning pipelines.
Build Difficulty: 5/5
Build a working replacement in a weekend with AI tools
Estimated Timeline
Based on 40 features at Weekend Project difficulty, expect about One weekend with AI-assisted development.
Recommended Tech Stack
Full-stack React framework with API routes and server components
PostgreSQL database, auth, and real-time subscriptions
Utility-first styling for rapid UI development
Key Features to Replicate
Top features across 8 categories. See all 40 features
Execution(9 features)
Wait for asynchronous operations and events with polling and callbacks
Evaluate conditional statements within workflow execution
Execute workflows when events occur such as when a file is uploaded to Cloud Storage or when a Pub/Sub message is published through Eventarc
Wait up to one year for a given period to implement polling
Use expressions and functions to transform response data and prepare request inputs
+4 more in this category
Integration(8 features)
Connectors for Google Cloud services like BigQuery make it easy to perform operations and wait for completion
Connectors make Google Cloud services particularly easy to use by taking care of request formatting, retries and waiting to complete long-running operations
Trigger workflows when files are uploaded to Cloud Storage buckets
Polling attempts made by connectors for long-running operations controlled using connector_params.polling_policy
Send documents to Document AI for processing and handle the results in workflows
+3 more in this category
Reliability(5 features)
Control failures and maintain reliability even when other systems fail with automatic redundancy and fault-tolerance
Workflows are automatically replicated across multiple zones ensuring executions continue even after outages
Default or custom retry logic and error handling with checkpointing every step to Spanner
Specify retry policies and error handling for workflow execution
Checkpoint state after each step to help keep track of progress
Development(4 features)
Access to standard library functions and built-in functions for workflow logic
Deploy in seconds to support fast developer experience and quick production changes
Create reusable subworkflows that can be called from main workflows
Specify workflows in YAML or JSON with named steps making them easy to visualize understand and observe
Use Cases(4 features)
Combine sequences of service invocations into reliable and observable workflows such as receipt processing in expense applications
Run line-of-business operations with workflows like order fulfillment and tracking automation
Implement batch and real-time data pipelines using workflows that sequence exports transformations queries and machine learning jobs
Automate cloud infrastructure with workflows that control Google Cloud services such as security compliance monitoring
Security(3 features)
Workflows run in a sandboxed environment with no code dependencies that require security patches
Orchestrate work of any Google Cloud product without worrying about authentication using proper service accounts
Store and retrieve secrets with Secret Manager
Monitoring(2 features)
Out-of-the-box integration with Cloud Logging with automatic and custom entries provides insight into each workflow execution
Cloud Monitoring tracks execution volume error rates and execution time
Automation(1 features)
Automate conditions based on input and service responses
Cost Calculator
Pricing data not available for Google Cloud Workflows. Check their website for current pricing.