Zeljko Obrenovic' Technology Catalog

Application integration is the process of enabling independently designed applications to work together. Commonly required capabilities include:

Messaging (5)

Event Bus (2)

Streaming (3)

Workflow Management (3)

API Management (7)

Messaging (5)

Asynchronous Messaging is a communication method where a message is placed in a message queue and does not require an immediate response to move forward with processing.

[AWS] Simple Notification Service (SNS)
Fully managed pub/sub messaging for microservices, distributed systems, and serverless applications.
Amazon Simple Notification Service (SNS) is a highly available, durable, secure, fully managed pub/sub messaging service that enables you to decouple microservices, distributed systems, and serverless applications. Amazon SNS provides topics for high-throughput, push-based, many-to-many messaging. Using Amazon SNS topics, your publisher systems can fan out messages to a large number of subscriber endpoints for parallel processing, including Amazon SQS queues, AWS Lambda functions, and HTTP/S webhooks. Additionally, SNS can be used to fan out notifications to end users using mobile push, SMS, and email.

You can get started with Amazon SNS in minutes by using the AWS Management Console, AWS Command Line Interface (CLI), or AWS Software Development Kit (SDK).

Source: https://d1.awsstatic.com/product-marketing/SNS/product-page-diagram_SNS_how-it-works_1.53a464980bf0d5a868b141e9a8b2acf12abc503f.png

Links:
- aws.amazon.com/sns
[AWS] Simple Queue Service (SQS)
Fully managed message queues for microservices, distributed systems, and serverless applications.
Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. SQS eliminates the complexity and overhead associated with managing and operating message oriented middleware, and empowers developers to focus on differentiating work. Using SQS, you can send, store, and receive messages between software components at any volume, without losing messages or requiring other services to be available. Get started with SQS in minutes using the AWS console, Command Line Interface or SDK of your choice, and three simple commands.

SQS offers two types of message queues. Standard queues offer maximum throughput, best-effort ordering, and at-least-once delivery. SQS FIFO queues are designed to guarantee that messages are processed exactly once, in the exact order that they are sent.

Source: https://miro.medium.com/max/1400/1*rvUfSxVuRjAjp8M3YywYAQ.png

Links:
- aws.amazon.com/sqs
[AWS] MQ
Managed message broker service for Apache ActiveMQ.
Amazon MQ is a managed message broker service for Apache ActiveMQ that makes it easy to set up and operate message brokers in the cloud. Message brokers allow different software systems–often using different programming languages, and on different platforms–to communicate and exchange information. Amazon MQ reduces your operational load by managing the provisioning, setup, and maintenance of ActiveMQ, a popular open-source message broker. Connecting your current applications to Amazon MQ is easy because it uses industry-standard APIs and protocols for messaging, including JMS, NMS, AMQP, STOMP, MQTT, and WebSocket. Using standards means that in most cases, there’s no need to rewrite any messaging code when you migrate to AWS.

Source: https://d2908q01vomqb2.cloudfront.net/1b6453892473a467d07372d45eb05abc2031647a/2018/02/20/message-lifecycle.jpg

Links:
- aws.amazon.com/amazon-mq
[Google Cloud] Pub/Sub
Global messaging and event ingestion made simple.
Whether you’re just beginning your journey to event-driven asynchronous microservices or migrating an existing system, making your events accessible through messaging middleware is a critical early step. Application developers on GCP rely on Cloud Pub/Sub to reliably deliver each event to all the services that must react to it.

Upon event publication to Cloud Pub/Sub, push subscriptions deliver the event to serverless apps running in Cloud Functions, App Engine, or Cloud Run and pull subscriptions make it available to more complex stateful services running in Google Kubernetes Engine or Cloud Dataflow. Multi-region environments operate seamlessly because of Cloud Pub/Sub’s global nature.

Source: https://lh3.googleusercontent.com/0BAiaS6Tp331qFe4ekq2trQS6SiRUenG6mMEpHmTLASsvRyGZaub1rEWnVDa4lkRRokWkLBPc8TN=e14-rj-sc0xffffff-w3004

Links:
- cloud.google.com/pubsub
[Azure] Service Bus
Reliable cloud messaging as a service (MaaS) and simple hybrid integration.
Depend on Azure Service Bus when you need highly-reliable cloud messaging service between applications and services, even when one or more is offline. Available in every Azure region, this fully-managed service eliminates the burdens of server management and licensing. Asynchronous operations give you flexible, brokered messaging between client and server, along with structured first-in, first-out (FIFO) messaging, and publish/subscribe capabilities—excellent for tasks like order processing.

Source: https://docs.microsoft.com/en-us/azure/service-bus-messaging/media/service-bus-messaging-overview/about-service-bus-queue.png

Source: https://docs.microsoft.com/en-us/azure/service-bus-messaging/media/service-bus-messaging-overview/about-service-bus-topic.png

Links:
- azure.microsoft.com/en-us/services/service-bus

Event Bus (2)

Asynchronous messaging at massive scale.

[AWS] EventBridge
Serverless event bus that connects application data from your own apps, SaaS, and AWS services.
Amazon EventBridge is a serverless event bus that makes it easy to connect applications together using data from your own applications, integrated Software-as-a-Service (SaaS) applications, and AWS services. EventBridge delivers a stream of real-time data from event sources, such as Zendesk, Datadog, or Pagerduty, and routes that data to targets like AWS Lambda. You can set up routing rules to determine where to send your data to build application architectures that react in real time to all of your data sources. EventBridge makes it easy to build event-driven applications because it takes care of event ingestion and delivery, security, authorization, and error handling for you. Schema Registry - Now in Preview: As your applications become more interconnected through events, you need to spend more effort in finding events and understanding their structure in order to write code to react to those events. The Amazon EventBridge schema registry stores event structure - or schema - in a shared central location and maps those schemas to code for Java, Python, and Typescript so it’s easy to use events as objects in your code. Schema from your event bus can be automatically added to the registry through the schema discovery feature. You can connect to and interact with the schema registry from the AWS Management Console, APIs, or the SDK Toolkits for Jetbrains (Intellij, PyCharm, Webstorm, Rider) and VS Code.

Source: https://d1.awsstatic.com/re19/unite/product-page-diagram-EventBridge_How-it-works.96da753d6591f93925f16716142f98d849c2ee0e.png

Links:
- aws.amazon.com/eventbridge
[Azure] Event Grid
Get reliable event delivery at massive scale.
Use Event Grid to power your event-driven and serverless apps. Simplify your event-based apps with Event Grid, a single service for managing routing of all events from any source to any destination. Designed for high availability, consistent performance, and dynamic scale, Event Grid lets you focus on your app logic rather than infrastructure.

Source: https://docs.microsoft.com/en-us/azure/event-grid/media/overview/functional-model.png

Links:
- azure.microsoft.com/en-us/services/event-grid

Streaming (3)

Streaming data refers to data that is continuously generated, usually in high volumes and at high velocity.

[AWS] Managed Streaming for Apache Kafka (Amazon MSK)
Fully managed, highly available, and secure Apache Kafka service.
Amazon MSK is a fully managed service that makes it easy for you to build and run applications that use Apache Kafka to process streaming data. Apache Kafka is an open-source platform for building real-time streaming data pipelines and applications. With Amazon MSK, you can use native Apache Kafka APIs to populate data lakes, stream changes to and from databases, and power machine learning and analytics applications.

Apache Kafka clusters are challenging to setup, scale, and manage in production. When you run Apache Kafka on your own, you need to provision servers, configure Apache Kafka manually, replace servers when they fail, orchestrate server patches and upgrades, architect the cluster for high availability, ensure data is durably stored and secured, setup monitoring and alarms, and carefully plan scaling events to support load changes. Amazon MSK makes it easy for you to build and run production applications on Apache Kafka without needing Apache Kafka infrastructure management expertise. That means you spend less time managing infrastructure and more time building applications.

With a few clicks in the Amazon MSK console you can create highly available Apache Kafka clusters with settings and configuration based on Apache Kafka’s deployment best practices. Amazon MSK automatically provisions and runs your Apache Kafka clusters. Amazon MSK continuously monitors cluster health and automatically replaces unhealthy nodes with no downtime to your application. In addition, Amazon MSK secures your Apache Kafka cluster by encrypting data at rest.

Source: https://d1.awsstatic.com/r2018/h/MSK/product-page-diagram_MSK-How-It-Works2.9861606c31eb29d4027e33ecca439cb9d59f491a.png

Source: https://docs.aws.amazon.com/msk/latest/developerguide/images/msk-architecture-visio-reduced-size.png

Links:
- aws.amazon.com/msk
Google Dataflow
Fast, unified stream and batch data processing.
Dataflow is a fully managed streaming analytics service that minimizes latency, processing time, and cost through autoscaling and batch processing. With its serverless approach to resource provisioning and management, you have access to virtually limitless capacity to solve your biggest data processing challenges, while paying only for what you use.

Source: https://miro.medium.com/max/3250/1*FDttEYL6RFn09aYWBbN5Rg.png

Source: https://storage.googleapis.com/gweb-cloudblog-publish/images/Market_data_on_cloud.max-1400x1400.png

Source: https://miro.medium.com/max/3296/1*OaVwGy1MNotrx3Oi6a9Zeg.png

Links:
- cloud.google.com/dataflow
[Azure] Stream Analytics
A real-time analytics and complex event-processing engine that is designed to analyze and process high volumes of fast streaming data from multiple sources simultaneously.
Azure Stream Analytics is a real-time analytics and complex event-processing engine that is designed to analyze and process high volumes of fast streaming data from multiple sources simultaneously. Patterns and relationships can be identified in information extracted from a number of input sources including devices, sensors, clickstreams, social media feeds, and applications. These patterns can be used to trigger actions and initiate workflows such creating alerts, feeding information to a reporting tool, or storing transformed data for later use. Also, Stream Analytics is available on Azure IoT Edge runtime, and supports the same exact language or syntax as cloud.

Links:
- cloud.google.com/dataflow

Workflow Management (3)

Setting-up, optimizing and monitoring a defined sequence of tasks, arranged as a workflow application.

[AWS] Step Functions
Build distributed applications using visual workflows.
AWS Step Functions lets you coordinate multiple AWS services into serverless workflows so you can build and update apps quickly. Using Step Functions, you can design and run workflows that stitch together services, such as AWS Lambda, AWS Fargate, and Amazon SageMaker, into feature-rich applications. Workflows are made up of a series of steps, with the output of one step acting as input into the next. Application development is simpler and more intuitive using Step Functions, because it translates your workflow into a state machine diagram that is easy to understand, easy to explain to others, and easy to change. Step Functions automatically triggers and tracks each step, and retries when there are errors, so your application executes in order and as expected. With Step Functions, you can craft long-running workflows such as machine learning model training, report generation, and IT automation. You can also build high volume, short duration workflows such as IoT data ingestion, and streaming data processing.

Source: https://d1.awsstatic.com/product-marketing/Step%20Functions/sfn_how-it-works.f795601e8338db32506b9abb01e71704f483fc81.png

Source: https://d1.awsstatic.com/Getting%20Started/create-a-serverless-workflow-step-functions-lambda/03c.585ec28744d135883e456a3334b4351b01d56c97.png

Links:
- aws.amazon.com/step-functions
[Google Cloud] Composer
A fully managed workflow orchestration service built on Apache Airflow.
Cloud Composer is a fully managed workflow orchestration service that empowers you to author, schedule, and monitor pipelines that span across clouds and on-premises data centers. Built on the popular Apache Airflow open source project and operated using the Python programming language, Cloud Composer is free from lock-in and easy to use.

Source: https://cloud.google.com/solutions/images/automating-infrastructure-using-cloud-composer-graph-view.png

Source: https://cloud.google.com/composer/docs/images/architecture.svg

Links:
- cloud.google.com/composer
[Azure] Logic Apps
Quickly build powerful integration solutions.
Connect your business-critical apps and services with Azure Logic Apps, automating your workflows without writing a single line of code.

Source: https://docs.microsoft.com/en-us/azure/logic-apps/media/logic-apps-overview/azure-logic-apps-designer.png

Links:
- azure.microsoft.com/en-us/services/logic-apps

API Management (7)

The process of creating and publishing web application programming interfaces (APIs), enforcing their usage policies, controlling access, nurturing the subscriber community, collecting and analyzing usage statistics, and reporting on performance.

[AWS] API Gateway
Create, maintain, and secure APIs at any scale.
Amazon API Gateway is a fully managed service that makes it easy for developers to create, publish, maintain, monitor, and secure APIs at any scale. APIs act as the "front door" for applications to access data, business logic, or functionality from your backend services. Using API Gateway, you can create RESTful APIs and WebSocket APIs that enable real-time two-way communication applications. API Gateway supports containerized and serverless workloads, as well as web applications.

API Gateway handles all the tasks involved in accepting and processing up to hundreds of thousands of concurrent API calls, including traffic management, CORS support, authorization and access control, throttling, monitoring, and API version management. API Gateway has no minimum fees or startup costs. You pay for the API calls you receive and the amount of data transferred out and, with the API Gateway tiered pricing model, you can reduce your cost as your API usage scales.

Source: https://d1.awsstatic.com/serverless/New-API-GW-Diagram.c9fc9835d2a9aa00ef90d0ddc4c6402a2536de0d.png

Links:
- aws.amazon.com/api-gateway
[AWS] AppSync
Power your applications with the right data, from one or more data sources, at global scale.
AWS AppSync simplifies application development by letting you create a flexible API to securely access, manipulate, and combine data from one or more data sources. AppSync is a managed service that uses GraphQL to make it easy for applications to get exactly the data they need.

With AppSync, you can build scalable applications, including those requiring real-time updates, on a range of data sources such as NoSQL data stores, relational databases, HTTP APIs, and your custom data sources with AWS Lambda. For mobile and web apps, AppSync additionally provides local data access when devices go offline, and data synchronization with customizable conflict resolution, when they are back online.

AWS AppSync is generally available. If you would like to try building data driven mobile and web applications, watch the re:Invent session video to learn more and open the AWS AppSync console to get started. For pricing details, please see the pricing page. AWS AppSync is available in multiple regions. For details on region availability, please see the regions detail page.

Source: https://d1.awsstatic.com/AppSync/product-page-diagram_AppSync@2x.d46d96d1e27169aa5005223299068da899280538.png

Links:
- aws.amazon.com/appsync
[Azure] API Management
Hybrid, multi-cloud management platform for APIs across all environments.
Today's innovative enterprises are adopting API architectures to accelerate growth. Streamline your work across hybrid and multi-cloud environments with a single place for managing all your APIs.

Source: https://azurecomcdn.azureedge.net/cvt-e918f8bc2be525756af58617c14443351ac83a8fd87a0b28d31919d627969098/images/page/services/api-management/transform-image.jpg

Source: https://azurecomcdn.azureedge.net/cvt-e918f8bc2be525756af58617c14443351ac83a8fd87a0b28d31919d627969098/images/page/services/api-management/accelerate-image.jpg

Links:
- azure.microsoft.com/en-us/services/api-management
[Google Cloud] Endpoints
Develop, deploy, and manage APIs on any Google Cloud back end.
Develop, deploy, protect, and monitor your APIs with Cloud Endpoints. An NGINX-based proxy and distributed architecture give unparalleled performance and scalability. Using an OpenAPI Specification or one of our API frameworks, Cloud Endpoints gives you the tools you need for every phase of API development and provides insight with Cloud Logging, Cloud Monitoring, and Cloud Trace.

Source: https://lh3.googleusercontent.com/77WNpDgElb-qSWgt5EEeTB4wB2kaBKz4Ua9G26-ueMfZms_a_tqytA435mj-iI_dEWrYMCc9hehI=e14-rj-sc0xffffff-w2540

Links:
- cloud.google.com/endpoints
[Google Cloud] Apigee API Management Platform
Design, secure, analyze, and scale APIs anywhere with visibility and control.
Source: https://cloud.google.com/images/apigee/api-management/api-management-platform.png

Source: https://cloud.google.com/images/apigee/api-management/developer-portal/unleash-api-products-to-market.png

Source: https://docs.apigee.com/api-platform/images/API-Prod_a1.png

Source: https://cloud.google.com/images/apigee/api-management/secure-apis/complete-intelligent-security-solution.png

Source: https://cloud.google.com/images/apigee/api-management/publish-apis/manage-developer-registration.png

Source: https://cloud.google.com/images/apigee/api-management/publish-apis/build-developer-portals.png

Source: https://cloud.google.com/images/apigee/api-management/publish-apis/manage-content-and-community.png

Source: https://cloud.google.com/images/apigee/api-management/analyze-apis/improve-developer-experience.png

Source: https://cloud.google.com/images/apigee/api-management/analyze-apis/proactive-risk-management.png

Source: https://cloud.google.com/images/apigee/api-management/monitor-apis/precision-diagnosis.png

Links:
- cloud.google.com/apigee/api-management
[Google Cloud] Apigee Hybrid
Hybrid deployment option for managing APIs.
Your APIs serve a variety of use cases from internal applications to digital ecosystems, so it’s no surprise that you leverage a mix of on-premises and cloud infrastructure to host those APIs. With Apigee hybrid, you have the power to choose where to host that API traffic—on-premises, Google Cloud, or hybrid. With an enterprise-grade hybrid gateway, embrace an API-first approach across all facets of your business with the flexibility of hybrid deployment.

Source: https://docs.apigee.com/hybrid/v1.2/images/arch-toplevel2.png

Source: https://docs.apigee.com/hybrid/v1.2/images/arch-runtime.png

Source: https://docs.apigee.com/hybrid/v1.2/images/arch-mart.png

Source: https://docs.apigee.com/hybrid/v1.2/images/arch-management.png

Links:
- cloud.google.com/apigee/api-management/hybrid
[Google Cloud] Healthcare API
Accelerate your healthcare solution development with fully managed, enterprise-scale, HL7® FHIR®, HL7® v2, and DICOM® APIs.
Cloud Healthcare API allows easy and standardized data exchange between healthcare applications and solutions built on Google Cloud. With support for popular healthcare data standards such as HL7® FHIR®, HL7® v2, and DICOM®, the Cloud Healthcare API provides a fully managed, highly scalable, enterprise-grade development environment for building clinical and analytics solutions securely on Google Cloud. The Cloud Healthcare API also includes additional value-added capabilities, such as automated DICOM and FHIR de-identification to better prepare data for these solutions.

Cloud Healthcare API provides a pathway to intelligent analytics and machine learning capabilities in Google Cloud with pre-built connectors for streaming data processing in Dataflow, scalable analytics with BigQuery, and machine learning with AI Platform.

The Cloud Healthcare API is backed by Google Cloud’s privacy and security features, supports HIPAA compliance, and is in scope for Google Cloud’s ISO/IEC 27001, ISO/IEC 27017, and ISO/IEC 27018 certifications. In addition, Google Cloud is HITRUST CSF certified.

Source: https://lh3.googleusercontent.com/9YxIjv-oRL-rbddLgPdi6p2LCtFQtowIp5khNN4LZtHF7c-p4L5ncV4KouvJTSB27ZzpjHhZ5Q=e14-rj-sc0xffffff-w1270

Links:
- cloud.google.com/healthcare

Public Clouds Encyclopedia: Application Integration

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links:

Links: