Microsoft Exams – DP-203 Azure Data Engineer

3 Minutes

Azure Synapse Analytics Event Delivery Guarantees Kappa Architecture Microsoft DP-203 Microsoft Exams Process Time Series Data

Configure Checkpoints/Watermarking During Processing – Design and Implement a Data Stream Processing Solution-3

Katie Cox 2024-08-07 0 Comment

An important metric to call out is Watermark Delay. The values represented in the metric indicate the realized processing delay of the event message. Under normal operation the Watermark...

4 Minutes

Microsoft DP-203 Microsoft Exams

Azure Databricks – Design and Implement a Data Stream Processing Solution

Katie Cox 2024-05-12 0 Comment

In Exercise 7.6 you created a stream processing solution using Azure Databricks. That stream processing solution used the Append output mode and displayed the data stream in the console,...

5 Minutes

Kappa Architecture Microsoft DP-203 Microsoft Exams

Azure Databricks – Design and Implement a Data Stream Processing Solution

Katie Cox 2023-10-26 0 Comment

An alternative to using Azure Stream Analytics for real‐time or near real‐time stream processing is Azure Databricks. If your current streaming solution uses Kafka and your team’s primary programming...

3 Minutes

Microsoft DP-203 Microsoft Exams Process Time Series Data

Stream Data to Power BI from Azure Stream Analytics – Design and Implement a Data Stream Processing Solution-1

Katie Cox 2023-05-27 0 Comment

FIGURE 7.19 Power BI Azure Stream Analytics output configuration FIGURE 7.20 The brainjammer streaming dataset in Power BI FIGURE 7.21 Adding a real‐time data tile to the Power BI...

3 Minutes

Event Delivery Guarantees Microsoft DP-203 Microsoft Exams

Process Time Series Data – Design and Implement a Data Stream Processing Solution

Katie Cox 2023-02-26 0 Comment

The streaming of data from an IoT device, like a BCI, is an ideal fit for time series analysis. The data in this context is ideal because the data...

3 Minutes

Azure Synapse Analytics Microsoft DP-203 Microsoft Exams

Process Data Across Partitions – Design and Implement a Data Stream Processing Solution

Katie Cox 2023-01-07 0 Comment

Streaming scenarios often do not meet the requirements necessary to achieve the parallelization achieved by partitioning. The most obvious example is related to the brainjammer brain wave solution implemented...

3 Minutes

Kappa Architecture Microsoft DP-203 Microsoft Exams

Develop a Stream Processing Solution with Azure Stream Analytics – Design and Implement a Data Stream Processing Solution-1

Katie Cox 2022-12-08 0 Comment

FIGURE 7.12 Develop a stream processing solution Azure Stream Analytics output type Azure Synapse Analytics. FIGURE 7.13 Develop a stream processing solution Azure Stream Analytics simulate streamed brain waves....

2 Minutes

Azure Synapse Analytics Microsoft DP-203 Microsoft Exams

Develop a Stream Processing Solution with Azure Stream Analytics – Design and Implement a Data Stream Processing Solution

Katie Cox 2022-10-22 0 Comment

FIGURE 7.10 Test sample data upload in Azure Stream Analytics FIGURE 7.11 The result of test data uploaded in Azure Stream Analytics In Exercise 7.2 you received a working...

3 Minutes

Event Delivery Guarantees Microsoft DP-203 Microsoft Exams

Azure Event Hubs – Design and Implement a Data Stream Processing Solution

Katie Cox 2022-03-27 0 Comment

In Exercise 3.16 you provisioned a Basic tier Event Hubs namespace, and in Exercise 3.17 you configured it as an Azure Stream Analytics input. An important aspect of Azure...

4 Minutes

Event Delivery Guarantees Kappa Architecture Microsoft DP-203 Microsoft Exams

Data Stream Processing Considerations – Design and Implement a Data Stream Processing Solution

Katie Cox 2021-03-15 0 Comment

The following sections discuss many of the decision points and considerations that will enable you to choose the product that best fits your requirements. For a quick overview of...