課程簡介
介紹
Spark Streaming 功能和體系結構概述
- 支持的數據源
- 核心 API
準備環境
- 依賴
- Spark 和流式處理上下文
- 連接到 Kafka
處理消息
- 將入站消息解析為 JSON
- ETL 過程
- 啟動流式處理上下文
執行視窗化Stream Processing
- 滑動間隔
- 檢查點交付配置
- 啟動環境
處理代碼的原型設計
- 連接到 Kafka 主題
- 使用 Paw 從數據源檢索 JSON
- 變化和附加處理
流式傳輸代碼
- 作業控制變數
- 定義要匹配的值
- 功能和條件
獲取流輸出
- 計數器
- Kafka 輸出(符合和非符合)
故障排除
總結和結論
最低要求
- 具有 Python 和 Apache Kafka 的經驗
- 熟悉流處理平臺
觀眾
- 數據工程師
- 數據科學家
- 程式師
客戶評論 (5)
As I was the only participant the training could be adapted to my needs.
Kevin THIERRY
Course - Web Development with Web2Py
範例/練習完全適合我們的領域
Luc - CS Group
Course - Scaling Data Analysis with Python and Dask
機器翻譯
培訓師非常樂意回答我所做的所有問題
Caterina - Stamtech
Course - Developing APIs with Python and FastAPI
機器翻譯
It was a though course as we had to cover a lot in a short time frame. Our trainer knew a lot about the subject and delivered the content to address our requirements. It was lots of content to learn but our trainer was helpful and encouraging. He answered all our questions with good detail and we feel that we learned a lot. Exercises were well prepared and tasks were tailored accordingly to our needs. I enjoyed this course
Bozena Stansfield - New College Durham
Course - Build REST APIs with Python and Flask
傳授培訓師的實踐知識和經驗。
Rumel Mateusz - Pojazdy Szynowe PESA Bydgoszcz SA
Course - GUI Programming with Python and PyQt
機器翻譯